How to index Azure storage data to elastic cloud How to index Azure storage data to elastic cloud elasticsearch elasticsearch

How to index Azure storage data to elastic cloud


One way to approach this would be to write a console application that

  1. pulls data from Azure storage using the Storage client in the WindowsAzure.Storage nuget package or similar
  2. transforms data into documents according to your domain needs
  3. bulk indexes documents into Elasticsearch in Elastic Cloud using the .NET Elasticsearch client NEST

If data will be updated in Azure storage and will need to be frequently indexed into Elasticsearch, consider making the console application an Azure Web Job.

Another approach would be to use Logstash in conjunction with the input plugin for Azure Storage blobs.