Experimenting here with Azure AI Search to index our telemetry data. We set up the data source, index, and indexer, defined the schema, and configured the indexer to process JSON Lines files stored in Azure Data Lake.

After testing, the initial indexing completed in about one second, which is quite good.

The real advantage becomes clear when this data is vectorized and exposed to agentic solutions, queries return results significantly faster, enabling more responsive and scalable AI-driven experiences. Here are some screen shots of the configuration:

#Crawler