none
sync search index from data source when ever new data is added in data source in Azure search RRS feed

  • Question

  • Hi All,

     Can any one  please suggest what would be best approach to sync search index from data source when ever new data is added in data source. Schedule program or programmatically to update  search index.

    Is there any impact if frequent changes in occur in data source and re-indexing the search index.

    Thanks

    Stick.

    Wednesday, March 27, 2019 4:26 PM

All replies

  • Hi Asif,

    This sounds like you want more of a real time update of content in Azure Search as data is added to Cosmos DB. You should consider leveraging the CosmosDB change feed for this purpose. You can link this to Azure Functions so that changes in Cosmos DB triggers a function which would take this feed of changes and applies it to Azure Search using the Azure Search PUSH api.  In general, the Azure Search indexer is not well suited for cases where you need to have more real time updates of content as it is a scheduled process.

    As to your specific question, if there are a lot of changes happening, the indexing into Azure Search will have an impact on the performance of the search queries since all of the resources are shared, however Azure Search can index large amounts of content pretty efficiently so it may not be that much of an issue.  For this reason, it is important to leverage a change tracking mechanism in Azure Search indexer, so that it only requests the data that has been changed, rather than getting all of the data.  The only real answer to perf questions like this is to test the workload to make sure the performance meets their needs and adjust the search service tier to meet the requirements. 


    Thursday, March 28, 2019 2:33 AM
    Moderator