Using reference data generated by an Azure Data Factory RRS feed

  • Question

  • Hi,

    I have an Azure Stream Analytics job which uses reference data from an Azure Storage Account. The two files I use are generated by an Azure Data Factory. Its pipeline is set to run at 00:00 and configured to, for example, create the output folder '/<path>/2017-04-11/' and put a new file into it on 2017-04-11 00:00. The relevant components are all set to <path>/{date}/<file> with format yyyy-MM-dd, so the Stream Analytics job should always use today's data.

    I was wondering what exactly the job does if there's no file present for the current day. Tonight, the pipeline created a new folder and file at 00:01:24. So technically, there was no current data for 84 seconds. But since there were no anomalies in the Stream Analytics job, I guess there's some mechanism that reads data for the previous day when the current day is not yet available?

    Thanks, Tobias

    Tuesday, April 11, 2017 8:55 AM