locked
Strange warning (type: InputPartitionNotProgressing) RRS feed

  • Question

  • Hi,

    I have noticed strange warning in Stream Analytics job: 

    "Message": "Input Partition [0] does not have additional data for more than [25] minute(s). Partition will not progress until either events arrive or late arrival threshold is met.",
    "Type": "InputPartitionNotProgressing",


    This warning appears every few hours. Stream job works fine, but I don't understand what this warning reffers to. We use reference data (json data - transmitted via Data Factory every day from SQL server).

    Anyone have any idea what does this warning mean?

    Thanks!


    Monday, January 8, 2018 10:44 AM

All replies

  • Hi,

    This means that one of your Event Hub partition is not receiving any data. Without any data coming to this partition, the timeline is not progressing for that partition (e.g. you may not have output event generated for this partition) until it reaches the "late arrival" threshold.  This threshold is 5 seconds by default, so it may delay output by 5 seconds if you kept the default.

    We have more information in this doc.

    Regardless of the timeline, it is recommended to balance the incoming events across all partitions so it is easier to parallelize the job.

    Thanks,

    JS

    Monday, January 8, 2018 8:08 PM