How to redirect or handle error events/rows? RRS feed

  • Question

  • Is there a way to capture and redirect data error events/rows to a separate output?

    For example, say I have events coming through and for some reason there are data conversion errors. I would like to handle those errors and do something, probably a separate output for further investigation?

    Currently in stream analytics error policy, if an event fails to be written to output we only got two options

    Drop - which just drop the events (or)
    Retry - retries writing the event until it succeeds


    Wednesday, April 6, 2016 10:30 AM


  • We currently don't have a built in solution to redirect bad data to a dedicated output. However in some cases you can write your own solution inside the query using CASE and INTO constructs. For example you have two query steps, one that detects using CASE statements and filters out bad events and direct good ones INTO good_output and another query that does the same but filters the bad events in and directs them INTO error_output.

    Hope this helps

    This posting is provided "AS IS" with no warranties, and confers no rights

    Friday, April 8, 2016 8:26 PM