locked
Process Events: Node shutdown due to high memory utilization. RRS feed

  • Question

  • I'm getting the error in the Stream analytics.

    Process Events: Node shutdown due to high memory utilization.

    My job tries to take single 500+mB json file from BLOB storage and select some data into two different SQL tables.

    Can you please reccomend the best approach for my case?

    Thank you.

    Tuesday, December 6, 2016 3:40 PM

All replies

  • Hi Obushakv,

    Depending on your query, you could try increasing the number of SUs and parallelize your processing using partitioning based on our scaling guidance here:

    https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-scale-jobs

    You could also write your query to filter out some information earlier in the query.


    If you can share your query here, we may be able to help optimize it further.

    Thanks,

    Dushyant

    Tuesday, December 6, 2016 10:54 PM