locked
Functions appear to silently fail with no information logged or exceptions thrown, never complete RRS feed

  • Question

  • Hello, 

    I am working on a Function that appears to silently fail when working with a moderate amount of data. Nothing is written in the logs about being out of memory or exceeding a time threshold, the functions appear in the monitoring tab to be running forever even after restarting the Function app. I've tried enclosing my application in a catch block to catch all instances of Exception, which the application never gets to because it looks like it just disappears as far as Azure is concerned. 

    Looking at the logs, nothing is there. For example, in this log I'm trying to process a file with a million rows, and here I'm printing out how many records have been processed as the function works through them in groups of 50,000:

    2016-10-25T18:56:12.945 Processed 50000K records.
    2016-10-25T18:56:13.633 Processed 100000K records.
    2016-10-25T18:56:14.288 Processed 150000K records.
    2016-10-25T18:56:14.945 Processed 200000K records.
    2016-10-25T18:56:15.710 Processed 250000K records.
    2016-10-25T18:56:22.023 Processed 300000K records.
    2016-10-25T18:56:22.648 Processed 350000K records.
    2016-10-25T18:56:23.429 Processed 400000K records.
    2016-10-25T18:56:24.194 Processed 450000K records.
    2016-10-25T18:56:29.210 Processed 500000K records.
    2016-10-25T18:56:29.960 Processed 550000K records.
    2016-10-25T18:56:35.194 Processed 600000K records.
    2016-10-25T18:56:36.007 Processed 650000K records.
    2016-10-25T18:56:39.147 Processed 700000K records.
    2016-10-25T18:56:56.085 Reading host configuration file 'D:\home\site\wwwroot\host.json'
    2016-10-25T18:56:56.413 Host lock lease acquired by instance ID '8cbc7c98c789cc92g61d0ac1b44181w1e'.
    2016-10-25T18:57:02.835 Generating 1 job function(s)
    2016-10-25T18:57:02.944 Starting Host (HostId=process-function, Version=1.0.10387.0, ProcessId=7274, Debug=True)
    2016-10-25T18:57:03.225 Found the following functions:
    Host.Functions.Processor
    2016-10-25T18:57:03.272 Job host started

    As you can see, nothing is printed about the job ending. It stops logging at around 700,00 rows even though there is more data to process. I've also tried to isolate if a certain row causes the issue, but it seems to happen at different rows during different runs. 

    So I'm at a bit of a loss as to where to go from here. Because even the Azure monitor tab appears to not know that they finished (right now, the functions appear to still be running from yesterday, even though the parent app service has been restarted), so it makes me think that something more core to how functions work is occurring. 

    Anyone have any thoughts on what may be occurring? 

    Thanks,

    Andy


    • Edited by Andrew W-- Wednesday, October 26, 2016 6:23 PM
    Wednesday, October 26, 2016 5:28 PM

Answers

  • Hi Andrew,

    Can you please tell function app name? So we can dig into logs.

    https://github.com/projectkudu/kudu/wiki/Reporting-your-site-name-without-posting-it-publicly 

    Thanks, Alexey

    Wednesday, October 26, 2016 9:32 PM

All replies

  • Hi Andrew,

    Can you please tell function app name? So we can dig into logs.

    https://github.com/projectkudu/kudu/wiki/Reporting-your-site-name-without-posting-it-publicly 

    Thanks, Alexey

    Wednesday, October 26, 2016 9:32 PM
  • Thanks Alexey,

    I created a target site: dummy98718

    The real thing to look at is the function app with the QFP function. 

    Thank you,

    Andy

    Tuesday, November 1, 2016 4:23 PM