none
Data lake job fails when job preparation time exceeds 25 mins

    Question

  • When processing an input file set of approximately 4000 csv files in Data Lake, the job fails with script compile error when job preparation time exceeds 25 mins

    we have a requirement to bulk process beyond 4000 csv files, Is there a solution to process a larger input file set, I have heard there is a preview solution to process an input file set as large as 30,000 files 

    Thursday, April 20, 2017 10:54 AM

All replies

  • Thanks for reaching out.  This is a dupe of a Stackoverflow post, and has been answered there. http://stackoverflow.com/questions/43517075/data-lake-job-fails-when-job-preparation-time-exceeds-25-mins 

    Thank you,

    Guy

    Monday, May 1, 2017 4:34 PM