none
File​System​Operations​Extensions.​Concat limited to 30 files

    Question

  • We use the C# api to copy files to the Data Lake Store. After copying we merge these file into a single file, using the concat function as descibed in the documentation: link

    We find that there seems to be a limit on the concat operation of 30 files. If we try to concat more files, we get an error saying only "not found". We've worked around this issue by concatenating in multiple batches. If you concatenate multiple times to the same output file, the data is appended to the file.

    Is this by design or should I submit this as a bug?

    Monday, May 22, 2017 2:53 PM