locked
Azure Batch blob source scaling RRS feed

  • Question

  • I'm using azure batch to process files that are stored inside a Blob storage account.
    The input for this activity is the blob storage account.

    The Batch-pool I use has 1 node assigned to it. This node processes the activity. It processes all the files that are present, and associated with the given slice.

    I would like to use a pool with multiple nodes that each handle the processing of 1 file, without creating an activity for each individual file. Is there a way to do this?

    Kind regards,

    -Florian

    Wednesday, October 19, 2016 8:19 AM

All replies

  • Unfortunately, this is not supported on ADF. Custom activity cannot be scale by file count.

    • Proposed as answer by Charles Gu Wednesday, October 26, 2016 2:37 AM
    Monday, October 24, 2016 2:45 AM