Activity Parallelization RRS feed

  • Question

  • I want to run my activity code, or a subset of the code in it for each input file (they are organized by yyyy/mm/dd/hh/<natural key>.txt.  Is there a way to apportion the work out to the batch pool through any method other than spinning up a BatchClient and writing a non-data factory batch job that it gives tasks to?
    Monday, February 6, 2017 10:38 PM

All replies

  • Maybe one option would be to use Azure Data Lake Analytics which will automatically do some parallelization when it builds it's DAG.
    Tuesday, February 7, 2017 12:31 AM