none
Moving Files from blob folders Year/Month All Failed. How to run everything again

    Question

  • Hi,

    Really struggling with Data Factory during training.

    I have 3 months of data going in from Year and Month Folders. I ran the pipeline and it errored. Ive changed something in Json but I don't know how to rerun the whole pipeline. I can rerun a day by clicking on a date in  Activity Window Explorer but I cant figure out how to rerun everything.

    Also if you make a mess of some code and have to update it, Can you clear all your fails and try again from scratch?

    Any help would be appreciated

    Debbie

    Friday, September 28, 2018 5:40 PM

All replies

  • I would immediately think of using Azure SDK for achieving the batch running of pipelines

    From docs https://docs.microsoft.com/en-us/azure/data-factory/concepts-pipeline-execution-triggers

    We can manually run your pipeline by using one of the following methods:

    .NET SDK
    Azure PowerShell module
    REST API
    Python SDK

    there are examples given for each method in the above document page.

    Looking at .NET SDK option, you may refer to following section of docs for code

    https://docs.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-dot-net#create-a-pipeline-run

    hope it helps.
    Friday, September 28, 2018 5:49 PM
  • Hello,

    checking to see if you are able to proceed with resolving your query. if you need further information, please let know.

    if above response has helped you resolve issue, you may vote the post as helpful or mark as an answer.

    Tuesday, October 2, 2018 12:10 PM