ADF v1 how can I orchestrate different pipelines RRS feed

  • Question

  • We have a number of data movement activities and various pipelines. Setting these on a schedule is not optimal as they are dependant on each other finishing before the next pipeline takes over. So I need to find a way to orchestrate them to run in sequence.

    For example pipeline 1 loads (stages) data from 16 tables in an on premise database to 16 equivalent tables in Azure SQL Database. 

    Pipeline 2 then runs a stored proc hosted in Azure SQL Database that transforms 16 staged tables into 5 transformed tables.

    Pipeline 2 can only run once all of pipeline 1 completes. 

    I cannot find a way to orchestrate Pipeline 1 and pipeline 2.

    The organisation is new to ADF and it currfently still seems way to immature to be taken seriously.

    'If this was helpful, please mark and an answer or as being helpful'

    Wednesday, December 13, 2017 12:13 AM

All replies