none
Deployment of Azure Data Factory version2 Pipelines. RRS feed

  • Question

  • Hello,

    What are the different ways to deploy the adf v2 pipelines on different environment. What can be the best approach to do fast, repeatable, reliable deployments of pipelines.

    Thanks in advance.

    Friday, December 29, 2017 4:47 AM

All replies

  • I haven't seen anything yet but the best way to deploy in a faster, repeatable, reliable, .... "Framework manner" way, currently is PowerShell, that is what i do, But learning it and getting the scripts ready is hard and time consuming.

    Anyone knows a better way ???


    Sincerely Nik -- Please kindly mark the post(s) that answered your question and/or vote for the post(s). http://sqldataside.blogspot.ca/ (SQL Tabular + PowerShell)

    Sunday, December 31, 2017 7:11 PM
  • Besides using Powershell, REST API, or .NET/Python SDK, if you want to be able to deploy into different environments, you can consider using ARM (Azure Resource Management) templates.  Using ARM templates, you can define parameters for things like data factory name, region, Azure resource accounts and credentials, etc, and then deploy the ARM template repeatedly against different environments.

    Check out this quick start example:

    https://docs.microsoft.com/en-us/azure/data-factory/quickstart-create-data-factory-resource-manager-template#deploy-data-factory-entities

    Wednesday, January 3, 2018 9:53 AM
    Moderator
  • WOW Thanks Shirley, the link was very helpful

    Sincerely Nik -- Please kindly mark the post(s) that answered your question and/or vote for the post(s). http://sqldataside.blogspot.ca/ (SQL Tabular + PowerShell)

    Thursday, January 4, 2018 2:58 AM
  • Hi,

    You could use ARM as indicated by Shirley’s post, on top of that you could call this in Octopus to make it fully automated -- in that case you could just click a button to deploy the ADF pipelines to multiple environments. More details can be found on the link below:

    https://octopus.com/docs/deploying-applications/azure-deployments/resource-groups


    R
    egards

    Stephen

    • Proposed as answer by stephen huo Monday, January 8, 2018 2:30 PM
    Monday, January 8, 2018 11:11 AM