locked
ADF and multi-tenant Azure SQL Databases RRS feed

  • Question

  • Hi,
    In my scenario, I have to copy some data from CSV files from Data Lake into Azure SQL Database in multi-tenant environment (Azure SQL DBs and Elastic Pools). Is there any way to achieve such functionality using Azure Data Factory ?
    I have been looking around for a while but it seems it is not possible.
    Do you have any ideas how to approach such scenario in Azure (excluding usage of PolyBase in Azure DW and HDInsight) ?

    Thanks in advance.

    Greets,
    Jędrzej

    Monday, March 13, 2017 3:56 PM

All replies

  • Data Factory can help you here.  Here are a couple of how-tos that should help.

    https://docs.microsoft.com/en-us/azure/data-factory/data-factory-azure-copy-wizard 

    https://docs.microsoft.com/en-us/azure/data-factory/data-factory-azure-sql-connector

    https://docs.microsoft.com/en-us/azure/data-factory/data-factory-azure-datalake-connector

    I hope this helps

    Guy

    Monday, March 13, 2017 4:36 PM
  • Thanks Guy. My scenario is a little bit more complex. I have multi-tenant application with sharded databases (Azure SQL database per tenant). It requires implementation of some kind of "data dependent routing" in Azure Data Factory - I am trying to figure it out whether it is possible.

    Jędrzej

    Tuesday, March 14, 2017 8:34 AM
  • Got it, let me bring someone from the SQL DB team into the conversation.

    Guy

    Tuesday, March 14, 2017 2:37 PM
  • Hi Jedrzej,

    To make sure I understand your scenario, are you looking for pushing the same set of data (CSV in Data Lake) into a number of Azure SQL DBs which belong to different end users? Correct if I'm wrong. If the case, using ADF, you can config multiple copy activities with each one handling CSV -> one DB data loading. In other word, config one copy activity per tenant/Azure SQL DB. Will this work? 

    Thanks,

    Linda

    Wednesday, March 15, 2017 11:09 AM