Finding the bottle necks to improve throughput RRS feed

  • Question

  • I need to transfer some large tables out of our Azure Data Warehouse and into individual Azure SQL Databases.  I have yet to find the settings needed to achieve greater than 7-9 MB/s transfer rates.  I'm trying a combination of the following values:

    Data Warehouse 2000 DWUs

    SQL Database P6

    Batch Size 100,000

    The tables (10-15 in total) have anywhere from 25 million to 1+billion rows.  They are not wide tables, roughly 10 - 20 columns.  Is it possible to identify where the bottle neck is that is limiting my transfer rates?  Is it the DW, the batch size, the SQL Database?  I have parallelCopies set to 14 and cloudUnits set to 8, although I'm not sure my transfer can utilize all of that.  I saw in the documentation to contact Azure Support if I needed greater than 8 cloudUnits but I'm not sure if that is what is holding me back.

    • Edited by BamWillis Monday, January 23, 2017 9:20 PM
    Monday, January 23, 2017 4:53 PM

All replies