ADF Data Movement process RRS feed

  • Question

  • Hello All

    I want to copy query output from On premise database to Azure blob using data factory and gateway.

    For better performance, Shall I use sql query as input to ADF pipeline and store the query output in Azure blob. OR use BCP out command to store the query output to a file in source db side and Move this file to Azure BLOB storage.  

    please advise on this 

    If I use query as a source in ADF copy activity, will it copy data in cursor based approach (row by row) or all data at once?  

    • Edited by Sqlindia Tuesday, September 26, 2017 5:31 PM
    Tuesday, September 26, 2017 5:28 PM

All replies

  • Hi there, the second approach you mentioned (using BCP out to a file on premises and then binary copy this file to Azure Blob) will achieve higher throughput.

    For your second question, the data extraction is done in batch, not in a row-by-row fashion.

    Wednesday, September 27, 2017 9:34 AM