How to get just certain data from azure blob storage in Azure Data Factory performing copy activity with destination as SQL database? RRS feed

  • Question

  • I am trying to perform Copy Activity inside Azure Data Factory where the source are Blobs (JSON) and destination is MySql database.

    I do not want certain data to be copied during that activity and that can be determined by reading First key value Element of the Blob's JSON.

    Or maybe if it is not possible to stop reading all the BLOB data then at least while writing inside the SQL table I want just some specific data(Like some jsons should be copied and some filtered out on the basis of a key value present inside blob).

    The main focus is to reduce the cost of writing irrelevant data, and to decrease the storage after writing.

    • Edited by Gaganss Wednesday, May 22, 2019 9:30 AM
    Wednesday, May 22, 2019 9:23 AM

All replies

  • I think you already have few suggestions here 


    Thanks Himanshu

    Wednesday, May 22, 2019 9:07 PM