ADF Copy Activity: Do we have a way to select fewer columns out of total columns in BLOB source with CSV file mapping sql RRS feed

  • Question

  •  am using ADF Custom Activity....and 40 Copy Activities in that...We have CSV as a Blob Source....We need to select few columns out of the CSV and get as input...I was trying Structure property..but its not working....Please suggest Can we do this Control over Blob Source limiting the cloumns in ADF.

    We have a section that describes about column mapping for SQL to BLOB. But this is opposite scenario.

    My scenario is different like Blob Source to SQL. As i told in the above post, I have tried with this Structure Property to Map the Columns, But its not working because i have 60 columns in the CSV file and i need only 5 columns in the CSV to be mapped to SQL.

    Thursday, July 21, 2016 11:44 AM

All replies

  • Hi Pavan,

    Are you copying from Blob Csv to SQL? If that is the case, you could do that by leveraging the column mapping feature. As the doc mentioned, we support that a subset of the columns in the source table “structure” are mapped to all columns in the sink table “structure”.

    More specifically for your case, you could set the source structure as 60 columns, set target structure as 5 columns, and set the column mapping rule as 5 columns' mappings.

    Wednesday, August 10, 2016 1:31 AM