How to populate ModifiedDate column in Azure Data Warehouse RRS feed

  • Question

  • Hi,

    I'm uploading data to the Azure data warehouse from blob CSV files using Data Factory. Is it possible to populate ModifiedDate column in DB with current time with Data Factory?

    I was planning to use this field for repeatability by using:

    "sqlWriterCleanupScript": "$$Text.Format('DELETE FROM table WHERE ModifiedDate >= \\'{0:yyyy-MM-dd HH:mm}\\' AND ModifiedDate < \\'{1:yyyy-MM-dd HH:mm}\\'', WindowStart, WindowEnd)"

    • Edited by bozza Monday, August 8, 2016 2:04 AM
    Friday, July 29, 2016 4:46 AM

All replies

  • Hello,

    Yes you can do so by doing the following:

    1. Copy the data from Blob CSV to a staging table in Azure SQL Data Warehouse

    2. Configure the stored procedure activity to trigger a stored procedure on Azure SQL Data Warehouse. The stored procedure would act on the data in the staging table and also populate the ModifiedDate column in the destination table. The stored procedure would only be configured to execute on successful completion of the copy activity

    Thanks, Harish

    Monday, August 8, 2016 4:31 AM