Not Able to Publish ADF-v2 Incremental Pipeline and Other Objects RRS feed

  • Question

  • As Earlier Posted a thread for syncing Data from Premises Mysql to Azure SQL over here referring this article, and found that lookup component for watermark detection is only available for SQL Server Only.

    So tried a work Around, that while using "Copy" Data Flow task ,will pick data greater than last watermark stored from Mysql.

    Issue: Able to validate  and debug package successfully but not able to publish same.

    Question : In Copy Data Flow Task i'm using below query to get data from MySql greater than watermark available.

    Can't we use Query like below on other relational sources like Mysql

    select * from @{item().TABLE_NAME} where @{item().WaterMark_Column} > '@{activity('LookupOldWaterMark').output.firstRow.WatermarkValue}'

    CopyTask SQL Query Preview

    CopyTask SQL Query Preview

    Validate Successfully 

    Error With no Details 

    Debug Successfully


    Thursday, March 8, 2018 4:59 AM