none
File Level Validation in ADF

    Question

  • Hi, 

    During the system design I come across one query from my client. 

    Req is to use ADF V2 to move data from multiple on-premise data source (structured and unstructured) to Azure Data Lake Gen2. 

    Few of the requirement they have to provide validations on 

    Source File quality checks
    Source File level Data Checkpoints

    Source File level recons process (automated)

    Is there any activity or any way to achieve it? 

    Data will be finally move to databrics and  data catalog will be maintained as well. 

    Monday, September 24, 2018 11:41 AM

All replies

  • Hello,

    Although it does not do all the things you asked, the Get Metadata activity may be useful:

    https://docs.microsoft.com/en-us/azure/data-factory/control-flow-get-metadata-activity

    Monday, September 24, 2018 4:09 PM
    Moderator