none
transform data in dbf file reside in data lake

    Question

  • I have a dbf file in data lake. I want to select some data in that file and store in to the sql server.  (For local dbf file i did it using ssis. But here i want to use azure data factory.)

    Monday, September 10, 2018 4:15 AM

All replies

  • Hi,

    You need to specify an Azure data lake datastore as source and a SQL server as sink, then there're two options for you to achieve copy:

    1. Use Copy data tool in Azure data factory, here is a tutorial you could refer.

    2. Use Copy activity in Azure data factory.

    Thanks.



    • Edited by Wang Zhang Monday, September 10, 2018 5:45 AM
    Monday, September 10, 2018 5:45 AM
  • Thanks for the reply.

    But the problem is, that not support for dbf file type.

    Tuesday, September 11, 2018 6:14 AM
  • Hi,

    Here are the ADF supported file types:

    https://docs.microsoft.com/en-us/azure/data-factory/supported-file-formats-and-compression-codecs

    I do not see that DBF is supported at this time.  You might try a custom activity to do a conversion to a supported file type before the copy:

    https://docs.microsoft.com/en-us/azure/data-factory/transform-data-using-dotnet-custom-activity

    Monday, September 24, 2018 7:59 PM
    Moderator