none
Azure data factory sink wildcard RRS feed

  • Question

  • hello guyz,

    i want to copy all data of directory in ADLS  to a another directory ( in parquet format) and change the extension of all the file to .parquet

    i already know how to copy recursively all the file with the same hierarchy but the ".csv" extension don't change and if i add a wildcard "*.parquet" in the sink i have this error

    Wildcard in path is not supported in sink dataset

    thanks

    Thursday, January 10, 2019 3:01 PM

All replies

  • Hi,

    As mentioned in the error, wildcards are not supported in sink dataset. You can however convert the format of the files with other ways. Have a look at this post for one way :

    https://stackoverflow.com/questions/50929417/azure-data-factory-csv-to-parquet-changing-file-extension

    Let us know if it helps. Else we can continue to probe in further.


    MSDN

    Friday, January 11, 2019 7:49 AM
    Owner