locked
Parquet file contained column 'errCol', which is of a non-primitive, unsupported type RRS feed

  • Question

  • Hello,

    We are trying to read on-premise Hadoop HDFS. When creating a dataset that is pointing to Parquet files folder, we get "Parquet file contained column 'errCol', which is of a non-primitive, unsupported type. "

    We get this error over any folder within HDFS folders.

    Any ideas how to resolve it?

    Thank you

    R


    • Edited by romankjr Tuesday, February 25, 2020 6:00 AM
    Monday, February 24, 2020 8:21 PM

Answers

  • Hello,

    You may receive this error message, when you pass the columns which are unsupported data type in parquet files.

    You may checkout the file contained column “errCol” data type and make sure you are using the supported data type.

    These are the supported data type mappings for parquet files.

    For more details, refer “ADF – Supported file formats - Parquet”.

    Hope this helps. Do let us know if you any further queries.

    ----------------------------------------------------------------------------------------

    Do click on "Mark as Answer" and Upvote on the post that helps you, this can be beneficial to other community members.

    Tuesday, February 25, 2020 6:08 AM