none
U-SQL EXTRACT CSV - Various NB Columns RRS feed

  • Question

  • Hello,

    I'm using U-SQL to extract multiple CSV files with the command :

    @InputFiles =
        EXTRACT xxxxxx string,
                xxxxxx string,
                xxxxxx string,
                xxxxxx string
        FROM @In
        USING new Aircraft.Analytics.Extract.DataReader(Encoding.UTF8);

    This code works fine, my problem is I don't have a defined number of columns. Some files have only 65 columns and others have 400 columns. 

    It seems my Extract command should be dynamic, is it possible ? Same for the Types

    Any idea how can I deal with it ?

    Many thanks.

    Monday, September 18, 2017 9:54 AM