none
Custom parallel extractor - U-SQL

    Question

  • I try create a custom parallel extractor, but i have no idea how do it correctly. I have a big files (more than 250 MB), where data for each row are stored in 4 lines. One file row store data for one column. Is this possible to create working parallely extractor for large files? I am afraid that data for one row, will be in different extents after file splitting.

    Example:

    ...
    Data for first row
    Data for first row
    Data for first row
    Data for first row
    Data for second row
    Data for second row
    Data for second row
    Data for second row
    ...

    Sorry for my English.

    Friday, April 1, 2016 8:03 PM

Answers