Data strategy for aggregating by month for CSV files by day RRS feed

  • Question

  • I'm bringing every night data from Azure Storage to Azure Data Lake Storage. Currently using ADF, but it could be something else too.

    I would like to make aggregate by week and months and store to output CSV file.

    Should I make every night new CSV file in Input folder? Or is it better to make giga large single blob file where rows are added each night. 

    If there are 30 CSV files, what is Data Lake Analytics method for making queries?


    Saturday, December 10, 2016 10:00 AM