none
Copy between data lakes stores RRS feed

  • Question

  • Hello!

    I have two data lake stores. Source and destination. In the soruce each hour it´s been created a new .csv file. example: first hour - file_01.csv. Second hour - file_02.csv, and so on. I want to update my destination data lake store only with the new file created in the source, not copying everything again(It does not make sense once I have giga bytes of data).

    How can I do this?

    Thanks


    • Edited by juanfperezr Thursday, April 19, 2018 12:10 PM
    Thursday, April 19, 2018 11:23 AM

All replies

  • Do you want to do this with the SDK/CLI commands? Or in a U-SQL script? 

    Michael Rys

    Thursday, April 19, 2018 5:49 PM
    Moderator
  • I would like to have a balance between performance and simplicity. What can you suggest me?

    I´ve been looking for some example but cannot find anything. Can you give me a hand?

    Thanks

    • Edited by juanfperezr Thursday, April 19, 2018 7:32 PM
    Thursday, April 19, 2018 7:25 PM