locked
Managing data workflows in Azure RRS feed

  • Question

  • Folks,

    We're building an Azure service and have a number of workflows that involve moving data across blobs and tables on a scheduled basis, warehousing some of that data (both in Azure DB and HDInsight), and then running SQL and Hive queries on the data. Keeping all this orchestrated is proving to be a huge pain. Are there some best practices to get this done effectively? What are others with similar problems doing?

    Thanks for any help!

    Friday, September 27, 2013 5:26 PM

Answers

  • Hi ArBee,

    From my experience, it depended on your need.

    If your system data is complicated and it have strict process, I suggest you pay attention to the object class structure and DataBase structure firstly. If your data design is excellence, I guess your develop workload will be reduced and development time will shortened. Secondly, I think you may need note the design patterns . A suitable design patterns will be a corresponding reduction in workload, and it may make your code Readability. Thirdly, I think we need work closely with the actual demand. If we do this, I guess we may effectively in development .

    Thank


    Will
    <THE CONTENT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, WHETHER EXPRESS OR IMPLIED>
    Thanks
    MSDN Community Support

    Please remember to "Mark as Answer" the responses that resolved your issue. It is a common way to recognize those who have helped you, and makes it easier for other visitors to find the resolution later.

    Monday, September 30, 2013 6:33 AM