Planning Azure Structure RRS feed

  • Question

  • Hi,

    Hope someone can offer any advice. At the moment I have been asked to scope out a possible infrastructure for a new Azure Platform. We are also going to be using HDFS / Hadoop for our ETL and Storage.

    Can anyone offer any advice on the following :

    Set up a Storage Optimised Server (eg, L4, 4 Core, 32gb Ram, 678 GB Storage) to hold our raw data, reference tables and final cleansed data within HDFS.  This server could be running 24/7 to feed our analytics platfforms.

    Then, to utilise the power of Hadoop, could we spin up a set of Processing servers (eg, once a week) to read from the Storage Server, process and write back to the storage server and then shutdown until the next load & process task.

    Would really appreciate anyones thoughts advice on this or any possible configurations we could think of?

    Many thanks 


    Thursday, December 14, 2017 1:52 PM