Can we use MSSQL Server as a database to deal with large volume of data like TeraBytes and Peta Bytes? RRS feed

  • Question

  • Hi Team,

    We are going to develop a product(Asp.Net Web Application) for one of our client. The application is going to deal with large amount of data. The Asp.Net Web Application will directly connect to the database and performs Reads and Writes to the database(Web Application performs Retrieval/Inserts/Updates and Deletes operations)

    As per the initial requirement gathering, we got to know that, the database size would be 30 - 40 Tera bytes and every 6 months this data gets double, i.e. as an average I could say every year the Asp.Net web application will write 50 Tera Bytes of structural data to the database tables. 

    If that is the case, if I choose any RDBMS(MSSQL, ORACLE, MYSQL and so on) as database to store the data which is coming from Asp.Net Web Application and we need to utilize this data to display different type of transactional functionalities, DashBoards, Reports and so on in that same web Application. As per the requirement, the database size will grow 30 TeraBytes every year and web application is going to use this data for real time processing. But, performance is very very important for the web application.

    So, I have the following questions in this regards

    1. What database would be the right fit for this? which database will give good performance to deal with large volume of real time data?
     (We are going to fetch the data from more than 100 tera Bytes of data to display the reports/dashboards in a real world web application, All and all I could say that, the Asp.Net web application is going to use this data to display dashboards and so on, at the same time the same application is going to write the data to the database tables.)
    2. How about the NoSQL(HBASE/CASSANDRA)? Can we use these NOSQL databases as backend to interact with Asp.Net Web Application? If Yes, how would be the performance of web application?(As I mentioned earlier, our web application should do retrieval/updates/inserts and deletes as link RDBMS database...Is this possible in HBASE/Cassandra?)

    3. Which one will be the right choice (RDBMS/HBASE/CASSANDRA) for retrieval/Inserts/Updates/Deletes through web application?

    4. I am not sure is there any other way in RDBMS to handle this large amount of data by maintaining 2 servers(OLTP/OLAP)? If yes, how can we do that? please suggest and help us on this...if possible share any link
    Wednesday, November 2, 2016 9:39 AM