What kind of file format use for storing huge amount of data (between 1GB and 10GB)? RRS feed

  • Question

  • I get from server some data that after couple days of working client application increase to 5, 6 GB.

    Because I don`t need all data all the time I would like to save this data on local hard drive.

    What kind of file is the best way (performance/size on disk) to save this data?

    Maybe some database format or some bin format?

    I would like to avoid installation of SQL Server on client local machine.



    • Moved by Tom PhillipsEditor Friday, March 26, 2010 1:33 PM Database Design Question (From:SQL Server Database Engine)
    Friday, March 26, 2010 9:21 AM


All replies

  • rather dumping the data on the disk , create a table in the exisintg database and keep archiving the prodcution table.


    Mohd Sufian www.sqlship.wordpress.com Please mark the post as Answered if it helped.
    Friday, March 26, 2010 9:25 AM
  • Which version of SQL Server are you using? If it is SQL Server 2008, you may use database backup with compression feature to reduce the backup file size while saving.
    Phani Note: Please mark the post as answered if it answers your question.
    Friday, March 26, 2010 11:04 AM
  • FYI - Backup Compression is ONLY available in the ENTERPRISE EDITION.



    Friday, March 26, 2010 11:57 AM
  • If you have SQL 2008, I think you should explore Filestream data type. That might serve your purpose.


    -- Vonid <http://sqlsimplified.com>
    Saturday, March 27, 2010 6:52 PM
  • I discuss the wisdom of storing BLOBs in a database in my books (all of them).

    However, if you insist, the only viable alterative in SQL Server is to use the SQL Server 2008 filestream. I prefer to store BLOBs in a file and keep the path in the DB. This approach can be used with SQL Server Compact edition and leverage the synchronization features of this engine.

    William Vaughn
    Mentor, Consultant, Trainer, MVP

    “Hitchhiker’s Guide to Visual Studio and SQL Server (7th Edition)”

    Please click the Mark as Answer button if a post solves your problem!

    • Proposed as answer by William Vaughn Sunday, March 28, 2010 2:25 AM
    • Marked as answer by kicaj Sunday, March 28, 2010 8:47 AM
    Sunday, March 28, 2010 2:25 AM