locked
How can I enable data deduplication in Windows Server 8?

    Question

  • I'm trying to enable data deduplication on my D drive but the help in power shell is lacking (I know it's not even beta yet) and I can't figure out how to do it. Any help would be appreciated.
    Thursday, September 15, 2011 9:51 PM

Answers

  • Hello all,

    Thanks for your interest in Data Deduplication in Window Server 8.

     

    Here are some commands to get you started:

     

    Run the commands in an elevated PowerShell command

    Import-Module Deduplication

     

    To view and get help on all Dedup cmdlets:

    help Dedup

     

    Enable volume for Data Deduplication

    Enable-DedupVolume <vol: Or Mount path>

     

    Set the file age for Deduplication (Setting 0 will allow immediate Deduplication once the job starts)

    Set-DedupVolume <vol: Or Mount path> -MinimumFileAgeDays 0

     

    Start the Data Deduplication

    Start-DedupJob <vol: Or Mount path> –Type Optimization

     

    View progress of the running job

    Get-DedupJob

     

    View the savings due to Deduplication

    Get-DedupStatus

     

    To revert back your files to “non Dedup” regular user files

    Start-DedupJob -Volume <vol: Or Mount path> -Type Unoptimization

     

    Let me know if you need more help.

    Amit

     

     


    Amit Karandikar, Windows Server, Microsoft
    Saturday, September 17, 2011 1:18 AM

All replies

  • The deduplication processes are run via Windows scheduled tasks or can be run interactively via PowerShell. The Get-DedupStatus command will quickly show a percentage of deduplication on a single volume. These scheduled tasks will scour the volume for the deduplication candidates and then coordinate movement into the chunk store. Windows Server 8 data deduplication is not allowed to run on C:\ drives. When I spoke with Microsoft product managers about the reasoning for this restriction, I was told that it was for experience of the system to be kept high. This is because any deduplication engine has overhead, no matter what any vendor says about it.

     

     

    Regards,

    Nicolai

    Friday, September 16, 2011 8:09 AM
  • How can I run it powershell? What's the cmdlet and what are the parameters?

     

    Also not sure if this has to do with anything but I see the following error in the Application event log.

    Log Name:      Application

    Source:        VSS

    Date:          9/15/2011 1:00:01 PM

    Event ID:      12292

    Task Category: None

    Level:         Error

    Keywords:      Classic

    User:          N/A

    Computer:      winsvr8test01

    Description:

    Volume Shadow Copy Service error: Error creating the Shadow Copy Provider COM class with CLSID {463948d2-035d-4d1d-9bfc-473fece07dab} [0x80070005, Access is denied.

    ]. 

     

    Operation:

       Creating instance of hardware provider

       Obtain a callable interface for this provider

       List interfaces for all providers supporting this context

       Query Shadow Copies

     

    Context:

       Provider ID: {3f900f90-00e9-440e-873a-96ca5eb079e5}

       Provider ID: {3f900f90-00e9-440e-873a-96ca5eb079e5}

       Class ID: {463948d2-035d-4d1d-9bfc-473fece07dab}

       Snapshot Context: -1

       Snapshot Context: -1

       Execution Context: Coordinator

    Event Xml:

    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">

      <System>

        <Provider Name="VSS" />

        <EventID Qualifiers="0">12292</EventID>

        <Level>2</Level>

        <Task>0</Task>

        <Keywords>0x80000000000000</Keywords>

        <TimeCreated SystemTime="2011-09-15T20:00:01.000000000Z" />

        <EventRecordID>295</EventRecordID>

        <Channel>Application</Channel>

        <Computer>winsvr8test01</Computer>

        <Security />

      </System>

      <EventData>

        <Data>{463948d2-035d-4d1d-9bfc-473fece07dab}</Data>

        <Data>0x80070005, Access is denied.

    </Data>

        <Data>

     

    Operation:

       Creating instance of hardware provider

       Obtain a callable interface for this provider

       List interfaces for all providers supporting this context

       Query Shadow Copies

     

    Context:

       Provider ID: {3f900f90-00e9-440e-873a-96ca5eb079e5}

       Provider ID: {3f900f90-00e9-440e-873a-96ca5eb079e5}

       Class ID: {463948d2-035d-4d1d-9bfc-473fece07dab}

       Snapshot Context: -1

       Snapshot Context: -1

       Execution Context: Coordinator</Data>

        <Binary>2D20436F64653A20434F52485750574330303030303336352D2043616C6C3A20434F52485750574330303030303238312D205049443A202030303030323637362D205449443A202030303030323338302D20434D443A2020433A5C57696E646F77735C73797374656D33325C76737376632E6578652020202D20557365723A204E616D653A204E5420415554484F524954595C53595354454D2C205349443A532D312D352D313820</Binary>

      </EventData>

    </Event>

    Friday, September 16, 2011 12:56 PM
  • So I figured out what I was doing wrong.

    I installed the role but it all the information wasn't showing in Server Manager. The system needed a reboot. After the reboot I was able to enable deduplication from within Server Manager.

    Now what would be the command to trigger the deduplication from power shell?

    Friday, September 16, 2011 2:55 PM
  • Hello all,

    Thanks for your interest in Data Deduplication in Window Server 8.

     

    Here are some commands to get you started:

     

    Run the commands in an elevated PowerShell command

    Import-Module Deduplication

     

    To view and get help on all Dedup cmdlets:

    help Dedup

     

    Enable volume for Data Deduplication

    Enable-DedupVolume <vol: Or Mount path>

     

    Set the file age for Deduplication (Setting 0 will allow immediate Deduplication once the job starts)

    Set-DedupVolume <vol: Or Mount path> -MinimumFileAgeDays 0

     

    Start the Data Deduplication

    Start-DedupJob <vol: Or Mount path> –Type Optimization

     

    View progress of the running job

    Get-DedupJob

     

    View the savings due to Deduplication

    Get-DedupStatus

     

    To revert back your files to “non Dedup” regular user files

    Start-DedupJob -Volume <vol: Or Mount path> -Type Unoptimization

     

    Let me know if you need more help.

    Amit

     

     


    Amit Karandikar, Windows Server, Microsoft
    Saturday, September 17, 2011 1:18 AM
  • Thanks. I got 124GB down to less than 600MB.
    Monday, September 19, 2011 1:15 PM
  • Hello,

     

    How can set a policy to automatically de-dup a volume as files are added to a volume. (like the demo shown at BUILD-Windows)

    As of now it is not automatic.

     

    Thanks.

    mandar

    Friday, September 30, 2011 11:45 AM