locked
kinect v2 audio technology RRS feed

  • Question

  • How does the Kinect v2 handle echo cancellation?

    What are the noise suppression and reduction technologies implemented?

    How do we tune them?

    This early video shows a guy sitting way far away yet the game noise was eliminated when listen through the Kinect. How does this happen?

    https://www.youtube.com/watch?v=7dSefGxnThc

    How does the Kinect know to remove the game noise from the human speaker?


    Ken

    Thursday, October 2, 2014 3:37 PM

All replies

  • Extending his question...

    Does the Kinectv2 SDK and sensor support advanced audio control of echo cancellation and autogain?

    In SDK v1.x is was possible to do...

    pvKinectProps.lVal = (LONG)(x->cbAudioEchoCancel ? OPTIBEAM_ARRAY_AND_AEC : OPTIBEAM_ARRAY_ONLY);

    and for autogain things like

    hr = pPropertyStore->SetValue(MFPKEY_WMAAECMA_FEATURE_MODE, pvKinectProps);
    pPropertyStore->SetValue(MFPKEY_WMAAECMA_FEATR_AGC, pvKinectProps);

    Is this possible in SDK 2.x?


    --Dale

    Sunday, October 26, 2014 11:17 AM
  • This early video was showing the XBox one audio pipeline.  In XBox one, we have full AEC, and are able to subtract out the sound generated by the system, but it is because we have complete control over the hardware... In a PC world, this is a much harder problem, and we are still working on it.  There is not currently support for echo cancellation in the K4W SDK.

    The parameters of the audio pipeline are not currently tunable.


    Chimera Scorn - Chris White

    Monday, October 27, 2014 9:45 PM