How to handle asymmetric facial expressions, e.g. raising one eyebrow with Kinect Facetracking RRS feed

  • Question

  • I am new to using the Kinect SDK and from what i could gather the 6 AUs that define facial expressions captureed by Kinect are symmetric, that is: the Eyebrow AU gives the weight for both raised eyebrows and not the individual ones.

    My question is what the best approach is for handling asymmetric expressions, tilting one side of the lip or raising one eyebrow?

    My best idea so far is storing the projected 3D points of the neutral face and then scale some custom weights according to how distances between certain feature points have changed, e.g. if the distance between outer eyebrow and eyelid have changed. This however will require a lot of boring linear algebra and I wonder if the SDK in some way has built-in functionality for this?

    Thursday, February 7, 2013 8:09 AM