none
Extract AU Coefficients by HD Face Tracking RRS feed

  • Question

  • Hi everyone,

    I'm using HD Face Tracking in the Kinect for Windows SDK 2. 

    How can I extract the AU Coefficients and 3D Head Posese returned by face tracking?

    Could you help me provide a sample code to get them or better if we can save it in a .txt or .csv file?

    Thank you so much.


    Wednesday, May 6, 2015 7:37 AM

All replies

  • Hi every one,

    I'm using HD Face Tracking in the Kinect for Windows SDK 2. 

    How can I extract the AU Coefficients and 3D Head Posese returned by face tracking?

    Could you help me provide a sample code to get them or better if we can save it in a .txt or .csv file?

    Thank you so much.


    Wednesday, May 6, 2015 7:35 AM
  • These are not explicitly defined as they are model specific. The intent of the visual model provided by Kinect was as a debugging aid to visualize what the mesh looked like.

    https://msdn.microsoft.com/en-us/library/dn785525.aspx (see face model)

    The typical workflow is you will already have you own artistic face mesh with the various AU/SU targets already defined. From that you can drive that animation for the character based on what the HDFace api provided given the -1 to 1 weights.


    Carmine Sirignano - MSFT

    Friday, May 8, 2015 5:43 PM