Using UWP MediaCapture. Cannot access Custom framesources on XBOX RRS feed

  • Question

  • I've been using the UWP FrameSource Custom framesource to extract joint and body tracking information from a Kinect sensor. 


    This works fine for UWP on Windows 10. I've been using this example: https://github.com/Microsoft/Windows-universal-samples/tree/master/Samples/CameraStreamCorrelation

    However, on trying to deploy to an XBOX console it appears that the Custom frame is not available. Is this an know issue? Can anyone suggest a workaround?

    Tuesday, November 22, 2016 4:22 PM

All replies

  • Seems like you're not the only one. This one had the same problem as well.

    What do you mean by not available by the way? Do you get null data or do you get messages like "cannot find reference, Custom doesn't exist in this context blah blah"?

    No expert on Xbox/Win10 combination but can you check what version of Windows SDK you compile against and check whether it matches the version of Windows build Xbox runs on?

    Tuesday, November 22, 2016 9:51 PM
  • Plese add system version of Xbox for future reference.

    Considering that MS introduced this partially-described custom stream one month ago. I think that is has more to do with a device driver (it is just a camera with "weird" streams after all). It is possible that you don't have a system / driver version needed yet (just a guess). 

    Wednesday, November 23, 2016 8:03 AM
  • Thanks for suggestions. 'I'd had similar initial thoughts.

    I'm currently using:

    Windows SDK build version: 14393

    Xbox OS version:  10.0.14393.12123 (rs1_xbox_rel_1610 161105-1400) fre

    The Kinect firmware version is: 4.0.3917.0:7 

    For clarity the following code attempts to obtain the Custom frame source. It works on Win10 but fails to find a match on Xbox.

    MediaFrameSource mediaSrc = mediaCapture.FrameSources.FirstOrDefault(

    framesrc => (framesrc.Value.Info.SourceKind == MediaFrameSourceKind.Custom)).Value;

    Friday, November 25, 2016 2:05 PM
  • Here are some interesting findings.

    First things first: the UWP API for the PC supports Custom/Perception frames. The same UWP API for the XBOX does not support Custom/Perception frames. As a result, Body Frames and BodyIndex frames are no longer available on the XBOX platform.

    Secondly: I have opened a ticket on GitHub:

    Please upvote, so Microsoft can see it's important.

    Finally, I noticed something very very weird. Even though I'm running the latest version of the XBOX OS (released December 14, 2016), the XBOX says "October 2016". You can see that in the screenshot. Notice that the version matches the December version (10.0.14393.2152).

    Summary: The UWP skeletal tracking features were released in November. The latest version says "October". It seems that the latest version of the XBOX is using an older platform Core, with probably older drivers.

    http://pterneas.com Kinect, mobile and web apps

    Wednesday, January 18, 2017 1:25 PM
  • Shall we expect an official reply about this?

    http://pterneas.com Kinect, mobile and web apps

    Saturday, January 28, 2017 4:13 PM
  • Xbox doesn’t support skeletal tracking in UWPs. Xbox provides support for using the infrared, depth, and color feeds from Kinect. We don’t have any further details to share at this time. 

    • Proposed as answer by Yanis Lukes Wednesday, July 11, 2018 11:33 AM
    Tuesday, April 18, 2017 12:33 AM