locked
Stereoscopic 3D playback

    Question

  • Hi,

    It looks like win8 have a lot of new stuff for S3D. As far as I know metro playback components use MFTs inside.

    Just curious,

    do MP4\MPEG-2 source (reader\splitter) MFTs support s3d streams?

    does EVR (or any other) supports s3d playback in case of correct initialization by metro or desktop application?

    I want to create MVC decoder and play 3d video captured by 3d cameras, do inbox components are ready for s3d?

    Thanks

    Tuesday, April 17, 2012 1:55 PM

Answers

  • Hello Nik7,

    The Media Engine does support stereoscopic video playback via D3D 11. The video processor supports the view unpacking operation on 3D video frames. If the input frame contains two views packed in the same frame, the video processor can split the views into separate buffers, or extract the base view and discard the second view. To enable view unpacking, set the MF_ENABLE_3DVIDEO_OUTPUT attribute to MF3DVideoOutputType_Stereo or MF3DVideoOutputType_BaseView.

    Does this answer your question?

    -James


    Windows Media SDK Technologies - Microsoft Developer Services - http://blogs.msdn.com/mediasdkstuff/

    Thursday, April 19, 2012 11:45 PM
    Moderator
  • AFAIK you need to support MFT_SUPPORT_3DVIDEO and MF_ENABLE_3DVIDEO_OUTPUT in your MFT. You also need to pack your two frames into one and specify the sample extension property MFSampleExtension_3DVideo.

    I hope this helps,

    James


    Windows Media SDK Technologies - Microsoft Developer Services - http://blogs.msdn.com/mediasdkstuff/

    • Marked as answer by Nik7 Friday, April 27, 2012 6:39 AM
    Tuesday, April 24, 2012 12:27 AM
    Moderator
  • Hello Nik7,

    Yes the MF source reader, sink writer, video processor and DX11 presenter all have code that specifically handle s3d data appropriately when supported by the other components in the topology / hosting application. I don't see anything s3d specific in any of our codec implementations but this is likely by design.

    -James


    Windows Media SDK Technologies - Microsoft Developer Services - http://blogs.msdn.com/mediasdkstuff/

    • Marked as answer by Nik7 Friday, April 27, 2012 6:39 AM
    Friday, April 27, 2012 12:57 AM
    Moderator

All replies

  • I do have same concerns.

    Stay hungry, stay foolish

    Wednesday, April 18, 2012 7:49 AM
  • Hello Nik7,

    The Media Engine does support stereoscopic video playback via D3D 11. The video processor supports the view unpacking operation on 3D video frames. If the input frame contains two views packed in the same frame, the video processor can split the views into separate buffers, or extract the base view and discard the second view. To enable view unpacking, set the MF_ENABLE_3DVIDEO_OUTPUT attribute to MF3DVideoOutputType_Stereo or MF3DVideoOutputType_BaseView.

    Does this answer your question?

    -James


    Windows Media SDK Technologies - Microsoft Developer Services - http://blogs.msdn.com/mediasdkstuff/

    Thursday, April 19, 2012 11:45 PM
    Moderator
  • Hello James,

    thanks for the explanations, still have 2 questions:

    1. Our decoding MFT outputs 2 views on by one on ProcessOutput: 1st view, 2nd view, 1st view, 2nd view, 1st view, 2nd view, 1st view, 2nd view, etc. Should we change this behavior to be understood by the video processor or render?

    2. Still not clear about source readers, do MP4\MPEG-2 source (reader\splitter) MFTs support s3d streams?

    Friday, April 20, 2012 9:26 AM
  • AFAIK you need to support MFT_SUPPORT_3DVIDEO and MF_ENABLE_3DVIDEO_OUTPUT in your MFT. You also need to pack your two frames into one and specify the sample extension property MFSampleExtension_3DVideo.

    I hope this helps,

    James


    Windows Media SDK Technologies - Microsoft Developer Services - http://blogs.msdn.com/mediasdkstuff/

    • Marked as answer by Nik7 Friday, April 27, 2012 6:39 AM
    Tuesday, April 24, 2012 12:27 AM
    Moderator
  • yeah, that helps. thank you. so, still the last question:  

    1. Do inbox MP4\MPEG-2 source (reader\splitter) MFTs, like "MPEG-4 File Source" support s3d streams?

    does "MPEG-4 File Source" just parses MP4 with MVC inside as a common H.264 and decoder can detect it as a MVC only after parsing the received headers?
    • Edited by Nik7 Tuesday, April 24, 2012 9:27 AM
    Tuesday, April 24, 2012 9:06 AM
  • Hello Nik7,

    Yes the MF source reader, sink writer, video processor and DX11 presenter all have code that specifically handle s3d data appropriately when supported by the other components in the topology / hosting application. I don't see anything s3d specific in any of our codec implementations but this is likely by design.

    -James


    Windows Media SDK Technologies - Microsoft Developer Services - http://blogs.msdn.com/mediasdkstuff/

    • Marked as answer by Nik7 Friday, April 27, 2012 6:39 AM
    Friday, April 27, 2012 12:57 AM
    Moderator
  • thank you James. now it's clear

    Nik


    • Edited by Nik7 Friday, April 27, 2012 6:47 AM
    Friday, April 27, 2012 6:40 AM