none
Open Sourcing a Kinect Interface for filmmakers – Beta Testers? RRS feed

  • Question

  • Hi friends,

    Would you like to try out my Kinect for Windows recording interface for filmmakers??

    I'm an ex-Pixar developer, and I just used this interface to direct a music video that'll be featured in a few tech/creative blogs this week when it premieres. For the video we recorded sixteen dancers (individually) dancing for up to 50 seconds from three Kinects at a time, as well as 22 takes of sock puppets singing for a long stretch. Performance-wise it is pretty robust and tries to report if there were any dropped frames etc.

    I'd like to make the code available to the community, but could really use a few collaborators who want to try it out to start. Some of its features:

    - Records depth frames at 30 FPS to a simple binary format

    - Exports to OBJ (ironically, we used this very little, turns out it's faster to just have the animation software read the binary format)

    - Transparent DirectX implementation with dynamically reloadable shaders – so you can edit your Vertex/Pixel/Geometry shaders, save the file, and they will dynamically compile/reload without needing to restart the program

    wired to receive, display, and record color frames and joints as well

    Are there any projects out there like this already? Apologies for my ignorance.

    You can see it in action here: https://vid.me/90qw

    thanks,

    Najeeb


    • Edited by NajeebT Saturday, November 28, 2015 9:59 PM
    Saturday, November 28, 2015 9:56 PM

All replies

  • One more note here – I started building this back when the recording software that comes with Kinect for Windows SDK did not have an obvious way to read the file format – would love to know if there are great interfaces for exporting those recordings now, and whether it performs well.
    Saturday, November 28, 2015 10:02 PM
  • As a filmmaker myself with overlapping interests this would be something to take a look at, I might be able to try out this. Do you need anything beside the Kinect (with SDK) and your software?
    Monday, November 30, 2015 2:37 PM
  • Hi Najeeb,

    sounds interesting and I would love to try it out.

    Other libraries that come to mind:

    * Depthkit http://www.rgbdtoolkit.com/tutorials.html

    * Kinect Studio API, example https://github.com/angelaHillier/Kinect-Studio-Sample

    kind regards,

    Roland Smeenk

    Tuesday, December 1, 2015 9:15 AM
  • Hey guys,

    I'll be in touch shortly with some additional details! Both of you are doing cool stuff! You can read about the project/see the video here:

    http://thecreatorsproject.vice.com/blog/another-love-music-video

    thanks,

    Najeeb

    Tuesday, December 1, 2015 6:36 PM
  • Hi Najeeb,

    awesome video. Initially missed that you recorded with 3 Kinects until I saw the video.

    Other open source libraries for working with multiple Kinects:

    * RoomAlive Toolkit https://github.com/Kinect/RoomAliveToolkit

    * LiveScan3D https://github.com/MarekKowalski/LiveScan3D

    --
    Roland



    Tuesday, December 1, 2015 9:22 PM
  • Hi Roland and others,

    The GitHub repo is here if you want to give it a try!

    https://github.com/najeebt/atrium

    There are few docs – though the software isn't too complicated. You'll be the first to give it a spin if you do. Let me know if you have any questions.

    thanks,

    Najeeb

    Friday, January 8, 2016 4:59 PM