locked
Fingers detection RRS feed

  • Question

  • Hello,

    I am just checking if the current beta version of SDK is able to detect your fingers? Say, you've put three fingers up, and the kinect (using the Windows SDK) is able to recognize and see that you're holding up three fingers.


    Regards,

    Dan


    Dan
    Thursday, June 16, 2011 11:46 PM

Answers

  • Hi foodan

    I'm running a project that provides finger detection, please have a look at:

    Project:
    http://candescentnui.codeplex.com

    Blog:
    http://blog.candescent.ch

    Originally I developed it with OpenNI. Now I'm in the process of providing Kinect SDK support as well. It works best at distances from 500mm to 800mm, but unfortunately the Kinect seems to return no data in this range (I've asked here: http://social.msdn.microsoft.com/Forums/en-US/kinectsdknuiapi/thread/53a62e18-6acf-466b-9549-9692ff183d77)

    Regards,
    Stefan




    Sunday, June 19, 2011 1:50 PM
  • Dan,

    Finger tracking is unfortunately not available from the SDK. The only tracking is done at the whole skeleton level, for joints like hip, knees, shoulders and elbows. You're not the first one to ask, though, so I'll keep my eyes open for any relevant samples shared by community and will post back if I find one.

    Hope this helps,
    Eddy


    I'm here to help
    Friday, June 17, 2011 1:07 AM

All replies

  • Dan,

    Finger tracking is unfortunately not available from the SDK. The only tracking is done at the whole skeleton level, for joints like hip, knees, shoulders and elbows. You're not the first one to ask, though, so I'll keep my eyes open for any relevant samples shared by community and will post back if I find one.

    Hope this helps,
    Eddy


    I'm here to help
    Friday, June 17, 2011 1:07 AM
  • I can imagine you could get fairly good finger tracking like this: (I haven't actually used the SDK yet but anyhow..)

     

    1. Use the limb tracking to find out where the ends of the arms are.

    2. Using this data you could estimate where the hands might be.

    3. Estimate a rectangle where you think the hands might be

    4. Compare the image/3D data here with a reference set of hand gestures. e.g. spread fingers vs fist.

     

    Don't know how accurate that would be but worth a try??

     

     

     

     

    Sunday, June 19, 2011 2:22 AM
  • Hi foodan

    I'm running a project that provides finger detection, please have a look at:

    Project:
    http://candescentnui.codeplex.com

    Blog:
    http://blog.candescent.ch

    Originally I developed it with OpenNI. Now I'm in the process of providing Kinect SDK support as well. It works best at distances from 500mm to 800mm, but unfortunately the Kinect seems to return no data in this range (I've asked here: http://social.msdn.microsoft.com/Forums/en-US/kinectsdknuiapi/thread/53a62e18-6acf-466b-9549-9692ff183d77)

    Regards,
    Stefan




    Sunday, June 19, 2011 1:50 PM
  • Hey Candescent. Are you going to make an add-on library that everyone can use to estimate finger tracking? That would be amazing!!!!

     

    I had a thought: Using just the body tracking data points and measuring the distance between then end of the forelimb and the elbow, this might give you enough information to tell the difference between a fist and an open hand???

    Tuesday, June 21, 2011 1:43 AM
  • Hi Zenanimator

    You can already download the library (or source code) from CodePlex.

    This is an example of what can be done with it in its current state with OpenNI (it does not work that well with the SDK, because of the 850mm minimum depth distance):

    http://www.youtube.com/watch?v=jer1Ms5dUJg

    I haven't done a lot with the skeleton tracking yet.

    Regards,
    Stefan

    Tuesday, June 21, 2011 7:21 AM
  • http://channel9.msdn.com/coding4fun/kinect/Finger-Tracking-with-Kinect-SDK-and-the-Kinect-for-XBox-360-Device

    Thursday, January 3, 2013 7:40 AM