Sixth sense technology -- Hand gesture recognition RRS feed

  • General discussion

  • I am doing a project similar to the SixthSense developed by Pranav Mistry.For more info on this project , visit www.pranavmistry.com/projects/sixthsense/

    My project is almost complete , except for hand gesture recognition.I am programming in vb.net.I have a lot of experience with vb.net language, except for the image processing part.So I decided to handover this task to msdn insteading of doing all myself.

    This is what I need:

    An application in vb.net, which when given an image,check whether there are any predefined hand gesture.If a gesture is found,then tell the user which was the gesture.For example: msgbox("closed fist")

    Sample gestures>

    More gestures at::http://www.idiap.ch/resource/gestures/

    Thanks for any help in advance.
    Long live open source software. 


    Wednesday, August 24, 2011 9:17 AM

All replies

  • Hi,

    I have worked on image feature extraction algorithms in my course work. I think there are two parts of your problem, one is to find/select a method/algorithms which helps find features of images by annotating and afterwards compare them on these extracted features. And the second part is to find a language to implement it ( in my case C++/Matlab).

    For the first part there are thousands for research/algorithms with promising results and implementations in different kind of applications. For example:




    For the other part Matlab is a promising tool for image processing development. You can build a library and then import it in .net code. The language is not very difficult and most of the algorithm's implementations are found in MATLAB.

    But there is a very good open source library for image processing available in .net (AForge.NET):



    It has an excellent documentation and online forum for this library. .Net provides basic libraries for the purpose but in that case you need work on the GDI+, which has basic functions available to parse Bitmap images and provide methods to implement complex algorithms. But your work load will be reduces after using a library like AForge.NET.


    But the main thing is you must first get into the image feature extraction and comparison techniques. And find an appropriate method for your implementation. i.e. Image Annotation methods, i.e.





    There is a huge amount of research on Hand Image Recognitions and also a handful of implementations of these algorithms (Search in Google Scholar).

    Best of luck in your project completion.



    Hope is one of the best things, so I hope that your answer lies here.
    Monday, August 29, 2011 5:04 AM
  • You might also check out the Kinect SDK:  http://research.microsoft.com/en-us/um/redmond/projects/kinectsdk/

    Since it is already packed with a lot of features along these lines, it may be able to help (you might also consider using the kinect itself as the input device).

    In addition, there may be Windows Phone 7 XNA and/or SilverLight implementations of this using a phone camera.  They could also provide reference points...

    Just some more suggestions - the ones you already received are great.


    Reed Kimble - "When you do things right, people won't be sure you've done anything at all"
    Monday, August 29, 2011 9:27 PM
  • hai the above links provided are quiet informative and i want to do a hand gesture controlled mouse pointer.so please suggest me particular process using matlab.

    thanks in advance please suggest me it helps me in doing my main project

    Sunday, February 26, 2012 10:48 AM