I am Mathieu Lessard and I am a student at Vancouver Island University. I've been greatly interested in the Kinect as another tool for creating NUIs(Natural User Interfaces) for software.
My first idea was to create a NUI for a media player, so I decided to use the Windows Media Player and it's SDK. The results of mine, and a friend's first attempts one day is here.
We were very busy learning and testing various things, and in general thinking up ideas, so we only implemented little, but the results were good.
Generally speaking, we want to create a NUI for the WMP that would make the WMP react however you would like, or however you would expect it to react. For example, when no one is watching the video, it will pause. While this may not be a good option for when it plays music, generally, when people answer the phone or answer the door, they pause their movie before doing so. This would allow the user to not have to find the remote and press the pause button. The user is also able to return and tell the player to rewind and play again.
Other ideas we've had include:
- Rewinding 3 seconds automatically when the person returns and says play.
- Volume controls, possibly with hand gestures.
- Fast Forward, Skip, and other button controls, probably as voice commands.
The problem we face is voice commands are not an option while the video is playing and must only be done when paused. This leaves only gestures as an option while the video is on. If I am able to, I am hoping to turn this project into a course/research this year at my University, being the analyzing of what people find to be "natural" gestures for a media player, and the study of NUIs in general.
If anyone has any ideas for gestures or suggestions, I'd love to hear them.
- This forum has the subtitle "Share experiences and provide feedback about the Kinect for Windows SDK beta." however has no button for "discussions" only one for "ask a question" which later allows the option of both. Makes it a little difficult to find where the correct place is to post.
- Skeletal Tracking while sitting in some couches causes the tracking to stop.
- I absolutely love this and would like to thank the Microsoft teams very much for the work they've done to release this.
Nice... Any chance you guys are going to release the source? I'd like to highlight this on the Channel 9 Kinect gallery (http://channel9.msdn.com/coding4fun/kinect) but I try to only include those project where the source is available. Or even a more in-depth how-to article, how you did it, code snips, etc.?
Have you actually tried using voice commands while the video is playing? The Xbox applications for Hulu and Netflix accept both voice and gesture commands while video is playing. I'd try experimenting with the Audio Echo Cancellation modes in the KinectAudioSource class.
Thanks very much for the idea Robert. To be honest we just disabled the voice commands when playing just for the fact that we didn't think it would work, not because we tried. I'll check out the API and see what it offers and give it a shot.
Thanks for the offer Greg. Being a student, I am almost embarrassed about the code. However I'd appreciate the opportunity to assist in creating a little article for Channel 9's Kinect Gallery. I'll shoot you an email.