none
Hover-to-click is currently best in class? RRS feed

  • Question

  • I downloaded the latest SDk today and played with the samples.  The "BasicInteraction" one was referred to as best-in-class in terms of user interaction in the announcement blog.  So, I was a little surprised to see it using hover-to-click, which is very suboptimal, imo.  Yeah, it's cool when you're first experiencing the magic of gesture-based computing, but it only takes a couple of hover-clicks to make you need some other way to click (well, that's how I felt).  I take this to mean that MS hasn't figured out a nice way yet to do clicks yet... we've got all this cool (and fairly accurate) joint data and there isn't an included gesture library to make use of it for a natural click yet.  I'm really not complaining, it's just curious to me, and I'll continue working it out myself (and searching out other libraries).  Are the MS Cambridge folks getting this worked out as part of their (awesome looking!) Fusion release?

    Thanks.  This stuff is magic.

    btw - the big buttons for scroll in that example did seem to work ok, imo.

    Tuesday, November 6, 2012 11:31 PM

Answers

  • In the recent BUILD conference we showed off the interaction model that Kinect for Windows team is working on for a future version:

    http://channel9.msdn.com/Events/Build/2012/2-029

    • Marked as answer by bbfl Monday, November 19, 2012 4:44 PM
    Saturday, November 17, 2012 2:40 AM
  • we are working on this for a future version
    Wednesday, November 7, 2012 12:13 AM

All replies

  • we are working on this for a future version
    Wednesday, November 7, 2012 12:13 AM
  • bbfl,

    I think it is considered best-in-class to the extent that it is widely used in Kinect for Xbox games. 

    I've also seen push to click (which I've built before but don't like) and grasp to click (which I like a lot but haven't built).

    James


    James Ashley - Presentation Layer Architect at Razorfish Emerging Experiences
    jamesashley@imaginativeuniversal.com
    www.imaginativeuniversal.com www.emergingexperiences.com

    Wednesday, November 7, 2012 10:46 PM
  • kinectmouse here uses a predefined gesture hard-coded to click: http://kinectmouse.codeplex.com (not my project)

    Iam currently doing a multi-mouse kinect project that uses dsf(device simulation framework) from the windows device driver development sdk. It is located here: http://

    The input report is how I mimic mouse input movements for each mouse individually and report descriptor is how it recognizes what type of device and features it has (mouse scrolling, middle mouse button, etc). So my code can be repurposed for educational scenarios with touch devices. In fact, I plan on emulating smarttech's (http://smarttech.com) smartboard in my project after getting multi-mouse devices to work with my program because they have multiple users working on their latest smartboard (touch device connected to computer).

    Hover to click is crazy and is better for selecting an item and not clicking something on windows in my opinion.


    Once you eliminate the impossible, whatever remains, no matter how improbable, must be the truth. - "Sherlock holmes" "speak softly and carry a big stick" - theodore roosevelt. Fear leads to anger, anger leads to hate, hate leads to suffering - Yoda. Blog - http://www.computerprofessions.co.nr



    • Edited by The Thinker Thursday, November 8, 2012 3:49 PM
    Thursday, November 8, 2012 3:47 PM
  • Todd - I definitely appreciate the info.  Great to have feedback from the Kinect team themselves.

    James - thanks.  I think that once we get to use the finger data, this pedestrian-but-critical challenge may be completely solved.  I think there are some folks hacking around to get finger recognition to work with the Kinect - KinEmote is doing some fancy stuff with existing data, and 3Gear systems uses two(!) Kinects to reconstruct it... and MS Cambridge might be soon coming out with something.  They're doing crazy cool stuff like the the "HoloDesk" (google it at research.microsoft.com - the erratic msdn forums won't let me paste a link)... anyway, maybe they just don't realize someone needs to backtrack from the cutting edge for a second and deal with the mundane "click" issue :)

    Thinker (Rodin's statue is on google doodle today, btw - it's his 172nd bday) - your link got deleted.  Or you had the same problems I did in trying to post a link.  Can you try to post it again?  Sounds very interesting.

    Monday, November 12, 2012 2:52 PM
  • whoops, sorry the post must have malfunctioned. Heres the link to my project: http://kinectmultipoint.codeplex.com

    BTW, i agree with your statement: "anyway, maybe they just don't realize someone needs to backtrack from the cutting edge for a second and deal with the mundane "click" issue :)". This is what is the problem with windows 8 you can click, but program compatibility issues (notifications from taskbar, one unified os that forces us to give up apps that require the taskbar in windows 7,how do we view an error message box while in metro?,windows 95 support was limited from what i see, unified os complicates volume licensed programs we have already - must buy program one by one now and deploy that way and/or forcing to buy from marketplace) are what are causing programmers to wait for windows 9 or switch to linux (I conducted a poll of businesses and tech guys alike in my local area and they would rather switch to linux then deal with windows 8 - had mostly to do with technology training costs).


    Once you eliminate the impossible, whatever remains, no matter how improbable, must be the truth. - "Sherlock holmes" "speak softly and carry a big stick" - theodore roosevelt. Fear leads to anger, anger leads to hate, hate leads to suffering - Yoda. Blog - http://www.computerprofessions.co.nr





    • Edited by The Thinker Monday, November 12, 2012 3:32 PM
    Monday, November 12, 2012 3:20 PM
  • In the recent BUILD conference we showed off the interaction model that Kinect for Windows team is working on for a future version:

    http://channel9.msdn.com/Events/Build/2012/2-029

    • Marked as answer by bbfl Monday, November 19, 2012 4:44 PM
    Saturday, November 17, 2012 2:40 AM
  • Thanks a ton.  Awesome talk.  Love the skateboard analogy - it's perfect.

    I feel like my concerns and hopes are validated, and that MS is gonna deal with the pedestrian select/scroll in the next SDK release with their own gesture library.

    The timing of this release impacts my own research and applications with my company.  Would love to be part of the earliest release possible with this.  Please pm if possible on what we need to do.  I am also trying to work this through our MS sales rep but that might be somewhat removed from the inner Kinect folks I need to be in contact with. 

    Monday, November 19, 2012 4:40 PM