Thursday, February 10, 2011

Gesture recognition and hand tracking with Kinect and OpenNI

This is a follow up on my recent post 'Playing with the Kinect'. Until now I was only using the depth map, but yesterday I got gesture recognition and hand tracking working:



  1. Hey stefan , is it possible for u to explain the algorithm that u have used for the hand tracking. I don't want to blindly use ur code. I need to understand ur algorithm before i try create my version of it.

  2. Hi Anirban

    In the video above I'm using the hand tracking that comes with OpenNI. It's an old post.

    If you read my blog chronologically you'll find information about how my hand detection works.

    I plan to write more documentation, but that will take some time.

    Short description of how it works:

    1. Depth segmentation (fixed threshold)
    2. K means clustering to separate hands
    3. Contour detection + convex hull
    4. Finger detection (using the contour + hull)
    5. Finding the center of the palm (using the contour)


  3. hi can u provide me the source code please as i am working on it