Object shuffling using GMI(Gesture Machine Interface)

Kumar V, Todorov E.

Details:

The demo demonstrate object shuffling using GMI (Gesture Machine Interface). User shuffles objects using naturalistic daily life interaction techniques. Users intent are captured using speech and references are interpreted using eyesight processing. Actual manipulation in the video is substituted by teleportation. We are working towards having a robotic hand for actual manipulation task. Stay tuned for updates...

Resources:

Object selection using GMI (Gesture Machine Interface)

Kumar V, Todorov E.



Details:

This video demonstrate a subject shooting bubbles on screen by just looking at them. Eye sight is being processed in real time using an eye tracker. This technique of GMI (Gesture Machine Interface) enables object selection using eye sight. On an average 3.5 bubbles can be shot without any initial training.

Subject's response ("woow, it is really responsive") after his first trail nicely captures the effectiveness of the method and easy of use.

Resources:

  • Object selection using GMI (.mp4)