Gestures for chronic pain sufferers

July 2016

As of July 2016, we are currently recruiting subjects for gesture manipulation experiment. Please click here for more information

Currently, we are on an exploratory endeavor investigating the usage of gesture-based technology with participants who suffer from chronic pain syndromes. Our goal is to gather what kind and for how long can interactions be performed without detrimental effects.

Gesture Manipulation

Here at the HCI lab, one of our research areas covers hand gestural interfaces. One cool application of this device is the potential to live out your Iron Man / Tom Cruise dreams.

Handpose

July 2015

Handpose is a real-time articulated hand tracker that is highly flexible and robust, able to track at distances of tens of centimeters up to several meters.

Presentations

Summer 2015

SUI’15 in Los Angeles, California, USA

The paper is titled: Models for Rested Touchless Gestural Interaction. This study evaluated 3 methods for performing touchless mid-air gestural interaction from a rested position: a basic rested interaction, a simple calibrated interaction which models palm positions onto a hyperplane, and a calibration which models the arm’s interaction space using angles of the forearm as input. Results showed that the two modeled interactions conform to Fitts’s law and also demonstrated that implementing a simple model can improve interaction by improving performance and accuracy.

The poster is titled: Modeling Mid-air Gestures With Spherical Coordinates. This study showed that using the Myo armband, a modeled interaction space also benefits devices that use spherical coordinates. The modeled interaction showed better performance, accuracy, and conformance to Fitts’s law.

Fall 2014

NordiCHI’14 in Helsinki, Finland

The paper is titled: An Evaluation of Touchless Hand Gestural Interaction for Pointing Tasks with Preferred and Non-preferred Hands. It shows that while gestures perform lower than the mouse and touchpad, they exhibit much higher performance improvement between rounds and show much lower degradation between hands. This low degradation has implications for users with hand impairments, where they might have considerably less pain in their off-hand and therefore prefer it for computer interaction.

The poster is titled: Evaluating Multimodal Interaction with Gestures and Speech for Point and Select Tasks. It examines the effects that adding voice commands to mouse and gesture navigation has on completion time and throughput. It shows that adding speech to mouse or gesture navigation makes no significant difference on throughput, but does add to completion time. The intention is to investigate the feasibility of voice and gestural navigation for users with hand impairments.

ASSETS '14 in New York, New York, USA

The poster is titled: Gestures with Speech for Hand-Impaired Persons. This work concluded that gesture navigation augmented with speech selection is a promising interaction format for persons with hand impairments, and that this interaction style can lead to better assistive technologies.

ACM SIGCHI | Baylor School of Engineering and Computer Science