Towards the Fusion of Gaze and Micro-Gestures

Kagan Taylor*, Haopeng Wang*, Florian Weidner*, Hans Gellersen*
*Lancaster University

Presented 12th March 2025 at IEEE VR, St.Malo.

This poster marks the beginnings of my exploration into the combination of gaze and micro-gestures for subtle and expressive interaction.
This work explores two potential combinations of gaze and micro-gestures for expressive controller-less input and discusses the strengths and drawbacks of each.
More to come in this topic.

See my post about the presentation of this poster, and the discussions that resulted as consequence, here.

Abstract

Gaze and hand-based micro-gestures have been widely studied individually, each offering unique advantages as input modalities, but their combination remains under-explored. In this work, we integrate gaze with thumb-to-finger micro-gestures, discussing their complementary strengths to enable expressive and efficient interactions. We examine two strategies for combining gaze and micro-gestures, assess their strengths and weaknesses, and present examples such as mouse emulation and application shortcuts. Finally, we outline the potential and challenges of gaze and micro-gestures to enhance interaction across diverse contexts, and discuss future directions. This work begins the exploration of gaze and micro-gestures for novel input techniques.

Read the full extended abstract Extended Abstract