Publication Details

Download

Mohamed Khamis, Anna Kienle, Florian Alt, Andreas Bulling
GazeDrone: Mobile Eye-Based Interaction in Public Space Without Augmenting the User
In DroNet'18: 4th ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications. September 05, 2018. Association for Computing Machinery, New York, NY, USA. (bib)

Gaze interaction holds a lot of promise for seamless human-computer interaction. At the same time, current wearable mobile eye trackers require user augmentation that negatively impacts natural user behavior while remote trackers require users to position themselves within a confined tracking range. We present GazeDrone, the first system that combines a camera-equipped aerial drone with a computational method to detect sidelong glances for spontaneous (calibration-free) gaze-based interaction with surrounding pervasive systems (e.g., public displays). GazeDrone does not require augmenting each user with on-body sensors and allows interaction from arbitrary positions, even while moving. We demonstrate that drone-supported gaze interaction is feasible and accurate for certain movement types. It is well-perceived by users, in particular while interacting from a fixed position as well as while moving orthogonally or diagonally to a display. We present design implications and discuss opportunities and challenges for drone-supported gaze interaction in public.