Attention engagement and cognitive state analysis for augmented reality text display functions

Takumi Toyama, Daniel Sonntag, Jason Orlosky, Kiyoshi Kiyokawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Scopus citations

Abstract

Human eye gaze has recently been used as an effective input interface for wearable displays. In this paper, we propose a gaze-based interaction framework for optical see-through displays. The proposed system can automatically judge whether a user is engaged with virtual content in the display or focused on the real environment and can determine his or her cognitive state. With these analytic capacities, we implement several proactive system functions including adaptive brightness, scrolling, messaging, notification, and highlighting, which would otherwise require manual interaction. The goal is to manage the relationship between virtual and real, creating a more cohesive and seamless experience for the user. We conduct user experiments including attention engagement and cognitive state analysis, such as reading detection and gaze position estimation in a wearable display towards the design of augmented reality text display applications. The results from the experiments show robustness of the attention engagement and cognitive state analysis methods. A majority of the experiment participants (8/12) stated the proactive system functions are beneficial. Copyrightc 2015 ACM.

Original languageEnglish (US)
Title of host publicationIUI 2015 - Proceedings of the 20th ACM International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
Pages322-332
Number of pages11
ISBN (Electronic)9781450333061
DOIs
StatePublished - Mar 18 2015
Externally publishedYes
Event20th ACM International Conference on Intelligent User Interfaces, IUI 2015 - Atlanta, United States
Duration: Mar 29 2015Apr 1 2015

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI
Volume2015-January

Conference

Conference20th ACM International Conference on Intelligent User Interfaces, IUI 2015
Country/TerritoryUnited States
CityAtlanta
Period3/29/154/1/15

Keywords

  • Attention engagement analysis
  • Augmented reality
  • Cognitive state analysis
  • Eye tracking
  • Gaze-based interface

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Attention engagement and cognitive state analysis for augmented reality text display functions'. Together they form a unique fingerprint.

Cite this