TY - GEN
T1 - Exploring Pupillometry as a Method to Evaluate Reading Comprehension in VR-based Educational Comics
AU - Sakamoto, Kenya
AU - Shirai, Shizuka
AU - Orlosky, Jason
AU - Nagataki, Hiroyuki
AU - Takemura, Noriko
AU - Alizadeh, Mehrasa
AU - Ueda, Mayumi
N1 - Funding Information:
This work was supported in part by the Japan Society for the Promotion of Science, grant #19K21763 and the United States Office of Naval Research, grant #N62909-18-1-2036. We would also like to thank Prof Hiroshi Kawamoto of Kyoto University and Ohmsha, Ltd. for providing the comic materials with which we conducted experiments.
Publisher Copyright:
© 2020 IEEE.
PY - 2020/3
Y1 - 2020/3
N2 - Ascertaining the level of reading comprehension in a learner is often a challenging task. Although written tests and self-evaluations can provide feedback as to whether an individual understands a particular topic, they are not real time, do not necessarily provide a full picture of the reader's comprehension, and can be subjective.In this paper, we present initial results of a study to determine better ways to evaluate a user's comprehension and understanding of educational comic books using pupillometry. Our system recreates the reading experience of an immunology comic book in virtual reality (VR), allows users to rate their comprehension of a particular section, and records eye data during the learning task. Through experiments, we explore the potential of this interface to facilitate learning and examine pupil metrics that might be used to automatically classify comprehension and understanding at the category (topic) level. We also discuss numerous design considerations that should be taken into account when designing future interfaces for evaluation of learning or comprehension.
AB - Ascertaining the level of reading comprehension in a learner is often a challenging task. Although written tests and self-evaluations can provide feedback as to whether an individual understands a particular topic, they are not real time, do not necessarily provide a full picture of the reader's comprehension, and can be subjective.In this paper, we present initial results of a study to determine better ways to evaluate a user's comprehension and understanding of educational comic books using pupillometry. Our system recreates the reading experience of an immunology comic book in virtual reality (VR), allows users to rate their comprehension of a particular section, and records eye data during the learning task. Through experiments, we explore the potential of this interface to facilitate learning and examine pupil metrics that might be used to automatically classify comprehension and understanding at the category (topic) level. We also discuss numerous design considerations that should be taken into account when designing future interfaces for evaluation of learning or comprehension.
KW - Virtual reality
KW - comics
KW - education
KW - eye tracking
UR - http://www.scopus.com/inward/record.url?scp=85085360030&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85085360030&partnerID=8YFLogxK
U2 - 10.1109/VRW50115.2020.00090
DO - 10.1109/VRW50115.2020.00090
M3 - Conference contribution
AN - SCOPUS:85085360030
T3 - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
SP - 422
EP - 426
BT - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
Y2 - 22 March 2020 through 26 March 2020
ER -