TY - JOUR
T1 - Estimating Level of Engagement from Ocular Landmarks
AU - Yücel, Zeynep
AU - Koyama, Serina
AU - Monden, Akito
AU - Sasakura, Mariko
N1 - Funding Information:
This work was supported by Japan Society for the Promotion of Science KAKENHI Grant Number J18K18168. We would like to thank our volunteer participants for their help in the experiments. We would also like to thank Dr. Francesco Zanlungo for his invaluable discussion.
Publisher Copyright:
© 2020 Taylor & Francis Group, LLC.
PY - 2020/10/1
Y1 - 2020/10/1
N2 - E-learning offers many advantages like being economical, flexible and customizable, but also has challenging aspects such as lack of–social-interaction, which results in contemplation and sense of remoteness. To overcome these and sustain learners’ motivation, various stimuli can be incorporated. Nevertheless, such adjustments initially require an assessment of engagement level. In this respect, we propose estimating engagement level from facial landmarks exploiting the facts that (i) perceptual decoupling is promoted by blinking during mentally demanding tasks; (ii) eye strain increases blinking rate, which also scales with task disengagement; (iii) eye aspect ratio is in close connection with attentional state and (iv) users’ head position is correlated with their level of involvement. Building empirical models of these actions, we devise a probabilistic estimation framework. Our results indicate that high and low levels of engagement are identified with considerable accuracy, whereas medium levels are inherently more challenging, which is also confirmed by inter-rater agreement of expert coders.
AB - E-learning offers many advantages like being economical, flexible and customizable, but also has challenging aspects such as lack of–social-interaction, which results in contemplation and sense of remoteness. To overcome these and sustain learners’ motivation, various stimuli can be incorporated. Nevertheless, such adjustments initially require an assessment of engagement level. In this respect, we propose estimating engagement level from facial landmarks exploiting the facts that (i) perceptual decoupling is promoted by blinking during mentally demanding tasks; (ii) eye strain increases blinking rate, which also scales with task disengagement; (iii) eye aspect ratio is in close connection with attentional state and (iv) users’ head position is correlated with their level of involvement. Building empirical models of these actions, we devise a probabilistic estimation framework. Our results indicate that high and low levels of engagement are identified with considerable accuracy, whereas medium levels are inherently more challenging, which is also confirmed by inter-rater agreement of expert coders.
UR - http://www.scopus.com/inward/record.url?scp=85086026332&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85086026332&partnerID=8YFLogxK
U2 - 10.1080/10447318.2020.1768666
DO - 10.1080/10447318.2020.1768666
M3 - Article
AN - SCOPUS:85086026332
SN - 1044-7318
VL - 36
SP - 1527
EP - 1539
JO - International Journal of Human-Computer Interaction
JF - International Journal of Human-Computer Interaction
IS - 16
ER -