Detecting computer activities using eye-movement features
- PDF / 811,950 Bytes
- 11 Pages / 595.276 x 790.866 pts Page_size
- 29 Downloads / 275 Views
ORIGINAL RESEARCH
Detecting computer activities using eye‑movement features Twin Yoshua R. Destyanto1 · Ray F. Lin1 Received: 2 March 2020 / Accepted: 6 November 2020 © Springer-Verlag GmbH Germany, part of Springer Nature 2020
Abstract Toward the age of smart human–computer interactions, human activity recognition becomes one of the most popular areas for promoting ambient intelligence techniques. To this end, this study aimed at selecting critical eye-movement features to build artificial intelligence models for recognizing three common user activities in front of the computer using an eye tracker. One hundred fifty students participated in this study to perform three everyday computer activities, comprising reading English journal articles, typing English sentences, and watching an English trailer video. While doing these tasks, their eye-movements were recorded using a desktop eye tracker (GP3 HD Gazepoint™ Canada). The collected data were then processed as 19 eye-movement features. Before building convolutional neural network (CNN) models for recognizing the three computer activities, three feature selection methods, comprising analysis of variance (ANOVA), extra tree classification (ETC), and mutual information (MI), were used to screen critical features. For each feature selection method, the top five and top 11 selected features were then used to build six types of CNN models. For comparison, the seventh type of CNN models were developed using all the 19 features as well. The comparison of the seven types of models showed that the models that used the top 11 features screened by the ANOVA method were superior to others, with an accuracy rate of 93.15% on average. This study demonstrates the application of feature selection methods, and an alternative means to recognize user activities in front of the computer. Keywords Human activity recognition · Eye-movement features · Smart HCI · Feature selection method
1 Introduction 1.1 Development of human activity recognition is critical for promoting ambient intelligence Human activity recognition becomes one of the most popular areas for promoting ambient intelligence (AmI) techniques (Andreu and Angelov 2013). As mentioned by Augusto et al. (2010), AmI applications include education, health care, entertainment, sports, transportation, etc. These applications rely on the research of studying techniques for understanding real-time human needs and the development of human activity recognition. Successful examples could be found in numerous areas, such as health care service (Alemdar and Ersoy 2017; Li et al. 2016), human-centered design * Ray F. Lin [email protected] 1
Department of Industrial Engineering and Management, Yuan Ze University, 135 Yuan‑Tung Road, Chung‑Li, Taoyüan 32003, Taiwan
(Wu et al. 2007), and even in the flow of the working process (Staudt et al. 2019). Specifically, Dong and Andrews (2009) used behavioral recognition to control the temperature of a place for the energy-saving objective. Li et al. (2012) built an energy manage
Data Loading...
