Multimodal human eye blink recognition method using feature level fusion for exigency detection
- PDF / 2,522,369 Bytes
- 17 Pages / 595.276 x 790.866 pts Page_size
- 92 Downloads / 245 Views
(0123456789().,-volV)(0123456789(). ,- volV)
METHODOLOGIES AND APPLICATION
Multimodal human eye blink recognition method using feature level fusion for exigency detection Puneet Singh Lamba1,2
•
Deepali Virmani3 • Oscar Castillo4
Ó Springer-Verlag GmbH Germany, part of Springer Nature 2020
Abstract In this paper, a precise multimodal eye blink recognition method using feature level fusion (MmERMFLF) is proposed. A new feature: eye-eyebrow facet ratio (EEBFR) (formed by fusing eye facet ratio (EFR: ratio of diagonal length and width of eye) and eyebrow to nose facet ratio (EBNFR: distance between eyebrow landmarks and nose landmark)) for approximating the eye state is computed. Initially, an improved intellectual framework (Sagacious Information Recuperation Technique) that senses the emergency state using information retrieved from eye blinks, pulse rate as well as behavioral patterns(emotions) exhibited by an individual is presented. Further a novel multimodal method (MmERMFLF) for detection and counting of eye blinks is implemented. For training, one state-of-the-art database—ZJU is used. To additionally improve the performance, feature-level fusion schemes [simple concatenate and fusion codes (gaborization)] are enforced and equated. Receiver operating characteristics, error rate, sensitivity, specificity, and precision are used to demonstrate the performance of the proposed method qualitatively and quantitatively. Accuracy with proposed MmERMFLF is increased to 99.02% (using EEBGFR method with bagged ensemble classifier) in comparison to unimodal eye blink recognition system (97.60%). 99.80% genuine blinks are classified by MmERMFLF (when gaborization fusion is used) using simple tree classifier. Keywords Multimodal Unimodal Feature level fusion Eye blink Gabor filter
1 Introduction Eye blinking is partially unintentional closing and reopening of the eyelid. Orbicularis oculi and levator palpebrae superioris are the muscles responsible for closing and reopening of the eye (Soukupova 2016). The primary function of eye blinking is to clean and moisten the eye cornea. There are three categories of blinking. The spontaneous blinking (involuntary) is performed during
Communicated by V. Loia. & Puneet Singh Lamba [email protected] 1
University School of Information, Communication and Technology, GGSIPU, Sector 16 C, Dwarka, Delhi, India
2
Bharati Vidyapeeth’s College of Engineering, Paschim Vihar, New Delhi, India
3
Department of Computer Science, Bhagwan Parshuram Institute of Technology, New Delhi, Delhi, India
4
Tijuana Institute of Technology, Calzada Tecnologico S/N Fracc. Tomas Aquino, 22371 Tijuana, BC, Mexico
breathing or digestion process without any obvious external stimulus. The second type of involuntary blinking is called the reflex blinking which is caused by contact with the cornea, fast visual change of light in front of the eye, sudden presence of near object or by a loud noise (Soukupova 2016). Another type of blinking is the voluntary blinking which is invoked delibera
Data Loading...
