Presentation attack detection based on score level fusion and challenge-response technique

  • PDF / 1,232,777 Bytes
  • 17 Pages / 439.37 x 666.142 pts Page_size
  • 43 Downloads / 252 Views

DOWNLOAD

REPORT


Presentation attack detection based on score level fusion and challenge‑response technique Chao‑Lung Chou1 Accepted: 14 October 2020 © Springer Science+Business Media, LLC, part of Springer Nature 2020

Abstract Biometrics is the state of the art in dealing with identity identification and verification based on the physical and behavioral characteristics and widely used in the fields of Fintech, such as mobile payment and online banking due to its security and convenience. However, there are various attacks against the biometrics system. The presentation attack is one of the most common attacks that an imposter presents fake biometrics to the sensor trying to fool the system. This paper proposes a multimodal presentation attack detection (PAD) method against photo-attack and videoattack in face recognition system by using score level fusion and challenge-response scenario. The proposed challenge-response scenario is that requesting the user to speak out the randomly prompted words. Then, the recognized speech text and the user’s mouth motion are detected simultaneously to verify if the user is liveness. Two weighted score level fusion rules, namely weighted sum and weight product, are used to combine the speech and mouth motion traits as a matching score. The final score is fed into supervised machine learning algorithms and trained for classifying spoofing. The experiments are conducted in the self-built database. Experimental results show that the proposed method can achieve the best half total error rate at 3.64% and can effectively improve facial recognition system security. Keywords  Biometrics · Presentation attack detection · Score level fusion · Challenge-response

1 Introduction Fintech refers to the use of software and algorithms of computers and smartphones to help financial professionals and consumers better manage their commercial operations, experience, and life. Fintech covers emerging technologies * Chao‑Lung Chou [email protected] 1



Department of Computer Science and Information Engineering, Chung Cheng Institute of Technology, National Defense University, Taoyuan County, Taiwan, ROC

13

Vol.:(0123456789)

C.-L. Chou

such as artificial intelligence (AI), Internet of Things (IoT), big data, cloud technology, and blockchain. With the rapid development of Fintech and the continuous investment of enterprises and industries, Fintech has become a global trend. It will have a profound impact on the financial services industry. Fintech has various aspects of the application in the financial services industry—banking and capital markets, asset and wealth management, insurance, and mobile payments. In recent, mobile payment is the most common Fintech application that uses mobile devices and user authentication to ensure security and convenience at the same time. Worth noting that one of the critical enablers for mobile payment is the biometric technology. Biometrics is based on physiological (such as fingerprints, face, iris, etc.) and behavior (such as speech, signature, gait, etc.) characteris