Development of a wearable guide device based on convolutional neural network for blind or visually impaired persons
- PDF / 3,629,871 Bytes
- 19 Pages / 439.642 x 666.49 pts Page_size
- 33 Downloads / 255 Views
Development of a wearable guide device based on convolutional neural network for blind or visually impaired persons Yi-Zeng Hsieh1 · Shih-Syun Lin1
· Fu-Xiong Xu1
Received: 23 September 2019 / Revised: 24 June 2020 / Accepted: 28 July 2020 / © Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract This study proposes a design for a wearable guide device for blind or visually impaired persons on the basis of video streaming and deep learning. This work mainly aims to provide supplementary assistance to white canes used by visually impaired persons and offer them increased freedom of movement and independence using the proposed wearable device. The considerable amount of environmental information provided by the device also ensures enhanced safety for its users. Computer vision in the proposed device uses an RGB camera instead of the RGBD camera commonly used in computer vision. Deep learning is applied to convert RGB images into depth images and calculate the plane for detecting indoor objects and safe walking routes. A convolutional neural network (CNN) is adopted, and its neural network structure, which is similar to that of the human brain, simulates a neural transmission mechanism similar to that triggered in human learning. Therefore, this system can learn a large number of feature routes and then generate a model from the learning result. The proposed system can help blind or visually impaired persons identify flat and safe walking routes. Keywords Blind or visually impaired persons · Wearable device · Deep learning · Convolutional neural networks
1 Introduction Persons with disabilities face a number of daily obstacles and challenges, including daily movement and communicating with other persons, which limit their freedom to interact Shih-Syun Lin
[email protected] Yi-Zeng Hsieh [email protected] Fu-Xiong Xu [email protected] 1
National Taiwan Ocean University, Keelung, Taiwan
Multimedia Tools and Applications
and engage with the world around them independently. Modern electronic technologies can be developed to address such challenges and improve the lives of individuals with physical and sensory disabilities. The use of appropriate auxiliary equipment can greatly impact an individual’s continued quality of life and promote and maintain independent living. At present, advances in high-speed microprocessors lead to various assistive technology systems [3, 9, 11, 15, 20, 26, 32, 36, 37]. These various systems allow people with disabilities to use limited voluntary motions for communication, computer manipulation, and control of household appliances. Each system has its own considerations, applicability, and limitations. The white cane is a common travel aid for blind or visually impaired persons, but it only ensures that a small ground area in front of the person is clear or locate any nearby obstacle on the ground via contact with the cane. Although the white cane has many advantages, such as being lightweight, small when folded, and low cost, its main limitation i
Data Loading...
