A novel interactive assembly teaching aid using multi-template augmented reality
- PDF / 3,414,788 Bytes
- 29 Pages / 439.37 x 666.142 pts Page_size
- 83 Downloads / 159 Views
A novel interactive assembly teaching aid using multi-template augmented reality Chi-Yi Tsai 1
1
1
& Ting-Yuan Liu & Yun-Han Lu & Humaira Nisar
2
Received: 18 October 2019 / Revised: 29 June 2020 / Accepted: 11 August 2020 # Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract
Augmented Reality (AR) technology is a fast growing field in the academics and industry. This paper presents a novel design of an interactive assembly teaching aid based on a multi-template AR system, which consists of three units: a multi-template AR unit, an online three-dimension (3D) model assembly unit, a hand-gesture interaction unit. The design of the multi-template AR unit employs an efficient multi-template pose tracking method to detect and track multiple template images simultaneously. The online 3D model assembly unit is enabled, when the pose of each target template is tracked and computed by the multi-template pose tracking method. This method measures the distance between the two templates to determine the 3D rendering mode of the virtual object. The third unit aims to realize a vision-based human-computer interactive system, which combines the AR rendering system with the real-time hand-gesture recognition method to decide the status of AR rendering of a 3D dynamic animation according to the user’s hand gesture. Based on the feedback of twenty-one users of the AR-based interactive teaching-aid, it can be concluded that the system creates an interactive experiences that engages the users and facilitates them to increase their learning interest significantly. In future, we plan to port the proposed AR system to Android and iOS mobile devices while improving the functionality, interactivity, and entertaining qualities of the teaching aid system. Keywords Interactive teaching-aids . Multi-template tracking . 6-DoF pose tracking . Augmented reality * Chi-Yi Tsai [email protected] Humaira Nisar [email protected]
1
Department of Electrical and Computer Engineering, TamKang University, 151 Yingzhuan Road, Tamsui District, New Taipei City 251 Taiwan, Republic of China
2
Department of Electronic Engineering, Universiti Tunku Abdul Rahman, Jalan Universiti, Bandar Barat, 31900 Kampar, Perak, Malaysia
Multimedia Tools and Applications
1 Introduction For the past few years, Augmented Reality (AR) has revolutionized the education and learning, as we know. Educators know for sure that teaching should involve more than just learning and reading; instead, it should also include creative and interactive elements as well [54]. For example, there are already several AR applications available for the teachers to help students learn English, Math, Science and many more [19]. The presence of AR not only changes the location and timing of the study process, but also provides additional ways and methods of transferring information into interactive mode. Since AR technology provides many possibilities to combine pictures, animations, digital watermarks [26, 34], image encryption [56], smart healthcare [25
Data Loading...
