RealityBrush: an AR authoring system that captures and utilizes kinetic properties of everyday objects
- PDF / 3,377,000 Bytes
- 24 Pages / 439.642 x 666.49 pts Page_size
- 116 Downloads / 157 Views
RealityBrush: an AR authoring system that captures and utilizes kinetic properties of everyday objects Hyunju Kim1 · Sanghwa Hong1 · Junki Kim1 · Taesoo Jang1 · Woontaek Woo1 · Seongkook Heo2 · Byungjoo Lee1 Received: 8 February 2020 / Revised: 11 May 2020 / Accepted: 9 July 2020 / © Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract This study introduces RealityBrush, a novel augmented reality (AR) authoring system that allows designers to quickly and easily create realistic virtual objects by capturing and utilizing the kinetic properties of everyday physical objects in the early stages of design. The RealityBrush system consists of a handheld device, a data analysis module and an AR feedback module. The handheld device, which is made in the shape of a rod, is equipped with a depth camera and a force sensor at the tip. When a user holds the device and pokes a physical object, the local force applied to the object and the resulting deformations of the object are measured simultaneously. By analyzing the relationship between measured force and deformations, the RealityBrush system can identify two kinetic properties of the poked object: stiffness and motion resistance. The user can then use the handheld device as a 3D brush to create a virtual object in the air and assign the measured kinetic properties to the created virtual object. Finally, the system’s physics engine allows the user to interact with the created object by using the device to poke or push the object. The technical evaluation showed that the system can successfully extract the stiffness and motion resistance of everyday objects. We also report initial user feedback on AR authoring using the RealityBrush system. Keywords Augmented reality · Kinetic property · AR authoring
1 Introduction Today’s AR systems help users effectively create virtual drawings and models in 3D space. Particularly, in such an AR authoring process, users can benefit by observing virtual models created by themselves and existing physical objects simultaneously in the same space. Previous studies have shown that in-situ AR authoring facilitates users’ spatial thinking [13] and allows novice users to perform complex modeling tasks effectively from such improved spatial awareness [35]. Byungjoo Lee
[email protected] 1
KAIST, Daejeon, Republic of Korea
2
Department of Computer Science, University of Virginia, Charlottesville, VA, USA
Multimedia Tools and Applications
In a situation where the virtual world and the physical world coexist, allowing the computer to access the information of the physical world can give users new possibilities of authoring. For example, previous studies suggested tools to capture visual information such as color or texture from physical objects and use it for digital drawing have encouraged people to explore the surroundings [10, 27], increase people’s interest in materials used in art works [28], and associate their personal stories with drawings [27, 29]. However, simply reproducing visual characteristics is n
Data Loading...
