Multiple weld seam extraction from RGB-depth images for automatic robotic welding via point cloud registration
- PDF / 4,137,071 Bytes
- 17 Pages / 439.37 x 666.142 pts Page_size
- 48 Downloads / 287 Views
Multiple weld seam extraction from RGB-depth images for automatic robotic welding via point cloud registration Jiwan Kim 1 & Jeongjin Lee 2 & Minyoung Chung 1
& Yeong-Gil Shin
1
Received: 29 June 2020 / Revised: 5 September 2020 / Accepted: 23 October 2020 # Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract
Robotic welding technology is constantly growing with the development of vision technologies. To establish a fully automatic robotic welding system, an automated weld seam extraction process with accurate perception of the target workpiece (i.e., object) is one of the most challenging tasks. Although many methods pertaining to automatic weld seam extraction have been proposed, most of the previous studies are difficult to employ in practical systems because the algorithms are unable to simultaneously handle multiple and occluded seams from arbitrary view directions. In this study, we propose a novel method to extract weld seams based on point cloud registration from various view directions that can handle randomly occluded seams in a workpiece with multiple seam parts. We focus on the shape of the weld seams as a line or curve, which are dominant structures in the field. Initially, we extract all detectable weld seams for each image with a single view direction obtained using an RGB-depth vision sensor. Subsequently, three-dimensional points of weld seams obtained from each view direction are filtered based on the edge cues from RGB images. Finally, the extracted weld seams obtained from the various view directions are merged by employing a point cloud registration technique. The experimental results demonstrate that the proposed method outperforms a state-of-the-art method in terms of detection accuracy. Our proposed algorithm can be employed for dynamic workpiece scenes, which indicates that multiple weld seams can be successfully extracted from arbitrary view directions containing scene occlusions. Keywords Seam extraction . 3D reconstruction . Point cloud registration . Multiple weld seam extraction
* Minyoung Chung [email protected] Extended author information available on the last page of the article
Multimedia Tools and Applications
1 Introduction Robotic welding technology is constantly growing with the development of vision technologies and robotic systems [26]. Intra- and inter-observer variability of the welding, which introduces human errors in manufacturing, can be significantly reduced by developing an automatic welding algorithm. Further, a significant improvement in efficient manufacturing can be obtained by developing the system. To establish a fully automatic welding system, developing an intelligent welding mode is essential based on the fact that traditional working modes, such as “teaching-playback” and offline programing [18, 21], cannot provide sufficient perception in dynamic and unstructured environments [33]. Many studies have been proposed to build an automated welding system based on various imaging devices [26]. As the robotic welding is performed i
Data Loading...
