Hardware-friendly architecture for a pseudo 2D weighted median filter based on sparse-window approach
- PDF / 1,829,032 Bytes
- 16 Pages / 439.37 x 666.142 pts Page_size
- 20 Downloads / 192 Views
Hardware-friendly architecture for a pseudo 2D weighted median filter based on sparse-window approach Jongkil Hyun 1 & Younghyeon Kim 2 & Junghwan Kim 1 & Byungin Moon 3 Received: 19 January 2020 / Revised: 19 July 2020 / Accepted: 16 September 2020 # Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract
Stereo matching, which is conventionally used for three-dimensional (3D) information acquisition through cameras, is the most actively studied subject in computer vision. To obtain sophisticated 3D information, refining the disparity map in stereo vision is important. The weighted median filter (WMF) is extensively used to eliminate outliers in post-processing. To this end, various studies have implemented WMFs in hardware for real-time processing. Among them, the separable weighted median filter (sWMF) vertically and horizontally separates a two-dimensional WMF into two one-dimensional WMFs to reduce hardware resource usage. Herein, we propose a hardware architecture that can reduce the hardware resource usage of the sWMF by applying the sparse-window approach, which is a method of creating a window by selecting pixels sparsely. This approach makes it possible to reduce drastically the number of elements to be computed. Although the proposed architecture has an insignificant disparity error rate, similar to that of the sWMF, it saves 33% slice lookup tables (LUTs) and 69% slice registers when using a window size of 37 × 37 pixels as the synthesis result on the Xilinx XC7K325T FPGA. When a window size of 49 × 13 pixels with the best performance is used, the proposed architecture uses 7335 slice LUTs, 4126 slice registers, and 21 block RAMs. The proposed architecture operates at frequencies of up to 167.95 MHz; hence, it can operate in real time. The proposed WMF architecture is suitable for application in embedded systems and low-resource environments as it is hardware-friendly. Keywords Stereo vision . Stereo matching . Post-processing . Weighted median filter . Hardware implementation * Byungin Moon [email protected]
1
School of Electronic and Electrical Engineering, Kyungpook National University, Daegu, Korea
2
Department of Mobile Telecommunications Engineering, Kyungpook National University, Daegu, Korea
3
School of Electronics Engineering, Kyungpook National University, Daegu, Korea
Multimedia Tools and Applications
1 Introduction With the advancements in computing devices and image sensors, extensive research has been conducted on computer vision in recent years. Computer vision can be applied in various fields such as smart farming, object detection, and three-dimensional (3D) information acquisition [6, 9, 16]. Among these, 3D information acquisition is particularly used in robot navigation, autonomous cars, and visual odometry. Moreover, 3D information can also be extensively used for content production such as augmented reality and 3D modeling in social multimedia because it can provide additional viewing freedom for enhanced immersive experience and augmented user intera
Data Loading...
