A 3D white referencing method for soybean leaves based on fusion of hyperspectral images and 3D point clouds

  • PDF / 2,273,115 Bytes
  • 14 Pages / 439.37 x 666.142 pts Page_size
  • 8 Downloads / 215 Views

DOWNLOAD

REPORT


A 3D white referencing method for soybean leaves based on fusion of hyperspectral images and 3D point clouds Libo Zhang1 · Jian Jin1 · Liangju Wang1 · Peikui Huang1,2 · Dongdong Ma1

© Springer Science+Business Media, LLC, part of Springer Nature 2020

Abstract In recent years, plant phenotyping technologies have been widely applied to evaluate complex plant traits such as morphology, physiology, ecology, biochemistry, tolerance, growth and yield. Hyperspectral/multispectral cameras, artificial lighting sources, mechanisms and computers together capture images of different species of plants. Due to the non-uniform intensity of lighting sources in different wavelengths, raw images need to be calibrated using white references. Flat white panels are typically scanned as a white reference. However, geometrical factors such as leaf tilt angles cannot be calibrated by flat white references. In this publication, the effectiveness of using angled white reference to calibrate corresponding raw images was first demonstrated. Furthermore, a 3D white referencing library integrating different angles and spatial positions in the system of a hyperspectral camera and a Kinect V2 depth sensor was created. Thus, a pixel on the leaf surface can be calibrated by a point with the nearest tilt angle and spatial position in the 3D referencing library. The validating samples for this referencing library were soybean leaves grown in a greenhouse. The results showed that the reflectance spectra after 3D calibration were closer to the standard calibration (flat leaf calibrated by flat white reference) than the conventional flat white referencing calibration. Furthermore, the pixel-level normalized difference vegetation index (NDVI) distribution over the soybean leaf surface after 3D calibration was also closer to the standard calibration. This proposed 3D white referencing method had the potential to improve calibration quality of plant images. Integrating with LiDAR sensors, this new approach has an opportunity to be applied in field environments. Keywords  Plant phenotyping · Non-uniform lighting · Hyperspectral image calibration · 3D white referencing library · 3D point clouds

* Jian Jin [email protected] 1

Department of Agricultural and Biological Engineering, Purdue University, 225 South University Street, West Lafayette, IN 47907, USA

2

Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China



13

Vol.:(0123456789)



Precision Agriculture

Introduction Plant phenotyping is a comprehensive method to evaluate plant traits such as morphology, physiology, ecology, biochemistry, tolerance, growth and yield (Dhondt et al. 2013; Li et al. 2014; Zhou et al. 2018). In recent years, plant phenotyping technologies have been widely applied in agriculture to implement quantitative analysis of plant traits and accelerate progress in breeding (Tester and Langridge, 2010; Xiong et al. 2017). Hyperspectral or multispectral cameras, artificial li