Mitigating Illumination-, Leaf-, and View-Angle Dependencies in Hyperspectral Imaging Using Polarimetry

Daniel Krafft; Clifton G Scarboro; William Hsieh; Colleen Doherty; Peter Balint-Kurti; Michael Kudenov

doi:10.34133/plantphenomics.0157

Mitigating Illumination-, Leaf-, and View-Angle Dependencies in Hyperspectral Imaging Using Polarimetry

Plant Phenomics. 2024 Mar 22:6:0157. doi: 10.34133/plantphenomics.0157. eCollection 2024.

Authors

Daniel Krafft^{1

2}, Clifton G Scarboro^{1

2}, William Hsieh¹, Colleen Doherty^{2

3}, Peter Balint-Kurti^{4

5}, Michael Kudenov^{1

2}

Affiliations

¹ Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA.
² NC Plant Sciences Initiative, North Carolina State University, Raleigh, NC, USA.
³ Department of Molecular and Structural Biochemistry, North Carolina State University, Raleigh, NC, USA.
⁴ Department of Entomology and Plant Pathology, North Carolina State University, Box 7616, Raleigh, NC 27695, USA.
⁵ Plant Science Research Unit, USDA-ARS, Raleigh, NC 27695, USA.

Abstract

Automation of plant phenotyping using data from high-dimensional imaging sensors is on the forefront of agricultural research for its potential to improve seasonal yield by monitoring crop health and accelerating breeding programs. A common challenge when capturing images in the field relates to the spectral reflection of sunlight (glare) from crop leaves that, at certain solar incidences and sensor viewing angles, presents unwanted signals. The research presented here involves the convergence of 2 parallel projects to develop a facile algorithm that can use polarization data to decouple light reflected from the surface of the leaves and light scattered from the leaf's tissue. The first project is a mast-mounted hyperspectral imaging polarimeter (HIP) that can image a maize field across multiple diurnal cycles throughout a growing season. The second project is a multistatic fiber-based Mueller matrix bidirectional reflectance distribution function (mmBRDF) instrument which measures the polarized light-scattering behavior of individual maize leaves. The mmBRDF data was fitted to an existing model, which outputs parameters that were used to run simulations. The simulated data were then used to train a shallow neural network which works by comparing unpolarized 2-band vegetation index (VI) with linearly polarized data from the low-reflectivity bands of the VI. Using GNDVI and red-edge reflection ratio we saw an improvement of an order of magnitude or more in the mean error (ϵ) and a reduction spanning 1.5 to 2.7 in their standard deviation (ϵ_σ) after applying the correction network on the HIP sensor data.