Combining 3D-multispectral and hyperspectral imaging to identify environmental stress treatments imposed during plant growth

Non-invasive, high-throughput phenotyping tools are needed that can identify environmental effects on plant structure and function to diagnose factors responsible for reduced growth in commercial and non-commercial settings. In this study, we explored whether the integration of 3D-multispectral (3D) and 2D-hyperspectral imaging (HSI), aided by machine learning (ML), could be used to identify environmental stress treatments imposed during plant growth. Controlled environment-grown Nicotiana Benthamiana plants were subjected to a range of abiotic treatments - including different growth irradiances, heat treatment and drought stress - with the treatments resulting in differences in shoot height, biomass, leaf area and spectral reflectance. ML models were trained to identify these treatments using morphological and spectral traits measured at 27, 29, 31, and 34 days after sowing (DAS). A 3D-multispectral scanner was used to obtain information on plant height, biomass, and leaf area. A visible and near-infrared (VNIR) HSI camera provided detailed spectral information for deriving spectral indices including the Normalised Difference Vegetation Index (NDVI), Photochemical Reflectance Index (PRI) and Normalized Difference Red Edge (NDRE). Manual measurements provided baseline comparative data. The 3D-multispectral scanner reliably estimated above-ground traits, with high correlations between manual and scanner-derived measurements. The ML models accurately differentiated among environmental stress treatments, with the fused 3D+HSI model achieving the best overall predictive performance across all evaluated metrics compared with models based on either imaging modality alone. Results demonstrated the effectiveness of combining 3D-multispectral and 2D-HSI data with ML analyses for non-destructive, high-throughput phenotyping. The integration of these techniques enabled non-destructive, high-throughput identification of environmental stress treatments imposed during plant growth.