HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

DeepIndices: Remote Sensing Indices Based on Approximation of Functions through Deep-Learning, Application to Uncalibrated Vegetation Images

{Gawain Jones Christelle Gée Jean-Noël Paoli Jehan-Antoine Vayssade}

Abstract

The form of a remote sensing index is generally empirically defined, whether by choosing specific reflectance bands, equation forms or its coefficients. These spectral indices are used as preprocessing stage before object detection/classification. But no study seems to search for the best form through function approximation in order to optimize the classification and/or segmentation. The objective of this study is to develop a method to find the optimal index, using a statistical approach by gradient descent on different forms of generic equations. From six wavebands images, five equations have been tested, namely: linear, linear ratio, polynomial, universal function approximator and dense morphological. Few techniques in signal processing and image analysis are also deployed within a deep-learning framework. Performances of standard indices and DeepIndices were evaluated using two metrics, the dice (similar to f1-score) and the mean intersection over union (mIoU) scores. The study focuses on a specific multispectral camera used in near-field acquisition of soil and vegetation surfaces. These DeepIndices are built and compared to 89 common vegetation indices using the same vegetation dataset and metrics. As an illustration the most used index for vegetation, NDVI (Normalized Difference Vegetation Indices) offers a mIoU score of 63.98% whereas our best models gives an analytic solution to reconstruct an index with a mIoU of 82.19%. This difference is significant enough to improve the segmentation and robustness of the index from various external factors, as well as the shape of detected elements.

Benchmarks

BenchmarkMethodologyMetrics
2d-semantic-segmentation-on-deep-indicesSoil Adjusted Vegetation Index
mIoU: 67.28
2d-semantic-segmentation-on-deep-indicesModified Chlorophyll Absorption In Reflectance Index 1
mIoU: 73.68
2d-semantic-segmentation-on-deep-indices5x5 universal-function + ibf + sprb
mIoU: 80.63
2d-semantic-segmentation-on-deep-indices7x7 linear + ibf+sprb
mIoU: 81.49
2d-semantic-segmentation-on-deep-indices5x5 linear-ratio + ibf + sprb
mIoU: 80.08
2d-semantic-segmentation-on-deep-indices7x7 dense-morphological + ibf + sprb
mIoU: 82.19
2d-semantic-segmentation-on-deep-indicesGlobal Environment Monitoring Index
mIoU: 65.04
2d-semantic-segmentation-on-deep-indices3x3 dense-morphological + ibf + sprb
mIoU: 80.29
2d-semantic-segmentation-on-deep-indicesAdjusted Transformed Soil Adjusted VI
mIoU: 64.96
2d-semantic-segmentation-on-deep-indices5x5 polynomial + ibf + sprb
mIoU: 80.67
2d-semantic-segmentation-on-deep-indices1x1 polynomial + ibf
mIoU: 80.03
2d-semantic-segmentation-on-deep-indices7x7 polynomial + ibf + sprb
mIoU: 81.21
2d-semantic-segmentation-on-deep-indicesNDVI
mIoU: 63.98
2d-semantic-segmentation-on-deep-indicesEnhanced Vegetation Index 3
mIoU: 65.05
2d-semantic-segmentation-on-deep-indices3x3 universal-function + ibf + sprb
mIoU: 81.08
2d-semantic-segmentation-on-deep-indices7x7 universal-function + ibf + sprb
mIoU: 80.36
2d-semantic-segmentation-on-deep-indicesSoil And Atmospherically Resistant VI 3
mIoU: 65.86
2d-semantic-segmentation-on-deep-indicesModified Triangular Vegetation Index 1
mIoU: 73.71
2d-semantic-segmentation-on-deep-indices1x1 universal-function + ibf + sprb
mIoU: 80.15
2d-semantic-segmentation-on-deep-indicesEnhanced Vegetation Index 2
mIoU: 67.94
2d-semantic-segmentation-on-deep-indices7x7 linear-ratio + ibf + sprb
mIoU: 81.35
2d-semantic-segmentation-on-deep-indices5x5 dense-morphological + ibf + sprb
mIoU: 81.92
2d-semantic-segmentation-on-deep-indices1x1 dense-morphological + ibf + sprb
mIoU: 80.00

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp