Skip to Main content Skip to Navigation
New interface
Conference papers

Two-step multi-spectral registration via key-point detector and gradient similarity. Application to agronomic scenes for proxy-sensing

Abstract : The potential of multi-spectral images is growing rapidly in precision agriculture, and is currently based on the use of multi-sensor cameras. However, their development usually concerns aerial applications and their parameters are optimized for high altitudes acquisition by drone (UAV ≈ 50 meters) to ensure surface coverage and reduce technical problems. With the recent emergence of terrestrial robots (UGV), their use is diverted for nearby agronomic applications. Making it possible to explore new agronomic applications, maximizing specific traits extraction (spectral index, shape, texture …) which requires high spatial resolution. The problem with these cameras is that all sensors are not aligned and the manufacturers’ methods are not suitable for close-field acquisition, resulting in offsets between spectral images and degrading the quality of extractable informations. We therefore need a solution to accurately align images in such condition. In this study we propose a two-steps method applied to the six-bands Airphen multi-sensor camera with (i) affine correction using pre-calibrated matrix at different heights, the closest transformation can be selected via internal GPS and (ii) perspective correction to refine the previous one, using key-points matching between enhanced gradients of each spectral bands. Nine types of key-point detection algorithms (ORB, GFTT, AGAST, FAST, AKAZE, KAZE, BRISK, SURF, MSER) with three different modalities of parameters were evaluated on their speed and performances, we also defined the best reference spectra on each of them. The results show that GFTT is the most suitable methods for key-point extraction using our enhanced gradients, and the best spectral reference was identified to be the band centered on 570 nm for this one. Without any treatment the initial error is about 62 px, with our method, the remaining residual error is less than 1 px, where the manufacturer’s involves distortions and loss of information with an estimated residual error of approximately 12 px
Complete list of metadata

Cited literature [29 references]  Display  Hide  Download
Contributor : Institut Agro Dijon Connect in order to contact the contributor
Submitted on : Thursday, March 5, 2020 - 2:51:16 PM
Last modification on : Friday, December 2, 2022 - 12:57:49 PM
Long-term archiving on: : Saturday, June 6, 2020 - 3:55:20 PM


Files produced by the author(s)



Jehan-Antoine Vayssade, Gawain Jones, Jean-Noël Paoli, Christelle Gée. Two-step multi-spectral registration via key-point detector and gradient similarity. Application to agronomic scenes for proxy-sensing. Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Feb 2020, La Valette, Malta. ⟨10.5220/0009169301030110⟩. ⟨hal-02499730⟩



Record views


Files downloads