This work addresses the problem of learning compact yet discriminative patch descriptors within a deep learning framework. We observe that features extracted by convolutional layers in the pixel domain are largely complementary to features extracted in a transformed domain. We propose a convolutional network framework for learning binary patch descriptors where pixel domain features are fused with features extracted from the transformed domain. In our framework, while convolutional and transformed features are distinctly extracted, they are fused and provided to a single classifier which thus jointly operates on convolutional and transformed features. We experiment at matching patches from three different dataset, showing that our feature fusion approach outperforms multiple state-of-the-art approaches in terms of accuracy, rate and complexity.

Feature Fusion for Robust Patch Matching with Compact Binary Descriptors

Fiandrotti, Attilio
;
2018

Abstract

This work addresses the problem of learning compact yet discriminative patch descriptors within a deep learning framework. We observe that features extracted by convolutional layers in the pixel domain are largely complementary to features extracted in a transformed domain. We propose a convolutional network framework for learning binary patch descriptors where pixel domain features are fused with features extracted from the transformed domain. In our framework, while convolutional and transformed features are distinctly extracted, they are fused and provided to a single classifier which thus jointly operates on convolutional and transformed features. We experiment at matching patches from three different dataset, showing that our feature fusion approach outperforms multiple state-of-the-art approaches in terms of accuracy, rate and complexity.
Multimedia Signal Processing (MMSP), 2018 IEEE 20th International Workshop on
Vancouver, BC, Canada
29-31 Aug. 2018
Proceedings of the 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP)
IEEE
1
6
978-1-5386-6070-6
https://ieeexplore.ieee.org/abstract/document/8547141
MIGLIORATI, ANDREA; Fiandrotti, Attilio; Francini, Gianluca; Lepsoy, Skjalg; LEONARDI, RICCARDO
File in questo prodotto:
File Dimensione Formato  
main.pdf

Accesso riservato

Dimensione 781.63 kB
Formato Adobe PDF
781.63 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
08547141.pdf

Accesso riservato

Dimensione 888.15 kB
Formato Adobe PDF
888.15 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/2318/1769279
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact