Multiview video plus depth (MVD) is the most popular 3D video format where the texture images contain the color information and the depth maps represent the geometry of the scene. The depth maps are exploited to obtain intermediate views to enable 3D-TV and free-viewpoint applications using the depth image based rendering (DIBR) techniques. DIBR is used to get an estimate of the intermediate views but has to cope with depth errors, occlusions, imprecise camera parameters, re-interpolation, to mention a few issues. Therefore, being able to evaluate the true perceptual quality of synthesized images is of paramount importance for a high quality 3D experience. In this paper, we present a novel algorithm to assess the quality of the synthesized images in the absence of the corresponding references. The algorithm uses the original views from which the virtual image is generated to estimate the distortion induced by the DIBR process. In particular, a block-based perceptual feature matching based on signal phase congruency metric is devised to estimate the synthesis distortion. The experiments worked out on standard DIBR synthesized database show that the proposed algorithm achieves high correlation with the subjective ratings and outperforms the existing 3D quality assessment algorithms.

Perceptual quality assessment of 3D synthesized images

FARID, MUHAMMAD SHAHID;LUCENTEFORTE, Maurizio;GRANGETTO, Marco
2017

Abstract

Multiview video plus depth (MVD) is the most popular 3D video format where the texture images contain the color information and the depth maps represent the geometry of the scene. The depth maps are exploited to obtain intermediate views to enable 3D-TV and free-viewpoint applications using the depth image based rendering (DIBR) techniques. DIBR is used to get an estimate of the intermediate views but has to cope with depth errors, occlusions, imprecise camera parameters, re-interpolation, to mention a few issues. Therefore, being able to evaluate the true perceptual quality of synthesized images is of paramount importance for a high quality 3D experience. In this paper, we present a novel algorithm to assess the quality of the synthesized images in the absence of the corresponding references. The algorithm uses the original views from which the virtual image is generated to estimate the distortion induced by the DIBR process. In particular, a block-based perceptual feature matching based on signal phase congruency metric is devised to estimate the synthesis distortion. The experiments worked out on standard DIBR synthesized database show that the proposed algorithm achieves high correlation with the subjective ratings and outperforms the existing 3D quality assessment algorithms.
2017 IEEE International Conference on Multimedia and Expo, ICME 2017
hkg
2017
Proceedings - IEEE International Conference on Multimedia and Expo
IEEE Computer Society
505
510
9781509060672
http://ieeexplore.ieee.org/xpl/conferences.jsp
Depth image based rendering; Free-viewpoint TV; Quality assessment; View synthesis; Computer Vision and Pattern Recognition
Farid, MUHAMMAD SHAHID; Lucenteforte, Maurizio; Grangetto, Marco
File in questo prodotto:
File Dimensione Formato  
DSQM_ICME17.pdf

Accesso aperto

Tipo di file: POSTPRINT (VERSIONE FINALE DELL’AUTORE)
Dimensione 435.63 kB
Formato Adobe PDF
435.63 kB Adobe PDF Visualizza/Apri
08019307.pdf

Accesso riservato

Tipo di file: PDF EDITORIALE
Dimensione 267.33 kB
Formato Adobe PDF
267.33 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1651383
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 21
  • ???jsp.display-item.citation.isi??? 19
social impact