Skip to Main content Skip to Navigation
Journal articles

Photometric Depth Super-Resolution

Bjoern Haefner 1 Songyou Peng 1 Alok Verma 1 Yvain Quéau 2 Daniel Cremers 1
2 Equipe Image - Laboratoire GREYC - UMR6072
GREYC - Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen
Abstract : This study explores the use of photometric techniques (shape-from-shading and uncalibrated photometric stereo) for upsampling the low-resolution depth map from an RGB-D sensor to the higher resolution of the companion RGB image. A single-shot variational approach is first put forward, which is effective as long as the target's reflectance is piecewise-constant. It is then shown that this dependency upon a specific reflectance model can be relaxed by focusing on a specific class of objects (e.g., faces), and delegate reflectance estimation to a deep neural network. A multi-shot strategy based on randomly varying lighting conditions is eventually discussed. It requires no training or prior on the reflectance, yet this comes at the price of a dedicated acquisition setup. Both quantitative and qualitative evaluations illustrate the effectiveness of the proposed methods on synthetic and real-world scenarios.
Document type :
Journal articles
Complete list of metadatas

Cited literature [104 references]  Display  Hide  Download

https://hal-normandie-univ.archives-ouvertes.fr/hal-02145726
Contributor : Yvain Queau <>
Submitted on : Monday, June 3, 2019 - 11:39:50 AM
Last modification on : Monday, September 23, 2019 - 2:40:04 PM

File

paper_arxiv.pdf
Files produced by the author(s)

Identifiers

Citation

Bjoern Haefner, Songyou Peng, Alok Verma, Yvain Quéau, Daniel Cremers. Photometric Depth Super-Resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, In press, ⟨10.1109/TPAMI.2019.2923621⟩. ⟨hal-02145726⟩

Share

Metrics

Record views

87

Files downloads

180