Depth map upsampling via multi-modal generative adversarial network

College

College of Computer Studies

Department/Unit

Computer Technology

Document Type

Article

Source Title

Sensors (Switzerland)

Volume

19

Issue

7

Publication Date

4-1-2019

Abstract

© 2019 by the authors. Licensee MDPI, Basel, Switzerland. Autonomous robots for smart homes and smart cities mostly require depth perception in order to interact with their environments. However, depth maps are usually captured in a lower resolution as compared to RGB color images due to the inherent limitations of the sensors. Naively increasing its resolution often leads to loss of sharpness and incorrect estimates, especially in the regions with depth discontinuities or depth boundaries. In this paper, we propose a novel Generative Adversarial Network (GAN)-based framework for depth map super-resolution that is able to preserve the smooth areas, as well as the sharp edges at the boundaries of the depth map. Our proposed model is trained on two different modalities, namely color images and depth maps. However, at test time, our model only requires the depth map in order to produce a higher resolution version. We evaluated our model both quantitatively and qualitatively, and our experiments show that our method performs better than existing state-of-the-art models.

html

Digitial Object Identifier (DOI)

10.3390/s19071587

Upload File

wf_yes

This document is currently not available here.

Share

COinS