Integration of Joint Multilateral Filter and Projective Transformation For Depth Map Enhancement

DOI

10.2991/acta-14.2014.21How to use a DOI?

Keywords

depth enhancement; joint multilateral filter; projective transformation; multi-view

Abstract

Although many depth map enhancement algorithms based on joint multilateral filter have been developed, they still have some drawbacks. Firstly, the edges of video and depth can be similar but not the same. Some texture of video will appear in where should not be in depth when the joint multilateral filter is used to enhance the depth. Secondly, it is difficult to trade off the window size and shape for reliable result and rate of convergence. Thirdly, these filters will lead to fuzzy result. In this paper, integration of joint multilateral filter and projective transformation is proposed to partially overcome the difficulties above. Based on the theory of multiple view geometry, the correspondences of projection points are determined by projective transformation in two camera image planes when the real scene is modeled as a plane. The proposed method over-segments the image into many small pieces. In each segment, the transformation matrix is calculated firstly if the segment is sufficient small and the reliable pixels determined by cross-check are enough. Then the matrix is checked to determine whether the segment can be approximated as a planar surface or not. The unreliable pixels in depth will be refined using reliable matrices in the corresponding segments. The rest unreliable pixels are refined by using joint multilateral filter. Experimental results show that the proposed algorithm can achieve a performance better than that with joint multilateral filter only.

Copyright

© 2014, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Zuo Yifan
AU  - Li Hejian
AU  - You Zhixiang
AU  - An Ping
AU  - Shen Liquan
PY  - 2014/06
DA  - 2014/06
TI  - Integration of Joint Multilateral Filter and Projective Transformation For Depth Map Enhancement
BT  - 2014 International Conference on Automatic Control Theory and Application
PB  - Atlantis Press
SP  - 81
EP  - 85
SN  - 2352-5398
UR  - https://doi.org/10.2991/acta-14.2014.21
DO  - 10.2991/acta-14.2014.21
ID  - Yifan2014/06
ER  -