Multi-view Depth Estimation Based on Adaptive Space Feature Enhancement

Authors

Dong Wei, School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, ChinaFollow
Huan Liu, School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, ChinaFollow
Xiaohan Zhang, School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, China
Changkai Li, School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, China
Tianyi Sun, School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, China
Ziyou Zhang, School of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, China

Abstract

Abstract: A multi-view depth estimation algorithm based on adaptive space feature enhancement (ASFE) is presented to improve the multi-view depth estimation accuracy. A multi-scale feature extraction module composed of an improved feature pyramid network (FPN) and ASFE is designed. This module obtains multi-scale feature maps with global context-aware information and coordinate information. The residual learning network is used to optimize the depth map to prevent the problem of blurred reconstructed edges in multiple convolution operations. The proposed algorithm constructs a focal loss function through the idea of classification to enhance the prediction ability of the network model. The experimental results show that on the technical university of denmark (DTU) dataset, compared with the cascade MVSNet (CasMVSNet) method, the proposed method reduces overall accuracy error, running time, and video memory resource occupation by 14.08%, 72.15%, and 4.62%, respectively. The Mean of the model on the Tanks and Temples dataset is superior to other algorithms, which proves the effectiveness of the proposed multi-view depth estimation algorithm based on ASFE.

Recommended Citation

Wei, Dong; Liu, Huan; Zhang, Xiaohan; Li, Changkai; Sun, Tianyi; and Zhang, Ziyou (2024) "Multi-view Depth Estimation Based on Adaptive Space Feature Enhancement," Journal of System Simulation: Vol. 36: Iss. 1, Article 8.
DOI: 10.16182/j.issn1004731x.joss.23-0112
Available at: https://dc-china-simulation.researchcommons.org/journal/vol36/iss1/8

First Page

110

Last Page

119

CLC

TP391.4

Recommended Citation

Wei Dong, Liu Huan, Zhang Xiaohan, et al. Multi-view Depth Estimation Based on Adaptive Space Feature Enhancement[J]. Journal of System Simulation, 2024, 36(1): 110-119.

Corresponding Author

Liu Huan

DOI

10.16182/j.issn1004731x.joss.23-0112