Person Retrieval Method Based on Image Caption

Authors

Yadong Li, State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China;
Mo Hong, State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China;
Shihao Wang, State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China;
Zhou Zhong, State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China;
Wu Wei, State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China;

Abstract

Abstract: Retrieve specific person in the surveillance scene is an important and urgent demand on the security field. In recent years, the method of image retrieval is mainly based on image content, which requires the image to be retrieved works as input and thus can’t meet the actual needs of surveillance and security. We propose a method of person retrieval based on image caption and present a new surveillance dataset SPCD which tags person caption. We verify the method in new dataset, the accuracy of gender, dress color and action respectively reaches 86.5%, 93.5% and 65.5%. This paper provides an effective way for application of retrieval person in the surveillance scene.

Recommended Citation

Li, Yadong; Hong, Mo; Wang, Shihao; Zhong, Zhou; and Wei, Wu (2019) "Person Retrieval Method Based on Image Caption," Journal of System Simulation: Vol. 30: Iss. 7, Article 45.
DOI: 10.16182/j.issn1004731x.joss.201807045
Available at: https://dc-china-simulation.researchcommons.org/journal/vol30/iss7/45

First Page

2794

DOI Link

https://doi.org/10.16182/j.issn1004731x.joss.201807045

Last Page

2800

CLC

TP391.4

Recommended Citation

Li Yadong, Mo Hong, Wang Shihao, Zhou Zhong, Wu Wei. Person Retrieval Method Based on Image Caption[J]. Journal of System Simulation, 2018, 30(7): 2794-2800.

DOI

10.16182/j.issn1004731x.joss.201807045