Research on Image Description Method Based on Neural Network

Authors

Kong Rui, 1. School of Intelligent Systems Science and Engineering, Jinan University, Zhuhai 519070, China;;
Xie Wei, 1. School of Intelligent Systems Science and Engineering, Jinan University, Zhuhai 519070, China;;
Lei Tai, 2. College of Information Science and Technology, Jinan University, Guangzhou 510632, China;

Abstract

Abstract: The automatic recognition and automatically describing image content is an important research direction to the artificial intelligence to connect the computer vision and the natural language processing. A method of describing the image content is proposed to generate the natural language by using the deep neural network model. The model consists of a convolutional neural network (CNN) and a recurrent neural network (RNN). The CNN is used to extract features of the input image to generate a fixed-length feature vector, which initializes the RNN to generate the sentences. Experimental results on the MSCOCO image description dataset show the syntactic accuracy and the semantic accuracy of the sentences generated by the model is superior to the previous baseline model.

Recommended Citation

Rui, Kong; Wei, Xie; and Tai, Lei (2020) "Research on Image Description Method Based on Neural Network," Journal of System Simulation: Vol. 32: Iss. 4, Article 7.
DOI: 10.16182/j.issn1004731x.joss.18-0310
Available at: https://dc-china-simulation.researchcommons.org/journal/vol32/iss4/7

First Page

601

Revised Date

2018-09-26

DOI Link

https://doi.org/10.16182/j.issn1004731x.joss.18-0310

Last Page

611

CLC

TP391.9

Recommended Citation

Kong Rui, Xie Wei, Lei Tai. Research on Image Description Method Based on Neural Network[J]. Journal of System Simulation, 2020, 32(4): 601-611.

DOI

10.16182/j.issn1004731x.joss.18-0310