Journal
SCIENTIFIC REPORTS
Volume 12, Issue 1, Pages -Publisher
NATURE PORTFOLIO
DOI: 10.1038/s41598-022-21149-9
Keywords
-
Categories
Funding
- NSFC [62076200, 2020JM-468]
- Shaanxi Natural Science Foundation
Ask authors/readers for more resources
This paper proposes a dynamic memory network model (DMN-MA) based on the multiple attention mechanism, which combines channel attention and spatial attention. By applying the multiple attention mechanism in the situational memory module, the model achieves accurate answers to complex questions and effectively utilizes contextual information for answer inference.
Since the existing visual question answering model lacks long-term memory modules for answering complex questions, it is easy to cause the loss of effective information. In order to further improve the accuracy of the visual question answering model, this paper applies the multiple attention mechanism combining channel attention and spatial attention to memory networks for the first time and proposes a dynamic memory network model (DMN-MA) based on the multiple attention mechanism. The model uses the multiple attention mechanism in the situational memory module to obtain the most relevant visual vectors for answering questions based on continuous memory updating, storage and iterative inference of the questions, and effectively uses contextual information for answer inference. The experimental results show that the accuracy of the model in this paper reaches 64.57% and 67.18% on the large-scale public datasets COCO-QA and VQA2.0, respectively.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available