Multimodal Knowledge Graph Completion Method Based on Knowledge Representation Enhancement

Zhi-xuan ZHANG , Yan-hui ZHU , Jia-rui SHEN , Shu-chuan JIN , Fang-teng MAN , Hao CHEN , Xu-jian YING

Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (29) : 12641 -12649.

PDF
Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (29) : 12641-12649 DOI: 10.12404/j.issn.1671-1815.2310236
research-article
Multimodal Knowledge Graph Completion Method Based on Knowledge Representation Enhancement
Author information +
History +
PDF

Abstract

Currently, knowledge representation learning has been effectively utilized in knowledge graph completion tasks to predict missing entities or relationships within knowledge graphs, achieving considerable success. However, the structural features of triples after data construction are the only considerations for most traditional completion methods based on representation learning, the results in the rich textual, image, and other multimodal information in the original data not being effectively utilized. To address this problem, it is proposed that the energy function of triples should be defined as the sum of sub-energy functions, which are characterized by the textual features of relationships and the multimodal features of entities, to fully exploit the semantic information in the triple. In addition, a multimodal negative sampling strategy has been devised for diverse energy functions, aiming to align the disparate features of entities, enhance the quality of knowledge representation, and boost the performance of knowledge graph completion. Link prediction experiments were conducted on publicly available datasets DB15K and FB15K-237. The results show that the proposed model exhibits remarkable capabilities in knowledge graph completion.

Keywords

knowledge graph completion / multimodal / knowledge representation learning / negative sampling

Cite this article

Download citation ▾
Zhi-xuan ZHANG, Yan-hui ZHU, Jia-rui SHEN, Shu-chuan JIN, Fang-teng MAN, Hao CHEN, Xu-jian YING. Multimodal Knowledge Graph Completion Method Based on Knowledge Representation Enhancement. Science Technology and Engineering, 2024, 24(29): 12641-12649 DOI:10.12404/j.issn.1671-1815.2310236

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (3694KB)

20

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉