公开(公告)号：US20210390257A1

公开(公告)日：2021-12-16

申请号：US17116846

申请日：2020-12-09

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Chao Pang ,  Shuohuan Wang ,  Yu Sun ,  Hua Wu ,  Haifeng Wang

IPC: G06F40/295 ,  G06F40/30 ,  G06F40/137 ,  G06N5/02

Abstract: A method, an apparatus, a device and a storage medium for learning a knowledge representation are provided. The method can include: sampling a sub-graph of a knowledge graph from a knowledge base; serializing the sub-graph of the knowledge graph to obtain a serialized text; and reading using a pre-trained language model the serialized text in an order in the sub-graph of the knowledge graph, to perform learning to obtain a knowledge representation of each word in the serialized text. The knowledge representation learning in this embodiment is performed for entity and relationship representation learning in the knowledge base.