公开(公告)号：US20240233334A1

公开(公告)日：2024-07-11

申请号：US18563222

申请日：2022-04-26

Applicant: Beijing Youzhuju Network Technology Co., Ltd.

Inventor： Jin XIA ,  Keyu WEN ,  Yuanyuan HUANG ,  Jie SHAO ,  Changhu WANG

IPC: G06V10/77 ,  G06T5/60 ,  G06V10/82

CPC classification number: G06V10/7715 ,  G06T5/60 ,  G06V10/82

Abstract: The present disclosure relates to a multi-modal data retrieval method and apparatus, a medium, and an electronic device. The method includes: inputting target retrieval data into a first feature extraction network corresponding to a modality of the target retrieval data to acquire a data feature of the target retrieval data; inputting the data feature into a second feature extraction network corresponding to the modality of the target retrieval data to acquire a target retrieval feature corresponding to the target retrieval data, wherein second feature extraction networks respectively corresponding to modalities share a weight; and performing retrieval based on the target retrieval feature.