-
公开(公告)号:US11521118B2
公开(公告)日:2022-12-06
申请号:US16534036
申请日:2019-08-07
Inventor: Pingping Huang , Min Qiao
Abstract: Embodiments of the present disclosure are directed to a method and an apparatus for generating training data for a visual question answering (VQA) system, and a computer readable medium. The method for generating training data for a visual question answering system includes: obtaining a first set of training data of the visual question answering system, the first set of training data comprising a first question for an image in the visual question answering system and a first answer corresponding to the first question; obtaining information related to the image; generating a second question corresponding to the first answer based on the information to obtain a second set of training data for the image in the visual question answering system, the second set of training data comprising the second question and the first answer.
-
公开(公告)号:US11620532B2
公开(公告)日:2023-04-04
申请号:US16665882
申请日:2019-10-28
Inventor: Jianhui Huang , Min Qiao , Zhifan Feng , Pingping Huang , Yong Zhu , Yajuan Lyu , Ying Li
Abstract: Embodiments of the present disclosure relate to a method and apparatus for generating a neural network. The method includes: acquiring a target neural network, the target neural network corresponding to a preset association relationship, and being configured to use two entity vectors corresponding to two entities in a target knowledge graph as an input, to determine whether an association relationship between the two entities corresponding to the inputted two entity vectors is the preset association relationship, the target neural network comprising a relational tensor predetermined for the preset association relationship; converting the relational tensor in the target neural network into a product of a target number of relationship matrices, and generating a candidate neural network comprising the target number of converted relationship matrices; and generating a resulting neural network using the candidate neural network.
-
3.
公开(公告)号:US20200242152A1
公开(公告)日:2020-07-30
申请号:US16690387
申请日:2019-11-21
Inventor: Pingping Huang , Min Qiao , Ying Li , Jianhui Huang
IPC: G06F16/532 , G06K9/62 , G06F16/583 , G06F16/535
Abstract: Embodiments of the present disclosure provide a method, apparatus, electronic device, and computer readable storage medium for image-based data processing. The method includes: determining, in response to an inputted query for an image, an attribute associated with an object presented in the image based on a preset mapping between the object and the attribute, further includes: determining a degree of correlation between the object and the query based on the object and the attribute, and still further includes: providing a response to the query based on the degree of correlation between the object and the query. The embodiments of the present disclosure can improve the performance of the system for image-based data processing.
-
公开(公告)号:US11416709B2
公开(公告)日:2022-08-16
申请号:US16546602
申请日:2019-08-21
Inventor: Pingping Huang , Min Qiao
IPC: G06K9/62 , G06F40/247 , G06F40/30
Abstract: Embodiments of the present disclosure relate to a method, an apparatus, a device and a computer readable medium for generating VQA training data. The method comprises: obtaining a first group of training data of the VQA system, the first group of training data including a first question for an image in the VQA system and a first answer corresponding to the first question; determining a second question associated with the first question in term of semantic; and determining a second answer corresponding to the second question based on the first question and the first answer, to obtain a second group of training data for the image in the VQA system, the second group of training data including the second question and the second answer.
-
公开(公告)号:US20200257922A1
公开(公告)日:2020-08-13
申请号:US16690432
申请日:2019-11-21
Inventor: Jianhui Huang , Pingping Huang , Min Qiao , Ying Li
IPC: G06K9/46 , G06K9/62 , G06F16/583 , G06K9/18 , G06F17/27
Abstract: Embodiments of the present disclosure disclose a method, apparatus, device, and readable storage medium for image-based data processing. The method comprises: acquiring an image and a to-be-processed text; extracting features of a plurality of objects in the image, and extracting a feature of the text; fusing the features of the plurality of objects into a fused feature of the image based on a matching degree between the feature of the text and a feature of each object of the plurality of objects; and processing the text based on the fused feature of the image and the feature of the text. Embodiments of the present disclosure can accurately learn an association relationship between a text and each object in an image, and improve the processing accuracy.
-
公开(公告)号:US11314800B2
公开(公告)日:2022-04-26
申请号:US16690387
申请日:2019-11-21
Inventor: Pingping Huang , Min Qiao , Ying Li , Jianhui Huang
IPC: G06F16/00 , G06F16/532 , G06F16/583 , G06F16/535 , G06K9/62
Abstract: Embodiments of the present disclosure provide a method, apparatus, electronic device, and computer readable storage medium for image-based data processing. The method includes: determining, in response to an inputted query for an image, an attribute associated with an object presented in the image based on a preset mapping between the object and the attribute, further includes: determining a degree of correlation between the object and the query based on the object and the attribute, and still further includes: providing a response to the query based on the degree of correlation between the object and the query. The embodiments of the present disclosure can improve the performance of the system for image-based data processing.
-
公开(公告)号:US11151406B2
公开(公告)日:2021-10-19
申请号:US16690432
申请日:2019-11-21
Inventor: Jianhui Huang , Pingping Huang , Min Qiao , Ying Li
Abstract: Embodiments of the present disclosure disclose a method, apparatus, device, and readable storage medium for image-based data processing. The method comprises: acquiring an image and a to-be-processed text; extracting features of a plurality of objects in the image, and extracting a feature of the text; fusing the features of the plurality of objects into a fused feature of the image based on a matching degree between the feature of the text and a feature of each object of the plurality of objects; and processing the text based on the fused feature of the image and the feature of the text. Embodiments of the present disclosure can accurately learn an association relationship between a text and each object in an image, and improve the processing accuracy.
-
公开(公告)号:US12165072B2
公开(公告)日:2024-12-10
申请号:US17213952
申请日:2021-03-26
Inventor: Pingping Huang , Quan Wang , Wenbin Jiang , Pengcheng Yuan
IPC: G06N5/02 , G06F18/20 , G06F18/214 , G06N5/022
Abstract: A method, apparatus, device, and storage medium for expanding data are disclosed. The method includes: acquiring a triplet from a knowledge graph; mining a relationship path equivalent to a relationship in the triplet from the knowledge graph, a subject in the triplet being used as a start point of the relationship path, and an object in the triplet being used as an end point of the relationship path; and expanding the triplet based on the relationship path to generate an expanded triplet. This implementation expands the triplet in the knowledge graph, and strengthens the association between the subject and the object in the triplet in a larger context, such that the association between the subject and the object in the triplet is more global.
-
公开(公告)号:US11995560B2
公开(公告)日:2024-05-28
申请号:US17043227
申请日:2020-04-07
Inventor: Quan Wang , Pingping Huang , Haifeng Wang , Wenbin Jiang , Yajuan Lyu , Yong Zhu , Hua Wu
IPC: G06N5/02 , G06F16/31 , G06F16/33 , G06F16/35 , G06F16/36 , G06F16/901 , G06F16/906 , G06F40/279 , G06N3/042 , G06N3/045 , G06N3/08 , G06N5/022
CPC classification number: G06N5/02 , G06N5/022 , G06F16/31 , G06F16/316 , G06F16/3347 , G06F16/35 , G06F16/36 , G06F16/367 , G06F16/9017 , G06F16/9024 , G06F16/906 , G06F40/279 , G06N3/042 , G06N3/045 , G06N3/08
Abstract: The present disclosure discloses a method and an apparatus for generating a vector representation of a knowledge graph, and relates to a field of a field of artificial intelligence technologies. The detailed implementing solution is: obtaining a knowledge graph, the knowledge graph including a plurality of entity nodes; obtaining a context type and context data corresponding to the knowledge graph; and generating vector representations corresponding to the plurality of entity nodes by a context model based on the context data and the context type.
-
公开(公告)号:US20210216885A1
公开(公告)日:2021-07-15
申请号:US17213952
申请日:2021-03-26
Inventor: Pingping Huang , Quan Wang , Wenbin Jiang , Pengcheng Yuan
Abstract: A method, apparatus, device, and storage medium for expanding data are disclosed. The method includes: acquiring a triplet from a knowledge graph; mining a relationship path equivalent to a relationship in the triplet from the knowledge graph, a subject in the triplet being used as a start point of the relationship path, and an object in the triplet being used as an end point of the relationship path; and expanding the triplet based on the relationship path to generate an expanded triplet. This implementation expands the triplet in the knowledge graph, and strengthens the association between the subject and the object in the triplet in a larger context, such that the association between the subject and the object in the triplet is more global.
-
-
-
-
-
-
-
-
-