METHOD AND APPARATUS FOR ACQUIRING PRE-TRAINED MODEL

    公开(公告)号:US20220292269A1

    公开(公告)日:2022-09-15

    申请号:US17502108

    申请日:2021-10-15

    Abstract: The present disclosure discloses a method and apparatus for acquiring a pre-trained model, and relates to natural language processing and deep learning technologies in the field of artificial intelligence technologies. An implementation includes: acquiring training data, the training data including a single-modal language material and a multi-modal language material, and the multi-modal language material including a language material pair formed by a first-modal language material and a second-modal language material; and performing a multi-task training operation on a pre-trained model using the training data, the multi-task including at least one cross-modal contrastive learning task and at least one single-modal learning task; the pre-trained language model obtained in the present disclosure may learn from different forms of language materials, i.e., the single-modal language material and the multi-modal language material, such that the pre-trained language model may effectively process information in various modals.

    IMAGE EDITING
    4.
    发明申请

    公开(公告)号:US20250078369A1

    公开(公告)日:2025-03-06

    申请号:US18953942

    申请日:2024-11-20

    Abstract: A method is provided that includes: obtaining an editing instruction input by a user in a current round of a dialogue and history dialogue information in at least one history round of the dialogue, wherein the history dialogue information comprises a history dialogue text and at least one history image; determining a source image to be edited from the at least one history image based on the editing instruction and the history dialogue information; and editing the source image to generate a target image based on the editing instruction.

    SUMMARY GENERATION MODEL TRAINING METHOD AND APPARATUS, DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20230004589A1

    公开(公告)日:2023-01-05

    申请号:US17577561

    申请日:2022-01-18

    Abstract: The present disclosure provides a summary generation model training method and apparatus, a device and a storage medium, and relates to the field of computer technologies, and in particular, to the field of artificial intelligence such as natural language processing and deep learning. The summary generation model training method includes: acquiring a document representation corresponding to a document sample; constructing, based on the document representation, a summary representation corresponding to the document representation, the summary representation including a positive summary representation and a negative summary representation; and constructing a total contrastive loss function based on the document representation, the positive summary representation and the negative summary representation, and training a summary generation model based on the total contrastive loss function. The present disclosure may improve accuracy of the summary generation model.

    METHOD FOR GENERATING QUERY STATEMENT, ELECTRONIC DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20220179889A1

    公开(公告)日:2022-06-09

    申请号:US17652314

    申请日:2022-02-24

    Abstract: The disclosure provides a method for generating a query statement. The method includes: determining a first vector representation based on known nodes in a first syntax tree corresponding to a query statement to be generated; determining a target generation strategy corresponding to a target node to be generated based on the first vector representation and a preset copy reference matrix; generating the target node based on the first vector representation or a second vector representation by performing the target generation strategy, in which the second vector representation is a vector representation corresponding to an adjacent query statement prior to the query statement to be generated; and generating the query statement based on the known nodes and a terminator in response to the target node being the terminator.

Patent Agency Ranking