公开(公告)号：US11720757B2

公开(公告)日：2023-08-08

申请号：US16543794

申请日：2019-08-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Vikas Bahirwani ,  Jade Huang ,  Matthew Brigham Hall ,  Yu Zhao ,  Pengcheng He ,  Weizhu Chen ,  Eslam K. Abdelreheem ,  Jiayuan Huang ,  Yuting Sun

IPC: G06F40/35 ,  G06F40/117 ,  G06F40/295 ,  H04L51/02 ,  G06N3/08 ,  G06N20/00

CPC classification number: G06F40/35 ,  G06F40/117 ,  G06F40/295 ,  G06N3/08 ,  G06N20/00 ,  H04L51/02

Abstract: Methods, systems, apparatuses, and computer program products are provided for extracting an entity value from a sentence. An embedding set that may include one or more sentence embeddings is generated for at least part of a first sentence that is tagged to associate a first named entity in the sentence with an entity type. A plurality of candidate embeddings is also generated for at least part of a second sentence. The one or more sentence embeddings in the embedding set may be compared with each of the plurality of candidate embeddings, and a match score may be assigned to each comparison to generate a match score set. A particular match score of the match score set may be identified that exceeds a similarity threshold, and an entity value of the entity type may be extracted from the second sentence associated with the identified match score.

公开(公告)号：US11580425B2

公开(公告)日：2023-02-14

申请号：US16917769

申请日：2020-06-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Shoou-Jiun Wang ,  Xing Zhang ,  Eslam K. Abdelreheem

IPC: G06F21/00 ,  G06N5/04 ,  G06N20/00

Abstract: The disclosure herein describes managing defects in a model training pipeline. A synthetic data set is generated that is associated with a defect type and a lifecycle stage of the model training pipeline, and baseline performance metrics associated with the defect type are generated. Based on a code change to the pipeline, a test model is trained using the pipeline and the synthetic data set, and test performance metrics are collected based on the test model and associated with the defect type. Based on comparing the baseline performance metrics and the test performance metrics, a defect of a particular defect type is identified in the pipeline. An indicator of the defect is provided that includes the defect type and the lifecycle stage with which the synthetic data set is associated, whereby a defect correction process is enabled to remedy the defect based on the associated defect type and the lifecycle stage.

公开(公告)号：US20210056169A1

公开(公告)日：2021-02-25

申请号：US16543794

申请日：2019-08-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Vikas Bahirwani ,  Jade Huang ,  Matthew Brigham Hall ,  Yu Zhao ,  Pengcheng He ,  Weizhu Chen ,  Eslam K. Abdelreheem ,  Jiayuan Huang ,  Yuting Sun

IPC: G06F17/27 ,  G06F17/21 ,  H04L12/58

Abstract: Methods, systems, apparatuses, and computer program products are provided for extracting an entity value from a sentence. An embedding set that may include one or more sentence embeddings is generated for at least part of a first sentence that is tagged to associate a first named entity in the sentence with an entity type. A plurality of candidate embeddings is also generated for at least part of a second sentence. The one or more sentence embeddings in the embedding set may be compared with each of the plurality of candidate embeddings, and a match score may be assigned to each comparison to generate a match score set. A particular match score of the match score set may be identified that exceeds a similarity threshold, and an entity value of the entity type may be extracted from the second sentence associated with the identified match score.