公开(公告)号：US20200301925A1

公开(公告)日：2020-09-24

申请号：US16894495

申请日：2020-06-05

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming Xiong ,  Richard Socher

IPC: G06F16/2452 ,  G06N3/08 ,  G06N7/00 ,  G06N3/04 ,  G06N3/00

Abstract: A computing system uses neural networks to translate natural language queries to database queries. The computing system uses a plurality of machine learning based models, each machine learning model for generating a portion of the database query. The machine learning models use an input representation generated based on terms of the input natural language query, a set of columns of the database schema, and the vocabulary of a database query language, for example, structured query language SQL. The plurality of machine learning based models may include an aggregation classifier model for determining an aggregation operator in the database query, a result column predictor model for determining the result columns of the database query, and a condition clause predictor model for determining the condition clause of the database query. The condition clause predictor is based on reinforcement learning.

公开(公告)号：US11836451B2

公开(公告)日：2023-12-05

申请号：US17179933

申请日：2021-02-19

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming Xiong

IPC: G06F40/30 ,  G06N3/08 ,  G06N5/022 ,  G06N3/084 ,  G06N3/044 ,  G06N3/045

CPC classification number: G06F40/30 ,  G06N3/044 ,  G06N3/045 ,  G06N3/08 ,  G06N3/084 ,  G06N5/022

Abstract: A method for maintaining a dialogue state associated with a dialogue between a user and a digital system includes receiving, by a dialogue state tracker associated with the digital system, a representation of a user communication, updating, by the dialogue state tracker, the dialogue state and providing a system response based on the updated dialogue state. The dialogue state is updated by evaluating, based on the representation of the user communication, a plurality of member scores corresponding to a plurality of ontology members of an ontology set, and selecting, based on the plurality of member scores, zero or more of the plurality of ontology members to add to or remove from the dialogue state. The dialogue state tracker includes a global-local encoder that includes a global branch and a local branch, the global branch having global trained parameters that are shared among the plurality of ontology members and the local branch having local trained parameters that are determined separately for each of the plurality of ontology members.

公开(公告)号：US11170287B2

公开(公告)日：2021-11-09

申请号：US15881582

申请日：2018-01-26

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming Xiong ,  Richard Socher

IPC: G06N3/04 ,  G06N3/08 ,  G06N5/04 ,  G06F16/93 ,  G06F16/2458 ,  G06N3/00

Abstract: A computer-implemented method for dual sequence inference using a neural network model includes generating a codependent representation based on a first input representation of a first sequence and a second input representation of a second sequence using an encoder of the neural network model and generating an inference based on the codependent representation using a decoder of the neural network model. The neural network model includes a plurality of model parameters learned according to a machine learning process. The encoder includes a plurality of coattention layers arranged sequentially, each coattention layer being configured to receive a pair of layer input representations and generate one or more summary representations, and an output layer configured to receive the one or more summary representations from a last layer among the plurality of coattention layers and generate the codependent representation.

公开(公告)号：US20210174028A1

公开(公告)日：2021-06-10

申请号：US17179933

申请日：2021-02-19

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming Xiong

IPC: G06F40/30 ,  G06N3/08 ,  G06N5/02 ,  G06N3/04

Abstract: A method for maintaining a dialogue state associated with a dialogue between a user and a digital system includes receiving, by a dialogue state tracker associated with the digital system, a representation of a user communication, updating, by the dialogue state tracker, the dialogue state and providing a system response based on the updated dialogue state. The dialogue state is updated by evaluating, based on the representation of the user communication, a plurality of member scores corresponding to a plurality of ontology members of an ontology set, and selecting, based on the plurality of member scores, zero or more of the plurality of ontology members to add to or remove from the dialogue state. The dialogue state tracker includes a global-local encoder that includes a global branch and a local branch, the global branch having global trained parameters that are shared among the plurality of ontology members and the local branch having local trained parameters that are determined separately for each of the plurality of ontology members.

公开(公告)号：US10963782B2

公开(公告)日：2021-03-30

申请号：US15421193

申请日：2017-01-31

Applicant: salesforce.com, inc.

Inventor： Caiming Xiong ,  Victor Zhong ,  Richard Socher

IPC: G06N3/08 ,  G06N5/04 ,  G06N3/04 ,  G06N5/02

Abstract: The technology disclosed relates to an end-to-end neural network for question answering, referred to herein as “dynamic coattention network (DCN)”. Roughly described, the DCN includes an encoder neural network and a coattentive encoder that capture the interactions between a question and a document in a so-called “coattention encoding”. The DCN also includes a decoder neural network and highway maxout networks that process the coattention encoding to estimate start and end positions of a phrase in the document that responds to the question.

公开(公告)号：US11526507B2

公开(公告)日：2022-12-13

申请号：US16894495

申请日：2020-06-05

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming Xiong ,  Richard Socher

IPC: G06F16/2452 ,  G06N3/04 ,  G06N3/08 ,  G06N7/00

Abstract: A computing system uses neural networks to translate natural language queries to database queries. The computing system uses a plurality of machine learning based models, each machine learning model for generating a portion of the database query. The machine learning models use an input representation generated based on terms of the input natural language query, a set of columns of the database schema, and the vocabulary of a database query language, for example, structured query language SQL. The plurality of machine learning based models may include an aggregation classifier model for determining an aggregation operator in the database query, a result column predictor model for determining the result columns of the database query, and a condition clause predictor model for determining the condition clause of the database query. The condition clause predictor is based on reinforcement learning.

公开(公告)号：US20190258714A1

公开(公告)日：2019-08-22

申请号：US15978445

申请日：2018-05-14

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming Xiong

IPC: G06F17/27 ,  G06N3/08

Abstract: A method for maintaining a dialogue state associated with a dialogue between a user and a digital system includes receiving, by a dialogue state tracker associated with the digital system, a representation of a user communication, updating, by the dialogue state tracker, the dialogue state and providing a system response based on the updated dialogue state. The dialogue state is updated by evaluating, based on the representation of the user communication, a plurality of member scores corresponding to a plurality of ontology members of an ontology set, and selecting, based on the plurality of member scores, zero or more of the plurality of ontology members to add to or remove from the dialogue state. The dialogue state tracker includes a global-local encoder that includes a global branch and a local branch, the global branch having global trained parameters that are shared among the plurality of ontology members and the local branch having local trained parameters that are determined separately for each of the plurality of ontology members.

公开(公告)号：US20190130248A1

公开(公告)日：2019-05-02

申请号：US15881582

申请日：2018-01-26

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming XIONG ,  Richard SOCHER

IPC: G06N3/04 ,  G06N3/00 ,  G06F17/30

Abstract: A computer-implemented method for dual sequence inference using a neural network model includes generating a codependent representation based on a first input representation of a first sequence and a second input representation of a second sequence using an encoder of the neural network model and generating an inference based on the codependent representation using a decoder of the neural network model. The neural network model includes a plurality of model parameters learned according to a machine learning process. The encoder includes a plurality of coattention layers arranged sequentially, each coattention layer being configured to receive a pair of layer input representations and generate one or more summary representations, and an output layer configured to receive the one or more summary representations from a last layer among the plurality of coattention layers and generate the codependent representation.

公开(公告)号：US11227218B2

公开(公告)日：2022-01-18

申请号：US15980207

申请日：2018-05-15

Applicant: salesforce.com, inc.

Inventor： Sewon Min ,  Victor Zhong ,  Caiming Xiong ,  Richard Socher

IPC: G06F40/30 ,  G06N20/00 ,  G06N3/08 ,  G06N5/04 ,  G06N3/04 ,  G06F40/20

Abstract: A natural language processing system that includes a sentence selector and a question answering module. The sentence selector receives a question and sentences that are associated with a context. For a question and each sentence, the sentence selector determines a score. A score represents whether the question is answerable with the sentence. Sentence selector then generates a minimum set of sentences from the scores associated with the question and sentences. The question answering module generates an answer for the question from the minimum set of sentences.

公开(公告)号：US10929607B2

公开(公告)日：2021-02-23

申请号：US15978445

申请日：2018-05-14

Applicant: salesforce.com, inc.

Inventor： Victor Zhong ,  Caiming Xiong

IPC: G06F40/30 ,  G06N3/04 ,  G06N3/08 ,  G06N5/02

Abstract: A method for maintaining a dialogue state associated with a dialogue between a user and a digital system includes receiving, by a dialogue state tracker associated with the digital system, a representation of a user communication, updating, by the dialogue state tracker, the dialogue state and providing a system response based on the updated dialogue state. The dialogue state is updated by evaluating, based on the representation of the user communication, a plurality of member scores corresponding to a plurality of ontology members of an ontology set, and selecting, based on the plurality of member scores, zero or more of the plurality of ontology members to add to or remove from the dialogue state. The dialogue state tracker includes a global-local encoder that includes a global branch and a local branch, the global branch having global trained parameters that are shared among the plurality of ontology members and the local branch having local trained parameters that are determined separately for each of the plurality of ontology members.