公开(公告)号：US20210224474A1

公开(公告)日：2021-07-22

申请号：US16746009

申请日：2020-01-17

Applicant: Apple Inc.

Inventor： Jerome R. BELLEGARDA ,  Bishal BARMAN ,  Douglas DAVIDSON

IPC: G06F40/253 ,  G06F40/30 ,  G06N3/04

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In one example process a set of words including a grammatical error is received. The process can generate, using a neural network based on the set of words including the grammatical error and a reference set of words, a transformed set of words and further determine, based on the set of words including the grammatical error and the reference set of words, a reconstructed reference set of words. The process can also determine, based on a comparison of the transformed set of words and the reconstructed reference set of words, whether the transformed set of words is grammatically correct and provide an indication of whether the transformed set of words is grammatically correct to the neural network.

公开(公告)号：US20220067283A1

公开(公告)日：2022-03-03

申请号：US17108933

申请日：2020-12-01

Applicant: Apple Inc.

Inventor： Jerome R. BELLEGARDA ,  Bishal BARMAN ,  Brent D. RAMERTH

IPC: G06F40/284 ,  G06F40/40 ,  G06N20/00

Abstract: Systems and methods for analysis and validation of language models trained using data that is unavailable or inaccessible are provided. One example method includes, at an electronic device with one or more processors and memory, obtaining a first set of data corresponding to one or more tokens predicted based on one or more previous tokens. The method determines a probability that the first set of data corresponds to a prediction generated by a first language model trained using a user privacy preserving training process. In accordance with a determination that the probability is within a predetermined range, the method determines that the one or more tokens correspond to a prediction associated with the user privacy preserving training process and outputs a predicted token sequence including the one or more tokens and the one or more previous tokens.

公开(公告)号：US20230376690A1

公开(公告)日：2023-11-23

申请号：US17891088

申请日：2022-08-18

Applicant: Apple Inc.

Inventor： Jerome R. BELLEGARDA ,  Bishal BARMAN ,  Hala ALMAGHOUT

IPC: G06F40/289 ,  G06N3/04

CPC classification number: G06F40/289 ,  G06N3/0454

Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes, receiving a text and a set of contextual information associated with the text; determining, using a system of neural networks, a plurality of text predictions based on the text and the contextual information, wherein a first text prediction of the plurality of text predictions includes a word and a second text prediction of the plurality of text predictions includes a phrase and wherein the system of neural networks includes a first neural network for extracting a context, a second neural network for determining text predictions, and a third neural network for determining whether the text predictions are relevant to the context; and in accordance with a determination that a plurality of confidence scores associated with the plurality of text predictions exceed a predetermined threshold, providing the plurality of text predictions.

公开(公告)号：US20180336184A1

公开(公告)日：2018-11-22

申请号：US15678618

申请日：2017-08-16

Applicant: Apple Inc.

Inventor： Jerome R. BELLEGARDA ,  Bishal BARMAN

IPC: G06F17/27 ,  G06F3/0481

CPC classification number: G06F17/2785 ,  G06F3/04817

Abstract: The present disclosure generally relates to systems and processes for emoji word sense disambiguation. In one example process, a word sequence is received. A word-level feature representation is determined for each word of the word sequence and a global semantic representation for the word sequence is determined. For a first word of the word sequence, an attention coefficient is determined based on a congruence between the word-level feature representation of the first word and the global semantic representation for the word sequence. The word-level feature representation of the first word is adjusted based on the attention coefficient. An emoji likelihood is determined based on the adjusted word-level feature representation of the first word. In accordance with the emoji likelihood satisfying one or more criteria, an emoji character corresponding to the first word is presented for display.

公开(公告)号：US20160357728A1

公开(公告)日：2016-12-08

申请号：US14845180

申请日：2015-09-03

Applicant: Apple Inc.

Inventor： Jerome R. BELLEGARDA ,  Bishal BARMAN

IPC: G06F17/27

CPC classification number: G06F17/275 ,  G06F17/2785 ,  G06F17/289 ,  G10L15/26

Abstract: Systems and processes for language identification from short strings are provided. In accordance with one example, a method includes, at a first electronic device with one or more processors and memory, receiving user input including an n-gram and determining a similarity between a representation of the n-gram and a representation of a first language. The representation of the first language is based on an occurrence of each of a plurality of n-grams in the first language and an occurrence of each of the plurality of n-grams in a second language. The method further includes determining whether the similarity between the representation of the n-gram and the representation of the first language satisfies a threshold.

Abstract translation: 提供了用于短串语言识别的系统和过程。 根据一个示例，一种方法包括在具有一个或多个处理器和存储器的第一电子设备处接收包括n-gram的用户输入并且确定n-gram的表示和第一语言的表示之间的相似性 。 第一语言的表示基于第一语言中的多个n-gram中的每一个的出现以及以第二语言出现的多个n-gram中的每一个。 该方法还包括确定n-gram的表示与第一语言的表示之间的相似性是否满足阈值。