公开(公告)号：US11886542B2

公开(公告)日：2024-01-30

申请号：US17325877

申请日：2021-05-20

Applicant: Apple Inc.

Inventor： Jerome R. Bellegarda

IPC: G06F18/214 ,  G06V30/194 ,  G06F18/22 ,  G06N3/045

CPC classification number: G06F18/2148 ,  G06F18/22 ,  G06N3/045 ,  G06V30/194

Abstract: Systems and processes for prediction using generative adversarial network and distillation technology are provided. For example, an input is received at a first portion of a language model. A first output distribution is obtained, based on the input, from the first portion of the language model. Using a first training model, the language model is adjusted based on the first output distribution. The first output distribution is received at a second portion of the language model. A first representation of the input is obtained, based on the first output distribution, from the second portion of the language model. The language model is adjusted, using a second training model, based on the first representation of the input. Using the adjusted language model, an output is provided based on a received user input.

公开(公告)号：US11016658B2

公开(公告)日：2021-05-25

申请号：US16505044

申请日：2019-07-08

Applicant: Apple Inc.

Inventor： Mei-Qun Xia ,  Jannes G. Dolfing ,  Ryan S. Dixon ,  Karl M. Groethe ,  Karan Misra ,  Jerome R. Bellegarda ,  Ueli Meier

IPC: G06F3/0488 ,  G06F3/01 ,  G06F3/0482 ,  G06K9/00 ,  G06F40/166 ,  G06F40/274

Abstract: Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

公开(公告)号：US10984780B2

公开(公告)日：2021-04-20

申请号：US16111055

申请日：2018-08-23

Applicant: Apple Inc.

Inventor： Jerome R. Bellegarda

IPC: G10L15/06 ,  G10L15/18 ,  G06N3/08 ,  G10L15/30 ,  G10L15/16

Abstract: Systems and processes for operating a digital assistant are provided. In accordance with one or more examples, a method includes, receiving training data for a data-driven learning network. The training data include a plurality of word sequences. The method further includes obtaining representations of an initial set of semantic categories associated with the words included in the training data; and training the data-driven learning network based on the plurality of word sequences included in the training data and based on the representations of the initial set of semantic categories. The training is performed using the word sequences in their entirety. The method further includes obtaining, based on the trained data-driven learning network, representations of a set of semantic embeddings of the words included in the training data; and providing the representations of the set of semantic embeddings to at least one of a plurality of different natural language processing tasks.

公开(公告)号：US10657328B2

公开(公告)日：2020-05-19

申请号：US15851487

申请日：2017-12-21

Applicant: Apple Inc.

Inventor： Jerome R. Bellegarda ,  Jannes G. Dolfing

IPC: G06F40/205 ,  G06F40/274 ,  G10L25/30 ,  G06F40/30 ,  G06F40/253 ,  G06F40/268

Abstract: The present disclosure generally relates to systems and processes for morpheme-based word prediction. An example method includes receiving a current word; determining a context of the current word based on the current word and a context of a previous word; determining, using a morpheme-based language model, a likelihood of a prefix based on the context of the current word; determining, using the morpheme-based language model, a likelihood of a stem based on the context of the current word; determining, using the morpheme-based language model, a likelihood of a suffix based on the context of the current word; determining a next word based on the likelihood of the prefix, the likelihood of the stem, and the likelihood of the suffix; and providing an output including the next word.

公开(公告)号：US10282416B2

公开(公告)日：2019-05-07

申请号：US15673587

申请日：2017-08-10

Applicant: Apple Inc.

Inventor： Jerome R. Bellegarda ,  Jannes G. Dolfing ,  Xin Wang

IPC: G06F17/27 ,  G06F17/28 ,  G06F17/22

Abstract: The present disclosure generally relates to integrated text conversion and prediction. In an example process, a current character input of a first writing system is received. A first current character context in the first writing system is determined based on the current character input and a first previous character context in the first writing system. A second current character context in a second writing system is determined based on the first current character context, a second previous character context in the second writing system, and a character representation in the second writing system. A current word context in the second writing system is determined based on the second current character context, a previous word context in the second writing system, and a word representation in the second writing system. Based on the current word context, a probability distribution over a word inventory in the second writing system is determined.

公开(公告)号：US10067938B2

公开(公告)日：2018-09-04

申请号：US15383679

申请日：2016-12-19

Applicant: Apple Inc.

Inventor： Jerome R. Bellegarda ,  Douglas R. Davidson

IPC: G06F17/27 ,  G06F17/28

CPC classification number: G06F17/289 ,  G06F17/275 ,  G06F17/2775 ,  G06F17/279

Abstract: Systems and processes for multilingual word prediction are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving context information associated with a current word; determining, for each of a plurality of languages, a set of monolingual probabilities based on the context information; determining a set of language weights based on the context information; determining a set of multilingual probabilities based on the respective sets of monolingual probabilities and the set of language weights; and providing a plurality of candidate words based on the set of multilingual probabilities.

公开(公告)号：US20180173415A1

公开(公告)日：2018-06-21

申请号：US15898025

申请日：2018-02-15

Applicant: Apple Inc.

Inventor： Mei-Qun Xia ,  Jannes G. Dolfing ,  Ryan S. Dixon ,  Karl M. Groethe ,  Karan Misra ,  Jerome R. Bellegarda ,  Ueli Meier

IPC: G06F3/0488 ,  G06K9/00 ,  G06F3/01 ,  G06F17/24 ,  G06F3/0482 ,  G06F17/27

Abstract: Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

公开(公告)号：US09898187B2

公开(公告)日：2018-02-20

申请号：US14290935

申请日：2014-05-29

Applicant: Apple Inc.

Inventor： Mei-Qun Xia ,  Jannes G. Dolfing ,  Ryan S. Dixon ,  Karl M. Groethe ,  Karan Misra ,  Jerome R. Bellegarda ,  Ueli Meier

IPC: G06F3/0488 ,  G06K9/00 ,  G06F3/01 ,  G06F3/0482 ,  G06F17/24 ,  G06F17/27

CPC classification number: G06F3/04883 ,  G06F3/018 ,  G06F3/0482 ,  G06F17/24 ,  G06F17/276 ,  G06K9/00416 ,  G06K9/00422 ,  G06K9/00436

Abstract: Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

公开(公告)号：US09842105B2

公开(公告)日：2017-12-12

申请号：US14838323

申请日：2015-08-27

Applicant: Apple Inc.

Inventor： Jerome R. Bellegarda

IPC: G10L15/00 ,  G06F17/27 ,  G10L15/183

CPC classification number: G06F17/2785 ,  G06F17/2705 ,  G10L15/183

Abstract: Systems and processes for natural language processing are provided. In accordance with one example, a method includes, at a first electronic device with one or more processors and memory, receiving a plurality of words, mapping each of the plurality of words to a word representation, and associating the mapped words to provide a plurality of phrases. In some examples, each of the plurality of phrases has a representation of a first type. The method further includes encoding each of the plurality of phrases to provide a respective plurality of encoded phrases. In some examples, each of the plurality of encoded phrases has a representation of a second type different than the first type. The method further includes determining a value of each of the plurality of encoded phrases and identifying one or more phrases of the plurality of encoded phrases having a value exceeding a threshold.

公开(公告)号：US09582608B2

公开(公告)日：2017-02-28

申请号：US14298720

申请日：2014-06-06

Applicant: Apple Inc.

Inventor： Jerome R. Bellegarda

IPC: G06F17/21 ,  G06F17/30 ,  G06F17/27

CPC classification number: G06F17/3097 ,  G06F17/2735 ,  G06F17/274 ,  G06F17/276 ,  G06F17/2785 ,  G06F17/2795 ,  G06F17/3053

Abstract: Methods, systems, and computer-readable media related to a technique for combining two or more aspects of predictive information for auto-completion of user input, in particular, user commands directed to an intelligent digital assistant. Specifically, predictive information based on (1) usage frequency, (2) usage recency, and (3) semantic information encapsulated in an ontology (e.g., a network of domains) implemented by the digital assistant, are integrated in a balanced and sensible way within a unified framework, such that a consistent ranking of all completion candidates across all domains may be achieved. Auto-completions are selected and presented based on the unified ranking of all completion candidates.

Abstract translation: 与用于组合用于自动完成用户输入的预测信息的两个或多个方面的技术相关的方法，系统和计算机可读介质，特别是指向智能数字助理的用户命令。 具体而言，以数字助理实现的（1）使用频率，（2）使用新近度和（3）封装在本体（例如，域的网络）中的语义信息的预测信息以平衡和敏感的方式被整合 在统一的框架内，可以实现所有领域的所有完成候选人的一致排名。 基于所有完成候选人的统一排名选择和呈现自动完成。