Analysis and validation of language models

    公开(公告)号:US11829720B2

    公开(公告)日:2023-11-28

    申请号:US17108933

    申请日:2020-12-01

    Applicant: Apple Inc.

    CPC classification number: G06F40/284 G06F40/40 G06N20/00

    Abstract: Systems and methods for analysis and validation of language models trained using data that is unavailable or inaccessible are provided. One example method includes, at an electronic device with one or more processors and memory, obtaining a first set of data corresponding to one or more tokens predicted based on one or more previous tokens. The method determines a probability that the first set of data corresponds to a prediction generated by a first language model trained using a user privacy preserving training process. In accordance with a determination that the probability is within a predetermined range, the method determines that the one or more tokens correspond to a prediction associated with the user privacy preserving training process and outputs a predicted token sequence including the one or more tokens and the one or more previous tokens.

    Predictive conversion of language input

    公开(公告)号:US09842101B2

    公开(公告)日:2017-12-12

    申请号:US14839830

    申请日:2015-08-28

    Applicant: Apple Inc.

    Abstract: Systems and processes for predictive conversion of language input are provided. In one example process, text composed by a user can be obtained. Input comprising a sequence of symbols of a first symbolic system can be received from the user. Candidate word strings corresponding to the sequence of symbols can be determined. Each candidate word string can comprise two or more words of a second symbolic system. The candidate word strings can be ranked based on a probability of occurrence of each candidate word string in the obtained text. Based on the ranking, a portion of the candidate word strings can be displayed for selection by the user.

Patent Agency Ranking