MULTI-MODAL LANGUAGE INTERPRETATION USING UNIFIED INPUT MODEL

    公开(公告)号:US20220391585A1

    公开(公告)日:2022-12-08

    申请号:US17411790

    申请日:2021-08-25

    Applicant: Apple Inc.

    Abstract: Systems and processes for multi-modal input interpretation are provided. For example, an input associated with a touch is received from a user. A first reconstruction based on the input is determined. A first simulated input is obtained based on a modification of the input. A second reconstruction is determined based on the first reconstruction and the first simulated input. Based on at least the first reconstruction and the second reconstruction, a probability representation is obtained. An output is determined, by a language model, based on the probability representation. The output is then provided to the user.

Patent Agency Ranking