BILINGUAL MULTITASK MACHINE TRANSLATION MODEL FOR LIVE TRANSLATION ON ARTIFICIAL REALITY DEVICES

    公开(公告)号:US20250103831A1

    公开(公告)日:2025-03-27

    申请号:US18471568

    申请日:2023-09-21

    Abstract: Head-mounted displays may include a machine translation model designed to recognize text through optical character recognition or automatic speech recognition, and may translate the text from its original language to another language. The machine translation model may be trained to modify source text using various tasks, thus allowing the machine translation model to learn different versions of the source text in several different versions. The source text and a variation(s) derived from a task(s) may be mapped to a target text, representing the properly translated and formatted version of the source text. The machine translation model may provide a single model, to facilitate machine translation, implemented on the head-mounted display. Also, the machine translation model may include a bilingual machine translation model that may translate source text from one language to another language, and vice versa.

    Bilingual Models for Live Translation for Assistant Systems

    公开(公告)号:US20250045537A1

    公开(公告)日:2025-02-06

    申请号:US18788782

    申请日:2024-07-30

    Abstract: A method includes receiving, from a client system, one or more utterances comprising one or more first words in a first language and one or more second words in a second language. The method further includes generating, based on a single bilingual automatic-speech-recognition (ASR) model, a transcription of the one or more utterances, such that the transcription comprises one or more first text strings in the first language and one or more second text strings in the second language. The method further includes executing one or more tasks based on the one or more first text strings in the first language and the one or more second text strings in the second language, and sending, to the client system, instructions for presenting a response responsive to the one or more utterances, such that the response is based on both the first and second languages.

Patent Agency Ranking