公开(公告)号：US20240153495A1

公开(公告)日：2024-05-09

申请号：US18494984

申请日：2023-10-26

Applicant: Google LLC

Inventor： Weiran Wang ,  Ding Zhao ,  Shaojin Ding ,  Hao Zhang ,  Shuo-yiin Chang ,  David Johannes Rybach ,  Tara N. Sainath ,  Yanzhang He ,  Ian McGraw ,  Shankar Kumar

IPC: G10L15/06 ,  G06F40/284 ,  G10L15/26

CPC classification number: G10L15/063 ,  G06F40/284 ,  G10L15/26

Abstract: A method includes receiving a training dataset that includes one or more spoken training utterances for training an automatic speech recognition (ASR) model. Each spoken training utterance in the training dataset paired with a corresponding transcription and a corresponding target sequence of auxiliary tokens. For each spoken training utterance, the method includes generating a speech recognition hypothesis for a corresponding spoken training utterance, determining a speech recognition loss based on the speech recognition hypothesis and the corresponding transcription, generating a predicted auxiliary token for the corresponding spoken training utterance, and determining an auxiliary task loss based on the predicted auxiliary token and the corresponding target sequence of auxiliary tokens. The method also includes the ASR model jointly on the speech recognition loss and the auxiliary task loss determined for each spoken training utterance.