公开(公告)号：US20200035231A1

公开(公告)日：2020-01-30

申请号：US16437763

申请日：2019-06-11

Applicant: Amazon Technologies, Inc.

Inventor： Sree Hari Krishnan Parthasarathi ,  Bjorn Hoffmeister ,  Brian King ,  Roland Maas

IPC: G10L15/20 ,  G10L15/02 ,  G10L17/06 ,  G10L25/87 ,  G10L15/08 ,  G10L15/16 ,  G10L17/18

Abstract: A system configured to process speech commands may classify incoming audio as desired speech, undesired speech, or non-speech. Desired speech is speech that is from a same speaker as reference speech. The reference speech may be obtained from a configuration session or from a first portion of input speech that includes a wakeword. The reference speech may be encoded using a recurrent neural network (RNN) encoder to create a reference feature vector. The reference feature vector and incoming audio data may be processed by a trained neural network classifier to label the incoming audio data (for example, frame-by-frame) as to whether each frame is spoken by the same speaker as the reference speech. The labels may be passed to an automatic speech recognition (ASR) component which may allow the ASR component to focus its processing on the desired speech.

公开(公告)号：US10373612B2

公开(公告)日：2019-08-06

申请号：US15196228

申请日：2016-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Sree Hari Krishnan Parthasarathi ,  Bjorn Hoffmeister ,  Brian King ,  Roland Maas

IPC: G10L15/02 ,  G10L15/08 ,  G10L15/16 ,  G10L15/20 ,  G10L17/02 ,  G10L17/06 ,  G10L17/18 ,  G10L25/78 ,  G10L25/87

Abstract: A system configured to process speech commands may classify incoming audio as desired speech, undesired speech, or non-speech. Desired speech is speech that is from a same speaker as reference speech. The reference speech may be obtained from a configuration session or from a first portion of input speech that includes a wakeword. The reference speech may be encoded using a recurrent neural network (RNN) encoder to create a reference feature vector. The reference feature vector and incoming audio data may be processed by a trained neural network classifier to label the incoming audio data (for example, frame-by-frame) as to whether each frame is spoken by the same speaker as the reference speech. The labels may be passed to an automatic speech recognition (ASR) component which may allow the ASR component to focus its processing on the desired speech.

公开(公告)号：US11915690B1

公开(公告)日：2024-02-27

申请号：US17488896

申请日：2021-09-29

Applicant: Amazon Technologies, Inc.

Inventor： Feng-Ju Chang ,  Martin Radfar ,  Athanasios Mouchtaris ,  Brian King ,  Siegfried Kunzmann ,  Maurizio Omologo

IPC: G10L15/18 ,  H04R3/00 ,  G10L15/22 ,  G10L19/008 ,  G10L13/027

CPC classification number: G10L15/18 ,  G10L15/22 ,  G10L19/008 ,  H04R3/005 ,  G10L13/027 ,  G10L2015/225

Abstract: A multi-channel transformer acoustic model that processes a plurality of audio signals output by microphones of a microphone array and outputs probabilities for acoustic units of an utterance represented in the audio signals. The audio signals represent the individual microphones' respective capturing of the utterance. The multi-channel model may perform self-attention on embeddings of the audio signals and then cross-channel attention across the attended audio signals. The cross-channel attention may involve processing of signals relative to each other to model the relationships across channels within and across time frames. The multi-channel model may include a transducer to perform processing frame-by-frame.

公开(公告)号：US11514901B2

公开(公告)日：2022-11-29

申请号：US16437763

申请日：2019-06-11

Applicant: Amazon Technologies, Inc.

Inventor： Sree Hari Krishnan Parthasarathi ,  Bjorn Hoffmeister ,  Brian King ,  Roland Maas

IPC: G10L15/20 ,  G10L15/02 ,  G10L17/06 ,  G10L25/87 ,  G10L15/08 ,  G10L15/16 ,  G10L17/18 ,  G10L25/78 ,  G10L17/02

Abstract: A system configured to process speech commands may classify incoming audio as desired speech, undesired speech, or non-speech. Desired speech is speech that is from a same speaker as reference speech. The reference speech may be obtained from a configuration session or from a first portion of input speech that includes a wakeword. The reference speech may be encoded using a recurrent neural network (RNN) encoder to create a reference feature vector. The reference feature vector and incoming audio data may be processed by a trained neural network classifier to label the incoming audio data (for example, frame-by-frame) as to whether each frame is spoken by the same speaker as the reference speech. The labels may be passed to an automatic speech recognition (ASR) component which may allow the ASR component to focus its processing on the desired speech.

公开(公告)号：US20170270919A1

公开(公告)日：2017-09-21

申请号：US15196228

申请日：2016-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Sree Hari Krishnan Parthasarathi ,  Bjorn Hoffmeister ,  Brian King ,  Roland Maas

IPC: G10L15/20 ,  G10L15/16 ,  G10L25/87 ,  G10L15/08 ,  G10L15/02 ,  G10L17/06

CPC classification number: G10L15/20 ,  G10L15/02 ,  G10L15/08 ,  G10L15/16 ,  G10L17/02 ,  G10L17/06 ,  G10L17/18 ,  G10L25/87 ,  G10L2015/088 ,  G10L2025/783

Abstract: A system configured to process speech commands may classify incoming audio as desired speech, undesired speech, or non-speech. Desired speech is speech that is from a same speaker as reference speech. The reference speech may be obtained from a configuration session or from a first portion of input speech that includes a wakeword. The reference speech may be encoded using a recurrent neural network (RNN) encoder to create a reference feature vector. The reference feature vector and incoming audio data may be processed by a trained neural network classifier to label the incoming audio data (for example, frame-by-frame) as to whether each frame is spoken by the same speaker as the reference speech. The labels may be passed to an automatic speech recognition (ASR) component which may allow the ASR component to focus its processing on the desired speech.