公开(公告)号：US20220270629A1

公开(公告)日：2022-08-25

申请号：US17589889

申请日：2022-01-31

Applicant: Apple Inc.

Inventor： Carlos M. AVENDANO ,  John WOODRUFF ,  Jonathan HUANG ,  Mehrez SOUDEN ,  Andreas KOUTROUVELIS

IPC: G10L21/028 ,  H04R1/10 ,  G10L21/0232 ,  G06N20/00

Abstract: Implementations of the subject technology provide systems and methods for providing audio source separation for audio input, such as for audio devices having limited power and/or computing resources. The subject technology may allow an audio device to leverage processing and/or power resources of a companion device that is communicatively coupled to the audio device. The companion device may identify a noise condition of the audio device, select a source separation model based on the noise condition, and provide the source separation model to the audio device. In this way, the audio device can provide audio source separation functionality using a relatively small footprint source separation model that is specific to the noise condition in which the audio device is operated.

公开(公告)号：US20230360641A1

公开(公告)日：2023-11-09

申请号：US17736959

申请日：2022-05-04

Applicant: Apple Inc.

Inventor： Daniel C. KLINGLER ,  Carlos M. AVENDANO ,  Jonathan HUANG ,  Miquel ESPI MARQUES

IPC: G10L15/08 ,  G10L25/78 ,  G10L25/51 ,  G06N20/20

CPC classification number: G10L15/08 ,  G10L25/78 ,  G10L25/51 ,  G06N20/20

Abstract: The subject disclosure provides systems and methods for generating and storing learned embeddings of audio inputs to an electronic device. The electronic device may generate and store encoded versions of audio inputs and learned embeddings of the audio inputs. When a new audio input is obtained, the electronic device can generate an encoded version of the new audio input, compare the encoded version of the new audio input to the stored encoded versions of prior audio inputs, and if the encoded version of the new audio input matches one of the stored encoded versions of the prior audio inputs, the electronic device can provide a stored learned embedding that corresponds to the one of the stored encoded versions of the prior audio inputs to a detection model at the electronic device. The cached embeddings can be provided to locally trained models for detecting individual sounds using electronic devices.

公开(公告)号：US20240029754A1

公开(公告)日：2024-01-25

申请号：US18376438

申请日：2023-10-03

Applicant: Apple Inc.

Inventor： Carlos M. AVENDANO ,  John WOODRUFF ,  Jonathan HUANG ,  Mehrez SOUDEN ,  Andreas KOUTROUVELIS

IPC: G10L21/028 ,  H04R1/10 ,  G06N20/00 ,  G10L21/0232

CPC classification number: G10L21/028 ,  H04R1/1016 ,  H04R1/1041 ,  H04R1/1083 ,  G06N20/00 ,  G10L21/0232 ,  H04R2420/07

Abstract: Implementations of the subject technology provide systems and methods for providing audio source separation for audio input, such as for audio devices having limited power and/or computing resources. The subject technology may allow an audio device to leverage processing and/or power resources of a companion device that is communicatively coupled to the audio device. The companion device may identify a noise condition of the audio device, select a source separation model based on the noise condition, and provide the source separation model to the audio device. In this way, the audio device can provide audio source separation functionality using a relatively small footprint source separation model that is specific to the noise condition in which the audio device is operated.

公开(公告)号：US20230177942A1

公开(公告)日：2023-06-08

申请号：US18103486

申请日：2023-01-30

Applicant: Apple Inc.

Inventor： Hyung-Suk KIM ,  Daniel C. KLINGLER ,  Miquel ESPI MARQUES ,  Carlos M. AVENDANO

IPC: G08B21/18 ,  G01H3/00 ,  G08B7/06 ,  G10L25/51 ,  G06N20/00

CPC classification number: G08B21/182 ,  G01H3/005 ,  G08B7/06 ,  G10L25/51 ,  G06N20/00

Abstract: An electronic device includes a processor, and a memory containing instructions that, when executed by the processor, cause the electronic device to learn a sound emitted by a legacy device and to issue an output when the electronic device subsequently hears the sound. For example, the electronic device can receive a training input and extract a compact representation of a sound in the training input, which the device stores. The device can receive an audio signal corresponding to an observed acoustic scene and extract a representation of the observed acoustic scene from the audio signal. The electronic device can determine whether the sound is present in the observed acoustic scene at least in part from a comparison of the representation of the observed acoustic scene with the representation of the sound. The electronic device emits a selected output responsive to determining that the sound is present in the acoustic scene.

公开(公告)号：US20220391758A1

公开(公告)日：2022-12-08

申请号：US17737017

申请日：2022-05-04

Applicant: Apple Inc.

Inventor： Jonathan HUANG ,  Miquel ESPI MARQUES ,  Carlos M. AVENDANO ,  Kevin M. DURAND ,  David FINDLAY ,  Vasudha KOWTHA ,  Daniel C. KLINGLER ,  Yichi ZHANG

IPC: G06N20/00 ,  G06F3/16 ,  H04R1/08 ,  G08B21/18

Abstract: The subject disclosure provides systems and methods for providing locally trained models for detecting individual sounds using electronic devices. Local detection of individual sounds with a detection model at an electronic device can be provided by obtaining training samples for the detection model with the electronic device, and generating additional negative and positive training samples based on the obtained training samples. A two-stage detection process may be provided, in which a trigger model at a device compares an audio input to a reference sound to trigger a detection model at the device. The detection of individual sounds with a detection model at an electronic device can also leverage audio capture capabilities of multiple devices in an acoustic scene to capture multiple concurrent training samples.