-
公开(公告)号:US11956623B2
公开(公告)日:2024-04-09
申请号:US17360823
申请日:2021-06-28
Applicant: Apple Inc.
Inventor: Christopher T. Eubank , Joshua D. Atkins , Soenke Pelzer , Dirk Schroeder
IPC: H04S7/00
CPC classification number: H04S7/305 , H04S2420/01
Abstract: Processing sound in an enhanced reality environment can include generating, based on an image of a physical environment, an acoustic model of the physical environment. Audio signals captured by a microphone array, can capture a sound in the physical environment. Based on these audio signals, one or more measured acoustic parameters of the physical environment can be generated. A target audio signal can be processed using the model of the physical environment and the measured acoustic parameters, resulting in a plurality of output audio channels having a virtual sound source with a virtual location. The output audio channels can be used to drive a plurality of speakers. Other aspects are also described and claimed.
-
公开(公告)号:US11930337B2
公开(公告)日:2024-03-12
申请号:US17360825
申请日:2021-06-28
Applicant: Apple Inc.
Inventor: Tomlinson Holman , Christopher T. Eubank , Joshua D. Atkins , Soenke Pelzer , Dirk Schroeder
IPC: G10L19/16 , G10L21/0208 , G10L21/0216 , H04R3/00 , H04R3/04 , H04R5/027 , H04R5/033 , H04R5/04
CPC classification number: H04R5/027 , G10L19/167 , G10L21/0216 , H04R3/005 , H04R3/04 , H04R5/033 , H04R5/04 , G10L2021/02082 , G10L2021/02166 , H04R2420/07
Abstract: An audio device can sense sound in a physical environment using a plurality of microphones to generate a plurality of microphone signals. Clean speech can be extracted from microphone signals. Ambience can be extracted from the microphone signals. The clean speech can be encoded at a first compression level. The ambience can be encoded at a second compression level that is higher than the first compression level. Other aspects are also described and claimed.
-
公开(公告)号:US11849291B2
公开(公告)日:2023-12-19
申请号:US17322539
申请日:2021-05-17
Applicant: Apple Inc.
Inventor: Mehrez Souden , Jason Wung , Ante Jukic , Ramin Pishehvar , Joshua D. Atkins
IPC: H04R3/04 , H04R3/00 , H04R5/04 , G10L25/78 , G10L21/0216 , G10L21/0208 , H04M9/08
CPC classification number: H04R3/04 , G10L21/0216 , G10L25/78 , H04R3/005 , H04R5/04 , G10L2021/02082 , G10L2021/02166 , H04M9/082
Abstract: A plurality of microphone signals can be captured with a plurality of microphones of the device. One or more echo dominant audio signals can be determined based on a pick-up beam directed towards one or more speakers of a playback device. Sound that is emitted from the one or more speakers and sensed by the plurality of microphones can be removed from plurality of microphone signals, by using the one or more echo dominant audio signals as a reference, resulting in clean audio.
-
公开(公告)号:US11532306B2
公开(公告)日:2022-12-20
申请号:US17111132
申请日:2020-12-03
Applicant: Apple Inc.
Inventor: Yoon Kim , John Bridle , Joshua D. Atkins , Feipeng Li , Mehrez Souden
IPC: G10L15/22 , H04R1/40 , G10L15/08 , G10L15/04 , H04R3/00 , G10L15/30 , G10L15/18 , G10L15/28 , G10L21/0216 , G10L25/51 , H04R27/00
Abstract: Systems and processes for operating an intelligent automated assistant are provided. In accordance with one example, a method includes, at an electronic device with one or more processors, memory, and a plurality of microphones, sampling, at each of the plurality of microphones of the electronic device, an audio signal to obtain a plurality of audio signals; processing the plurality of audio signals to obtain a plurality of audio streams; and determining, based on the plurality of audio streams, whether any of the plurality of audio signals corresponds to a spoken trigger. The method further includes, in accordance with a determination that the plurality of audio signals corresponds to the spoken trigger, initiating a session of the digital assistant; and in accordance with a determination that the plurality of audio signals does not correspond to the spoken trigger, foregoing initiating a session of the digital assistant.
-
公开(公告)号:US11503409B1
公开(公告)日:2022-11-15
申请号:US17200337
申请日:2021-03-12
Applicant: Apple Inc.
Inventor: Ismael H. Nawfal , Joshua D. Atkins , Stephen J. Nimick , Guy C. Nicholson , Jason M. Harlow
Abstract: Digital audio signal processing techniques used to provide an acoustic transparency function in a pair of headphones. A number of transparency filters can be computed at once, using optimization techniques or using a closed form solution, that are based on multiple re-seatings of the headphones and that are as a result robust for a population of wearers. In another embodiment, a transparency hearing filter of a headphone is computed by an adaptive system that takes into consideration the changing acoustic to electrical path between an earpiece speaker and an interior microphone of that headphone while worn by a user. Other embodiments are also described and claimed.
-
36.
公开(公告)号:US11341988B1
公开(公告)日:2022-05-24
申请号:US16578802
申请日:2019-09-23
Applicant: Apple Inc.
Inventor: Ramin Pishehvar , Feiping Li , Ante Jukic , Mehrez Souden , Joshua D. Atkins
Abstract: A hybrid machine learning-based and DSP statistical post-processing technique is disclosed for voice activity detection. The hybrid technique may use a DNN model with a small context window to estimate the probability of speech by frames. The DSP statistical post-processing stage operates on the frame-based speech probabilities from the DNN model to smooth the probabilities and to reduce transitions between speech and non-speech states. The hybrid technique may estimate the soft decision on detected speech in each frame based on the smoothed probabilities, generate a hard decision using a threshold, detect a complete utterance that may include brief pauses, and estimate the end point of the utterance. The hybrid voice activity detection technique may incorporate a target directional probability estimator to estimate the direction of the speech source. The DSP statistical post-processing module may use the direction of the speech source to inform the estimates of the voice activity.
-
公开(公告)号:US10951990B2
公开(公告)日:2021-03-16
申请号:US16029314
申请日:2018-07-06
Applicant: Apple Inc.
Inventor: Ismael H. Nawfal , Joshua D. Atkins , Stephen J. Nimick , Guy C. Nicholson , Jason M. Harlow
Abstract: Digital audio signal processing techniques used to provide an acoustic transparency function in a pair of headphones. A number of transparency filters can be computed at once, using optimization techniques or using a closed form solution, that are based on multiple re-seatings of the headphones and that are as a result robust for a population of wearers. In another embodiment, a transparency hearing filter of a headphone is computed by an adaptive system that takes into consideration the changing acoustic to electrical path between an earpiece speaker and an interior microphone of that headphone while worn by a user. Other embodiments are also described and claimed.
-
公开(公告)号:US20210020189A1
公开(公告)日:2021-01-21
申请号:US16516780
申请日:2019-07-19
Applicant: Apple Inc.
Inventor: Ante Jukic , Mehrez Souden , Joshua D. Atkins
Abstract: A learning based system such as a deep neural network (DNN) is disclosed to estimate a distance from a device to a speech source. The deep learning system may estimate the distance of the speech source at each time frame based on speech signals received by a compact microphone array. Supervised deep learning may be used to learn the effect of the acoustic environment on the non-linear mapping between the speech signals and the distance using multi-channel training data. The deep learning system may estimate the direct speech component that contains information about the direct signal propagation from the speech source to the microphone array and the reverberant speech signal that contains the reverberation effect and noise. The deep learning system may extract signal characteristics of the direct signal component and the reverberant signal component and estimate the distance based on the extracted signal characteristics using the learned mapping.
-
公开(公告)号:US10482899B2
公开(公告)日:2019-11-19
申请号:US15225707
申请日:2016-08-01
Applicant: Apple Inc.
Inventor: Sean A. Ramprashad , Esge B. Andersen , Joshua D. Atkins , Sorin V. Dusan , Vasu Iyengar , Tarun Pruthi , Lalin S. Theverapperuma
IPC: G10L21/028 , G10L25/21 , G10L21/0216
Abstract: An audio system has a housing in which are integrated a number of microphones. A programmed processor accesses the microphone signals and produces a number of acoustic pick up beams based groups of microphones, an estimation of voice activity and an estimation of noise characteristics on each beam. Two or more beams including a voice beam that is used to pick up a desired voice and a noise beam that is used to provide information to estimate ambient noise are adaptively selected from among the plurality of beams, based on thresholds for voice separation and thresholds for noise-matching. Other embodiments are also described and claimed.
-
公开(公告)号:US20190007780A1
公开(公告)日:2019-01-03
申请号:US15639191
申请日:2017-06-30
Applicant: Apple Inc.
Inventor: Jonathan D. Sheaffer , Joshua D. Atkins , Martin E. Johnson , Stuart J. Wood
IPC: H04S7/00 , G10L19/008 , G06T7/20
Abstract: Image analysis of a video signal is performed to produce first metadata, and audio analysis of a multi-channel sound track associated with the video signal is performed to produce second metadata. A number of time segments of the sound track are processed, wherein each time segment is processed by either (i) spatial filtering of the audio signals or (ii) spatial rendering of the audio signals, not both, wherein for each time segment a decision was made to select between the spatial filtering or the spatial rendering, in accordance with the first and second metadata. A mix of the processed sound track and the video signal is generated. Other embodiments are also described and claimed.
-
-
-
-
-
-
-
-
-