-
公开(公告)号:US20220059123A1
公开(公告)日:2022-02-24
申请号:US17514694
申请日:2021-10-29
Applicant: Apple Inc.
Inventor: Jonathan D. Sheaffer , Joshua D. Atkins , Mehrez Souden , Symeon Delikaris Manias , Sean A. Ramprashad
IPC: G10L25/78 , G10L21/0272 , G06T7/246 , H04R3/00
Abstract: Processing of ambience and speech can include extracting from audio signals, ambience and speech signals. One or more spatial parameters can be generated that define spatial characteristics of ambience sound in the one or more ambience audio signals. The primary speech signal, the one or more ambience audio signals, and the spatial parameters can be encoded into one or more encoded data streams. Other aspects are described and claimed.
-
公开(公告)号:US11222652B2
公开(公告)日:2022-01-11
申请号:US16516780
申请日:2019-07-19
Applicant: Apple Inc.
Inventor: Ante Jukic , Mehrez Souden , Joshua D. Atkins
Abstract: A learning based system such as a deep neural network (DNN) is disclosed to estimate a distance from a device to a speech source. The deep learning system may estimate the distance of the speech source at each time frame based on speech signals received by a compact microphone array. Supervised deep learning may be used to learn the effect of the acoustic environment on the non-linear mapping between the speech signals and the distance using multi-channel training data. The deep learning system may estimate the direct speech component that contains information about the direct signal propagation from the speech source to the microphone array and the reverberant speech signal that contains the reverberation effect and noise. The deep learning system may extract signal characteristics of the direct signal component and the reverberant signal component and estimate the distance based on the extracted signal characteristics using the learned mapping.
-
公开(公告)号:US20190222950A1
公开(公告)日:2019-07-18
申请号:US16240161
申请日:2019-01-04
Applicant: Apple Inc.
Inventor: Jonathan D. Sheaffer , Joshua D. Atkins , Martin E. Johnson , Stuart J. Wood
IPC: H04S7/00 , G06T7/20 , G10L19/008
CPC classification number: H04S7/30 , G06T7/20 , G10L19/008 , G10L21/0272 , G10L2021/02082 , G10L2021/02166 , H04S3/00 , H04S7/302 , H04S2400/11 , H04S2400/15 , H04S2420/01
Abstract: Image analysis of a video signal is performed to produce first metadata, and audio analysis of a multi-channel sound track associated with the video signal is performed to produce second metadata. A number of time segments of the sound track are processed, wherein each time segment is processed by either (i) spatial filtering of the audio signals or (ii) spatial rendering of the audio signals, not both, wherein for each time segment a decision was made to select between the spatial filtering or the spatial rendering, in accordance with the first and second metadata. A mix of the processed sound track and the video signal is generated. Other embodiments are also described and claimed.
-
公开(公告)号:US10334357B2
公开(公告)日:2019-06-25
申请号:US15721644
申请日:2017-09-29
Applicant: Apple Inc.
Inventor: Joshua D. Atkins , Mehrez Souden , Symeon Delikaris-Manias , Peter Raffensperger
Abstract: Impulse responses of a device are measured. A database of sound files is generated by convolving source signals with the impulse responses of the device. The sound files from the database are transformed into time-frequency domain. One or more sub-band directional features is estimated at each sub-band of the time-frequency domain. A deep neural network (DNN) is trained for each sub-band based on the estimated one or more sub-band directional features and a target directional feature.
-
公开(公告)号:US20190172476A1
公开(公告)日:2019-06-06
申请号:US15830955
申请日:2017-12-04
Applicant: Apple Inc.
Inventor: Jason Wung , Mehrez Souden , Ramin Pishehvar , Joshua D. Atkins
IPC: G10L21/02 , G10L25/30 , G10L15/02 , G10L21/0232 , G10L25/03
Abstract: A number of features are extracted from a current frame of a multi-channel speech pickup and from side information that is a linear echo estimate, a diffuse signal component, or a noise estimate of the multi-channel speech pickup. A DNN-based speech presence probability is produced for the current frame, where the SPP value is produced in response to the extracted features being input to the DNN. The DNN-based SPP value is applied to configure a multi-channel filter whose input is the multi-channel speech pickup and whose output is a single audio signal. In one aspect, the system is designed to run online, at low enough latency for real time applications such voice trigger detection. Other aspects are also described and claimed.
-
公开(公告)号:US11996114B2
公开(公告)日:2024-05-28
申请号:US17321411
申请日:2021-05-15
Applicant: Apple Inc.
Inventor: Ramin Pishehvar , Ante Jukic , Mehrez Souden , Jason Wung , Feipeng Li , Joshua D. Atkins
IPC: G10L15/16 , G06N20/00 , G10L21/0216
CPC classification number: G10L21/0216 , G06N20/00 , G10L15/16 , G10L2021/02166
Abstract: Disclosed is a multi-task machine learning model such as a time-domain deep neural network (DNN) that jointly generate an enhanced target speech signal and target audio parameters from a mixed signal of target speech and interference signal. The DNN may encode the mixed signal, determine masks used to jointly estimate the target signal and the target audio parameters based on the encoded mixed signal, apply the mask to separate the target speech from the interference signal to jointly estimate the target signal and the target audio parameters, and decode the masked features to enhance the target speech signal and to estimate the target audio parameters. The target audio parameters may include a voice activity detection (VAD) flag of the target speech. The DNN may leverage multi-channel audio signal and multi-modal signals such as video signals of the target speaker to improve the robustness of the enhanced target speech signal.
-
公开(公告)号:US20240098442A1
公开(公告)日:2024-03-21
申请号:US18458077
申请日:2023-08-29
Applicant: Apple Inc.
Inventor: Shai Messingher Lang , Joshua D. Atkins , Scott A. Wardle , Symeon Delikaris Manias
IPC: H04S7/00
CPC classification number: H04S7/302 , H04S2400/11
Abstract: An audio processing system may obtain a size of a visual object to present to a display. The audio processing system may determine a virtual placement for each of a plurality of virtual speakers at least based on the size of the visual object. Each of the plurality of virtual speakers may be spatially rendered at each virtual placement through binaural audio, for playback through head-worn speakers. Other aspects are also described and claimed.
-
公开(公告)号:US20230410828A1
公开(公告)日:2023-12-21
申请号:US17845655
申请日:2022-06-21
Applicant: Apple Inc.
Inventor: Ramin Pishehvar , Mehrez Souden , Sean A. Ramprashad , Jason Wung , Ante Jukic , Joshua D. Atkins
IPC: G10L21/0232 , G06V40/16 , G10L25/84 , G10L21/034 , G10L21/0364 , G10L15/25 , G10L15/06 , G10L15/22
CPC classification number: G10L21/0232 , G06V40/161 , G10L25/84 , G10L21/034 , G10L21/0364 , G10L15/25 , G10L15/063 , G10L15/22
Abstract: Disclosed is a reference-less echo mitigation or cancellation technique. The technique enables suppression of echoes from an interference signal when a reference version of the interference signal conventionally used for echo mitigation may not be available. A first stage of the technique may use a machine learning model to model a target audio area surrounding a device so that a target audio signal estimated as originating from within the target audio area may be accepted. In contrast, audio signals such as playback of media content on a TV or other interfering signals estimated as originating from outside the target audio area may be suppressed. A second stage of the technique may be a level-based suppressor that further attenuates the residual echo from the output of the first stage based on an audio level threshold. Side information may be provided to adjust the target audio area or the audio level threshold.
-
公开(公告)号:US11841899B2
公开(公告)日:2023-12-12
申请号:US16899019
申请日:2020-06-11
Applicant: Apple Inc.
Inventor: Jonathan D. Sheaffer , Symeon Delikaris Manias , Gaetan R. Lorho , Peter A. Raffensperger , Eric A. Allamanche , Frank Baumgarte , Dipanjan Sen , Joshua D. Atkins , Juha O. Merimaa
IPC: G06F16/683 , G06F16/174 , H04R1/40 , H04R3/00
CPC classification number: G06F16/683 , G06F16/1744 , H04R1/406 , H04R3/005 , H04R2410/00
Abstract: A device with microphones can generate microphone signals during an audio recording. The device can store, in an electronic audio data file, the microphone signals, and metadata that includes impulse responses of the microphones. Other aspects are described and claimed.
-
公开(公告)号:US11818561B1
公开(公告)日:2023-11-14
申请号:US17984134
申请日:2022-11-09
Applicant: Apple Inc.
Inventor: Ismael H. Nawfal , Joshua D. Atkins , Stephen J. Nimick , Guy C. Nicholson , Jason M. Harlow
CPC classification number: H04R5/04 , H04R5/027 , H04R1/1041 , H04R5/033 , H04R2201/401 , H04R2201/403 , H04R2430/01 , H04R2460/01 , H04R2460/05
Abstract: Digital audio signal processing techniques used to provide an acoustic transparency function in a pair of headphones. A number of transparency filters can be computed at once, using optimization techniques or using a closed form solution, that are based on multiple re-seatings of the headphones and that are as a result robust for a population of wearers. In another embodiment, a transparency hearing filter of a headphone is computed by an adaptive system that takes into consideration the changing acoustic to electrical path between an earpiece speaker and an interior microphone of that headphone while worn by a user. Other embodiments are also described and claimed.
-
-
-
-
-
-
-
-
-