AUDIO PROCESSING
    2.
    发明申请

    公开(公告)号:US20210329405A1

    公开(公告)日:2021-10-21

    申请号:US17360823

    申请日:2021-06-28

    申请人: Apple Inc.

    IPC分类号: H04S7/00

    摘要: Processing sound in an enhanced reality environment can include generating, based on an image of a physical environment, an acoustic model of the physical environment. Audio signals captured by a microphone array, can capture a sound in the physical environment. Based on these audio signals, one or more measured acoustic parameters of the physical environment can be generated. A target audio signal can be processed using the model of the physical environment and the measured acoustic parameters, resulting in a plurality of output audio channels having a virtual sound source with a virtual location. The output audio channels can be used to drive a plurality of speakers. Other aspects are also described and claimed.

    System and method for performing panning for an arbitrary loudspeaker setup

    公开(公告)号:US10609485B2

    公开(公告)日:2020-03-31

    申请号:US16000281

    申请日:2018-06-05

    申请人: Apple Inc.

    摘要: Placement of one or two placed virtual loudspeakers within a loudspeaker setup that includes a real loudspeakers is determined and vector base amplitude panning (VBAP) gains including the gains of the real loudspeakers and placed one or two virtual loudspeakers are also then determined. Gains of one or two placed virtual loudspeakers are redistributed to the real loudspeakers to ensure preservation of total energy. Real loudspeakers in the loudspeaker setup have redistributed gains of one or two placed virtual loudspeakers. Loudspeaker outputs are generated and transmitted to the real loudspeakers to be played back. When received audio content is ambisonics content, a predetermined grid is generated and HOA content is projected to the grid. Other aspects are also described.

    System to move a virtual sound away from a listener using a crosstalk canceler

    公开(公告)号:US10524080B1

    公开(公告)日:2019-12-31

    申请号:US16111045

    申请日:2018-08-23

    申请人: Apple Inc.

    IPC分类号: H04S7/00 H04S1/00 G10K15/08

    摘要: An audio processing system has one or more processors that process an audio signal on three paths. The first path has a direct gain and a direct virtual source algorithm operating on the audio signal. The second path has a plurality of early reflection gains operating on the audio signal. Operation with the early reflection gains produces a plurality of early reflections. Each of the early reflection signals may be subjected to a delay and may be processed according to an early reflections virtual source algorithm. The third path has a reverb gain and binaural reverb filters operating on the audio signal. The third path also has a crosstalk canceler. A mixer combines left and right channel outputs of each of the first path, second path and third path. The mixer produces a left loudspeaker signal and a right loudspeaker signal.

    METHOD AND SYSTEM FOR MAINTAINING TRACK LENGTH FOR PRE-RENDERED SPATIAL AUDIO

    公开(公告)号:US20220394406A1

    公开(公告)日:2022-12-08

    申请号:US17737897

    申请日:2022-05-05

    申请人: Apple Inc.

    IPC分类号: H04S1/00 H04S7/00

    摘要: A method performed by a programmed processor of an audio system, the method includes receiving a sound track that has a track length, producing a binaural audio version of a sound track, the binaural audio version having an extended track length performing a fading operation upon the binaural audio version to gradually reduce a signal level of the binaural audio version to below a signal threshold level at a time along the extended track length that corresponds to an end time of the track length of the sound track; and storing the binaural audio version having the track length of the sound track in memory for later transmission to an audio playback device for driving one or more speakers.

    Microphone array based deep learning for time-domain speech signal extraction

    公开(公告)号:US11508388B1

    公开(公告)日:2022-11-22

    申请号:US17100802

    申请日:2020-11-20

    申请人: Apple Inc.

    摘要: A device for processing audio signals in a time-domain includes a processor configured to receive multiple audio signals corresponding to respective microphones of at least two or more microphones of the device, at least one of the multiple audio signals comprising speech of a user of the device. The processor is configured to provide the multiple audio signals to a machine learning model, the machine learning model having been trained based at least in part on an expected position of the user of the device and expected positions of the respective microphones on the device. The processor is configured to provide an audio signal that is enhanced with respect to the speech of the user relative to the multiple audio signals, wherein the audio signal is a waveform output from the machine learning model.

    End-To-End Time-Domain Multitask Learning for ML-Based Speech Enhancement

    公开(公告)号:US20220366927A1

    公开(公告)日:2022-11-17

    申请号:US17321411

    申请日:2021-05-15

    申请人: Apple Inc.

    摘要: Disclosed is a multi-task machine learning model such as a time-domain deep neural network (DNN) that jointly generate an enhanced target speech signal and target audio parameters from a mixed signal of target speech and interference signal. The DNN may encode the mixed signal, determine masks used to jointly estimate the target signal and the target audio parameters based on the encoded mixed signal, apply the mask to separate the target speech from the interference signal to jointly estimate the target signal and the target audio parameters, and decode the masked features to enhance the target speech signal and to estimate the target audio parameters. The target audio parameters may include a voice activity detection (VAD) flag of the target speech. The DNN may leverage multi-channel audio signal and multi-modal signals such as video signals of the target speaker to improve the robustness of the enhanced target speech signal.