公开(公告)号：US11417347B2

公开(公告)日：2022-08-16

申请号：US17316408

申请日：2021-05-10

Applicant: Apple Inc.

Inventor： Martin E. Johnson ,  Juha O. Merimaa

IPC: G10L19/008 ,  H04S7/00 ,  H04S3/00

Abstract: A binaural room impulse response (BRIR) can be generated based on a position of a listener's head, and a plurality of head related impulse responses (HRIRs). Each of the plurality of HRIRs are selected for a respective one of a plurality of acoustic reflections which, when taken together, approximate reverberation of a room. Each of the acoustic reflections have a direction and a delay. The BRIR filter is applied to source audio to generate binaural audio output.

公开(公告)号：US11375333B1

公开(公告)日：2022-06-28

申请号：US17023160

申请日：2020-09-16

Applicant: Apple Inc.

Inventor： Antti J. Vanne ,  Darius A. Satongar ,  James W. Vandyke ,  Juha O. Merimaa ,  Martin E. Johnson ,  Tomi A. Huttunen

IPC: H04S7/00 ,  G06F3/01 ,  H04R5/033 ,  H04R5/04

Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.

公开(公告)号：US11202164B2

公开(公告)日：2021-12-14

申请号：US16651316

申请日：2018-09-25

Applicant: Apple Inc.

Inventor： Juha O. Merimaa ,  Christopher T. Eubank ,  Martin E. Johnson ,  Stuart J. Wood ,  Deepak Natarajan

IPC: H04R5/02 ,  H04S7/00 ,  H04R5/033

Abstract: Methods and apparatus for predictive head-tracked binaural audio rendering in which a rendering device renders multiple audio streams for different possible head locations based on head tracking data received from a headset, for example audio streams for the last known location and one or more predicted or possible locations, and transmits the multiple audio streams to the headset. The headset then selects and plays one of the audio streams that is closest to the actual head location based on current head tracking data. If none of the audio streams closely match the actual head location, two closest audio streams may be mixed. Transmitting multiple audio streams to the headset and selecting or mixing an audio stream on the headset may mitigate or eliminate perceived head tracking latency.

公开(公告)号：US10979806B1

公开(公告)日：2021-04-13

申请号：US16389835

申请日：2019-04-19

Applicant: Apple Inc.

Inventor： Martin E. Johnson ,  Jonathan D. Sheaffer

IPC: H04R3/00 ,  G06T7/70 ,  H04N5/247 ,  H04R1/40

Abstract: An audio system having a depth capturing device and a microphone array to respectively detect a point cloud and a local sound field, is described. The point cloud includes points corresponding to objects in a source space, and the local sound field includes sounds received in respective directions from the source space. The audio system includes one or more processors to generate a global sound field based on distances to the points and directions of the sounds. The global sound field includes virtual sound sources emitting respective sounds at respective points. A speaker can render the virtual sound sources to a user in a virtual space that corresponds to the source space.

公开(公告)号：US10524080B1

公开(公告)日：2019-12-31

申请号：US16111045

申请日：2018-08-23

Applicant: Apple Inc.

Inventor： Martin E. Johnson ,  Darius A. Satongar ,  Stuart J. Wood ,  Lance F. Reichert ,  Juha O. Merimaa ,  Joshua D. Atkins

IPC: H04S7/00 ,  H04S1/00 ,  G10K15/08

Abstract: An audio processing system has one or more processors that process an audio signal on three paths. The first path has a direct gain and a direct virtual source algorithm operating on the audio signal. The second path has a plurality of early reflection gains operating on the audio signal. Operation with the early reflection gains produces a plurality of early reflections. Each of the early reflection signals may be subjected to a delay and may be processed according to an early reflections virtual source algorithm. The third path has a reverb gain and binaural reverb filters operating on the audio signal. The third path also has a crosstalk canceler. A mixer combines left and right channel outputs of each of the first path, second path and third path. The mixer produces a left loudspeaker signal and a right loudspeaker signal.

公开(公告)号：US20190104359A1

公开(公告)日：2019-04-04

申请号：US15721654

申请日：2017-09-29

Applicant: Apple Inc.

Inventor： Jonathan D. Sheaffer ,  Darius A. Satongar ,  Joshua D. Atkins ,  Martin E. Johnson

IPC: H04R3/00 ,  H04R1/40 ,  H04R1/04 ,  H04R1/08

CPC classification number: H04R3/005 ,  H04R1/04 ,  H04R1/40 ,  H04R1/406 ,  H04R3/00 ,  H04R2499/11 ,  H04S7/305 ,  H04S7/40

Abstract: A microphone array included in a portable electronic device is used to generate various virtual studio microphones by combining one or more microphone signals to produce one or more acoustic pickup beams. An error is determined in a position of the microphone array relative to an audio source to be recorded. An interface is displayed to instruct a user on repositioning the microphone array relative to the instrument and the instrument is recorded using the repositioned microphone array.

公开(公告)号：US10251008B2

公开(公告)日：2019-04-02

申请号：US15037302

申请日：2014-09-25

Applicant: Apple Inc.

Inventor： John J. Baker ,  Martin E. Johnson ,  Afrooz Family ,  Michael B. Howes ,  Craig M. Stanley ,  Brad G. Boozer

IPC: H04S7/00 ,  G10L17/04 ,  G10L17/06 ,  H04R1/08 ,  H04R1/40

Abstract: An audio system that adjusts one or more beam patterns emitted by one or more loudspeaker arrays based on the preferences of users/listeners is described. The audio system includes an audio receiver that contains a listener location estimator, a listener identifier, and a voice command processor. Inputs from the listener location estimator, the listener identifier, and the voice command processor are fed into an array processor. The array processor drives the one or more loudspeaker arrays to emit beam patterns into the listening area based on inputs from each of these devices. By examining the location, preferred usage settings, and voice commands from listeners, the generated beam patterns are customized to the explicit and implicit preferences of the listeners with minimal direct input. Other embodiments are also described.

公开(公告)号：US10063984B2

公开(公告)日：2018-08-28

申请号：US15514813

申请日：2015-09-29

Applicant: Apple Inc.

Inventor： Martin E. Johnson ,  Sylvain J. Choisel ,  Daniel K. Boothe ,  Mitchell R. Lerner

IPC: H04R5/00 ,  H04S1/00 ,  H04S7/00

CPC classification number: H04S1/002 ,  H04S1/00 ,  H04S7/30 ,  H04S7/307 ,  H04S2400/09 ,  H04S2400/11 ,  H04S2400/13 ,  H04S2420/01

Abstract: A system and method are described for transforming stereo signals into mid and side components xm and xs to apply processing to only the side-component xs and avoid processing the mid-component. By avoiding alteration to the mid-component XM, the system and method may reduce the effects of ill-conditioning, such as coloration that may be caused by processing a problematic mid-component xM while still performing crosstalk cancellation and/or generating virtual sound sources. Additional processing may be separately applied to the mid and side components xM and xs and/or particular frequency bands of the original stereo signals to further reduce ill-conditioning.

公开(公告)号：US09961472B2

公开(公告)日：2018-05-01

申请号：US14775600

申请日：2014-03-13

Applicant: Apple Inc.

Inventor： Martin E. Johnson ,  Afrooz Family ,  Tom-Davy William Jendrik Saux

IPC: H04R5/02 ,  H04S7/00

CPC classification number: H04S7/303 ,  H04R5/02 ,  H04R2203/12 ,  H04S7/301 ,  H04S7/302 ,  H04S2400/11 ,  H04S2400/15

Abstract: A method for determining the orientation of a loudspeaker relative to a listening device is described. The method simultaneously drives each transducer to emit beam patterns corresponding to distinct orthogonal audio signals. The listening device senses sounds produced by the orthogonal audio signals and analyzes the sensed audio signal to determine the spatial orientation of the loudspeaker relative to the listening device. Other embodiments are also described.

公开(公告)号：US09949032B1

公开(公告)日：2018-04-17

申请号：US15275211

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： Martin E. Johnson ,  Tom-Davy W. Saux ,  Justin D. Crosby

IPC: H04R5/02 ,  H04R1/34 ,  H04R1/28 ,  H04R5/04

CPC classification number: H04R5/02 ,  H04R1/288 ,  H04R1/345 ,  H04R1/403 ,  H04R5/04 ,  H04R2203/12

Abstract: Some embodiments provide a directivity speaker array, comprising multiple driver assemblies, which is configured to provide audio signal patterns, which include audio content, to one or more listeners where the signal patterns are associated with at least a certain threshold directivity across a range of frequencies in which the array can transition between the providing audio signal patterns via beamforming of signals generated by multiple driver assemblies and via an individual driver assembly, based on overlapping frequency ranges at which such provided audio signal patterns are associated with at least the certain threshold directivity. A driver assembly can include a release duct which progressively releases an audio signal generated by a coupled driver, via perforations in a perforated surface, as the signal propagates along a surface of an enclosure of the duct such that an intensity of the audio signal is maximized along the particular axis of propagation.