-
公开(公告)号:US12063497B2
公开(公告)日:2024-08-13
申请号:US18451794
申请日:2023-08-17
申请人: Magic Leap, Inc.
发明人: Remi Samuel Audfray , Jean-Marc Jot , Samuel Charles Dicker , Mark Brandon Hertensteiner , Justin Dan Mathew , Anastasia Andreyevna Tajik , Nicholas John LaMartina
CPC分类号: H04S7/304 , H04R5/033 , H04R5/04 , H04S3/008 , H04S2400/01 , H04S2400/11 , H04S2420/01
摘要: Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a source location corresponding to the audio signal is identified. For each of the respective left and right ear of the user, a virtual speaker position, of a virtual speaker array, is determined, the virtual speaker position collinear with the source location and with a position of the respective ear. For each of the respective left and right ear of the user, a head-related transfer function (HRTF) corresponding to the virtual speaker position and to the respective ear is determined; and the output audio signal is presented to the respective ear of the user via one or more speakers associated with the wearable head device. Processing the audio signal includes applying the HRTF to the audio signal.
-
公开(公告)号:US12008982B2
公开(公告)日:2024-06-11
申请号:US18296901
申请日:2023-04-06
申请人: Magic Leap, Inc.
CPC分类号: G10K15/08
摘要: Systems and methods for providing accurate and independent control of reverberation properties are disclosed. In some embodiments, a system may include a reverberation processing system, a direct processing system, and a combiner. The reverberation processing system can include a reverb initial power (RIP) control system and a reverberator. The RIP control system can include a reverb initial gain (RIG) and a RIP corrector. The RIG can be configured to apply a RIG value to the input signal, and the RIP corrector can be configured to apply a RIP correction factor to the signal from the RIG. The reverberator can be configured to apply reverberation effects to the signal from the RIP control system. In some embodiments, one or more values and/or correction factors can be calculated and applied such that the signal output from a component in the reverberation processing system is normalized to a predetermined value (e.g., unity (1.0)).
-
公开(公告)号:US12003953B2
公开(公告)日:2024-06-04
申请号:US18181920
申请日:2023-03-10
申请人: Magic Leap, Inc.
发明人: Colby Nelson Leider , Justin Dan Mathew , Michael Z. Land , Blaine Ivin Wood , Jung-Suk Lee , Anastasia Andreyevna Tajik , Jean-Marc Jot
IPC分类号: H04R5/02 , A63F13/285 , A63F13/577 , G06F3/16 , G06T19/00 , H04S7/00
CPC分类号: H04S7/303 , A63F13/285 , A63F13/577 , G06F3/165 , G06T19/006 , A63F2300/8082
摘要: Disclosed herein are systems and methods for generating and presenting virtual audio for mixed reality systems. A method may include determining a collision between a first object and a second object, wherein the first object comprises a first virtual object. A memory storing one or more audio models can be accessed. It can be determined if the one or more audio models stored in the memory comprises an audio model corresponding to the first object. In accordance with a determination that the one or more audio models comprises an audio model corresponding to the first object, an audio signal can be synthesized, wherein the audio signal is based on the collision and the audio model corresponding to the first object, and the audio signal can be presented to a user via a speaker of a head-wearable device. In accordance with a determination that the one or more audio models does not comprise an audio model corresponding to the first object, an acoustic property of the first object can be determined, a custom audio model based on the acoustic property of the first object can be generated, an audio signal can be synthesized, wherein the audio signal is based on the collision and the custom audio model, and the audio signal can be presented, via a speaker of a head-wearable device, to a user.
-
公开(公告)号:US20230410835A1
公开(公告)日:2023-12-21
申请号:US18459342
申请日:2023-08-31
申请人: Magic Leap, Inc.
发明人: Jung-Suk Lee , Jean-Marc Jot
IPC分类号: G10L25/78 , G10L25/51 , H04R3/00 , H04R3/04 , H04R5/04 , G06F3/01 , G02B27/00 , G02B27/01 , G06F17/18
CPC分类号: G10L25/78 , G10L25/51 , H04R3/005 , H04R3/04 , H04R5/04 , G06F3/011 , G06F3/017 , G02B27/0093 , G02B27/017 , G06F17/18 , G10L2025/783
摘要: In some embodiments, a first audio signal is received via a first microphone, and a first probability of voice activity is determined based on the first audio signal. A second audio signal is received via a second microphone, and a second probability of voice activity is determined based on the first and second audio signals. Whether a first threshold of voice activity is met is determined based on the first and second probabilities of voice activity. In accordance with a determination that a first threshold of voice activity is met, it is determined that a voice onset has occurred, and an alert is transmitted to a processor based on the determination that the voice onset has occurred. In accordance with a determination that a first threshold of voice activity is not met, it is not determined that a voice onset has occurred.
-
公开(公告)号:US11800313B2
公开(公告)日:2023-10-24
申请号:US18146284
申请日:2022-12-23
申请人: Magic Leap, Inc.
发明人: Jean-Marc Jot , Michael Minnick , Dmitry Pastouchenko , Michael Aaron Simon , John Emmitt Scott , Richard St. Clair Bailey , Shivakumar Balasubramanyam , Harsharaj Agadi
CPC分类号: H04S7/304 , G02B27/017 , H04S2400/01 , H04S2400/11 , H04S2420/01
摘要: Disclosed herein are systems and methods for presenting audio content in mixed reality environments. A method may include receiving a first input from an application program; in response to receiving the first input, receiving, via a first service, an encoded audio stream; generating, via the first service, a decoded audio stream based on the encoded audio stream; receiving, via a second service, the decoded audio stream; receiving a second input from one or more sensors of a wearable head device; receiving, via the second service, a third input from the application program, wherein the third input corresponds to a position of one or more virtual speakers; generating, via the second service, a spatialized audio stream based on the decoded audio stream, the second input, and the third input; presenting, via one or more speakers of the wearable head device, the spatialized audio stream.
-
公开(公告)号:US11778398B2
公开(公告)日:2023-10-03
申请号:US18058232
申请日:2022-11-22
申请人: Magic Leap, Inc.
摘要: Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.
-
公开(公告)号:US11651762B2
公开(公告)日:2023-05-16
申请号:US17568588
申请日:2022-01-04
申请人: Magic Leap, Inc.
CPC分类号: G10K15/08
摘要: Systems and methods for providing accurate and independent control of reverberation properties are disclosed. In some embodiments, a system may include a reverberation processing system, a direct processing system, and a combiner. The reverberation processing system can include a reverb initial power (RIP) control system and a reverberator. The RIP control system can include a reverb initial gain (RIG) and a RIP corrector. The RIG can be configured to apply a RIG value to the input signal, and the RIP corrector can be configured to apply a RIP correction factor to the signal from the RIG. The reverberator can be configured to apply reverberation effects to the signal from the RIP control system. In some embodiments, one or more values and/or correction factors can be calculated and applied such that the signal output from a component in the reverberation processing system is normalized to a predetermined value (e.g., unity (1.0)).
-
公开(公告)号:US11627430B2
公开(公告)日:2023-04-11
申请号:US17112969
申请日:2020-12-04
申请人: Magic Leap, Inc.
发明人: Remi Samuel Audfray , Mark Brandon Hertensteiner , Samuel Charles Dicker , Blaine Ivin Wood , Michael Z. Land , Jean-Marc Jot
摘要: Disclosed herein are systems and methods for storing, organizing, and maintaining acoustic data for mixed reality systems. A system may include one or more sensors of a head-wearable device, a speaker of the head-wearable device, and one or more processors configured to execute a method. A method for execution by the one or more processors may include receiving a request to present an audio signal. An environment may be identified via the one or more sensors of the head-wearable device. One or more audio model components associated with the environment may be retrieved. A first audio model may be generated based on the audio model components. A second audio model may be generated based on the first audio model. A modified audio signal may be determined based on the second audio model and based on the request to present an audio signal. The modified audio signal may be presented via the speaker of the head-wearable device.
-
公开(公告)号:US11627428B2
公开(公告)日:2023-04-11
申请号:US17190326
申请日:2021-03-02
申请人: Magic Leap, Inc.
发明人: Jean-Marc Jot , Michael Minnick , Dmitry Pastouchenko , Michael Aaron Simon , John Emmitt Scott, III , Richard St. Clair Bailey , Shivakumar Balasubramanyam , Harsharaj Agadi
摘要: Disclosed herein are systems and methods for presenting audio content in mixed reality environments. A method may include receiving a first input from an application program; in response to receiving the first input, receiving, via a first service, an encoded audio stream; generating, via the first service, a decoded audio stream based on the encoded audio stream; receiving, via a second service, the decoded audio stream; receiving a second input from one or more sensors of a wearable head device; receiving, via the second service, a third input from the application program, wherein the third input corresponds to a position of one or more virtual speakers; generating, via the second service, a spatialized audio stream based on the decoded audio stream, the second input, and the third input; presenting, via one or more speakers of the wearable head device, the spatialized audio stream.
-
公开(公告)号:US11477592B2
公开(公告)日:2022-10-18
申请号:US16987079
申请日:2020-08-06
申请人: Magic Leap, Inc.
摘要: Systems and methods for rendering audio signals are disclosed. In some embodiments, a method may receive an input signal including a first portion and the second portion. A first processing stage comprising a first filter is applied to the first portion to generate a first filtered signal. A second processing stage comprising a second filter is applied to the first portion to generate a second filtered signal. A third processing stage comprising a third filter is applied to the second portion to generate a third filtered signal. A fourth processing stage comprising a fourth filter is applied to the second portion to generate a fourth filtered signal. A first output signal is determined based on a sum of the first filtered signal and the third filtered signal. A second output signal is determined based on a sum of the second filtered signal and the fourth filtered signal. The first output signal is presented to a first ear of a user of a virtual environment, and the second output signal is presented to the second ear of the user. The first portion of the input signal corresponds to a first location in the virtual environment, and the second portion of the input signal corresponds to a second location in the virtual environment.
-
-
-
-
-
-
-
-
-