公开(公告)号：US20210375258A1

公开(公告)日：2021-12-02

申请号：US16768968

申请日：2018-11-29

Applicant: Nokia Technologies Oy

Inventor： Jussi LEPPANEN ,  Antti ERONEN ,  Arto LEHTINIEMI ,  Tapani PIHLAJAKUJA

IPC: G10K15/08 ,  H04S7/00 ,  G10K15/02

Abstract: A method including receiving an audio scene including at least one source captured using at least one near field microphone and at least one far field microphone. The method includes determining at least one room-impulse-response associated with the audio scene based on the at least one near field microphone and the at least one far field microphone, accessing a predetermined scene geometry corresponding to the audio scene, and identifying best match to the predetermined scene geometry in a scene geometry database. The method also includes performing RIR comparison based on the at least one RIR and at least one geometric RIR associated with the best matching geometry and rendering a volumetric audio scene based on a result of the RIR comparison.

公开(公告)号：US20210289292A1

公开(公告)日：2021-09-16

申请号：US16332407

申请日：2017-09-08

Applicant: NOKIA TECHNOLOGIES OY

Inventor： Antti ERONEN ,  Arto LEHTINIEMI ,  Jussi LEPPANEN ,  Veli-Matti KOLMONEN

IPC: H04R3/00 ,  G10L25/51 ,  G10L25/06 ,  H04R1/40 ,  H04R29/00 ,  H04S7/00 ,  G11B27/038 ,  G11B27/10

Abstract: A method including obtaining a first clean signal and a first processed signal dependent upon audio input at a first microphone; obtaining a second clean signal and a second processed signal dependent upon audio input at a second microphone; using the first clean signal and the second clean signal to enable further processing of at least the first processed signal and the second processed signal.

公开(公告)号：US20200288262A1

公开(公告)日：2020-09-10

申请号：US16649433

申请日：2018-10-01

Applicant: Nokia Technologies Oy

Inventor： Antti ERONEN ,  Arto LEHTINIEMI ,  Jussi LEPPANEN ,  Tapani PIHLAJAKUJA

IPC: H04S7/00

Abstract: An apparatus for spatial audio signal processing, the apparatus including at least one processor configured to: receive captured audio content, the captured audio content captured within a capture environment with defined geometry; determine audio directions and distances associated with the captured audio content; determine a listening space area geometry; map the audio directions and distances associated with the captured audio content relative to the defined geometry to the listening space area geometry; and synthesize a volumetric audio based on the mapped audio directions and distances to generate an audio content experience within the listening space area geometry.

公开(公告)号：US20200280816A1

公开(公告)日：2020-09-03

申请号：US16650190

申请日：2018-10-01

Applicant: Nokia Technologies Oy

Inventor： Antti ERONEN ,  Arto LEHTINIEMI ,  Jussi LEPPANEN ,  Tapani PIHLAJAKUJA

IPC: H04S7/00 ,  G10K15/12 ,  H04R3/00

Abstract: An apparatus for audio signal rendering, the apparatus including at least one processor configured to: receive at least one microphone audio signal captured by at least one microphone within a capture environment; receive at least one projection audio signal, wherein the at least one projection audio signal is a room-impulse-response filtered at least one microphone audio signal within the capture environment; receive at least one residual audio signal, wherein the at least one residual audio signal is a result of removing the at least one projection audio signal from at least one audio signal captured by a microphone array within the capture environment; and generate at least two volumetric audio signals based on the at least one microphone audio signal, the at least one projection audio signal and the at least one residual audio signal.

公开(公告)号：US20190005728A1

公开(公告)日：2019-01-03

申请号：US16019872

申请日：2018-06-27

Applicant: Nokia Technologies Oy

Inventor： Jussi LEPPANEN ,  Arto LEHTINIEMI ,  Antti ERONEN ,  Juha ARRASVUORI

IPC: G06T19/00 ,  G06T19/20 ,  G06T15/00 ,  G06F17/30

Abstract: A method is disclosed, including providing data indicative of dimensions of a real-world space within which a virtual world is to be consumed. The method may also include identifying one or more objects within said real-world space, and determining one or more available areas within the real-world space for rendering three-dimensional virtual content, based at least partly on the dimensions of the real-world space. The method may also include identifying one or more of the objects as being movable, identifying, from a set of three-dimensional virtual content items, one or more candidate items unable to be rendered within the available area(s) and which can be rendered if one or more of the movable objects is moved and providing an indication to a virtual reality user device of the candidate virtual item(s) and of the movable object(s) required to be moved.

公开(公告)号：US20240089694A1

公开(公告)日：2024-03-14

申请号：US18269892

申请日：2021-11-19

Applicant: Nokia Technologies Oy

Inventor： Sujeet Shyamsundar Mate ,  Antti ERONEN ,  Jussi LEPPANEN

IPC: H04S7/00

CPC classification number: H04S7/306 ,  H04S7/304 ,  H04S2400/11

Abstract: An apparatus for rendering an audio scene in a physical space including circuitry configured to: determine a listening position within the physical space during rendering; obtain at least one information of a virtual scene to render the virtual scene according to the at least one information; obtain at least one acoustic characteristic of the physical space; prepare the audio scene using the at least one information of the virtual scene and the at least one acoustic characteristic of the physical space, such that the virtual scene acoustics and the physical space acoustics are merged; and render the prepared audio scene according to the listening position.

公开(公告)号：US20210067894A1

公开(公告)日：2021-03-04

申请号：US16957756

申请日：2018-12-20

Applicant: Nokia Technologies Oy

Inventor： Jussi LEPPANEN ,  Arto LEHTINIEMI ,  Antti ERONEN

IPC: H04S7/00 ,  G06F3/01 ,  G06T19/00 ,  G06F3/16

Abstract: A method, an apparatus and a computer program are provided. The method includes rendering visual augmented reality content for display on a display of a hand-held electronic device, based on a location of the hand-held electronic device; estimate a location of a user of the hand-held electronic device, different from the location of the hand-held electronic device; and rendering aural augmented reality content for output to the user of the hand-held electronic device, based on the location of the user.

公开(公告)号：US20190149919A1

公开(公告)日：2019-05-16

申请号：US16308707

申请日：2017-06-07

Applicant: Nokia Technologies Oy

Inventor： Sujeet Shyamsundar MATE ,  Arto LEHTINIEMI ,  Antti ERONEN ,  Jussi LEPPANEN

IPC: H04R3/00 ,  H04R1/10 ,  H04R1/40 ,  H04H60/04

Abstract: An apparatus comprising including a processor configured to determine a position for at least one sound source relative to a reference position, and a position for a sound source tracker relative to the reference position. The processor further configured to determine a direction associated with the sound source tracker, select the at least one sound source based on an analysis of the direction associated with the sound source tracker, the position for the at least one sound source and the position of the sound source tracker. The processor is further configured to receive at least one control interaction associated with the selected at least one sound source from at least one controller, process at least one audio signal associated with the selected sound source based on the control interaction and output the processed at least one audio signal to be rendered.

公开(公告)号：US20180295463A1

公开(公告)日：2018-10-11

申请号：US15767422

申请日：2016-10-07

Applicant: Nokia Technologies Oy

Inventor： Antti ERONEN ,  Jussi LEPPANEN ,  Arto LEHTINIEMI ,  Sujeet MATE ,  Francesco CRICRI

IPC: H04S7/00 ,  H04R1/40 ,  H04R3/00 ,  G10L19/008

Abstract: A spatial audio signal is received that is associated with a microphone array configured to provide spatial audio capture and additional audio signal(s) associated with an additional microphone, the additional audio signal having been delayed by a variable delay determined such that common components of the spatial audio signal and the additional audio signal(s) are time aligned. A relative position is received between a first position associated with the microphone array and a second position associated with the additional microphone Source parameter(s) are received classifying an audio source associated with the common components and/or space parameter(s) identifying an environment within which the audio source is located Processing effect ruleset is determined based on the source parameter(s) and/or the space parameter(s). Multiple output audio channel signals are generated by mixing and applying processing effect(s) to the spatial audio signal and the additional audio signal(s) based on the processing effect ruleset(s).

公开(公告)号：US20180190005A1

公开(公告)日：2018-07-05

申请号：US15849882

申请日：2017-12-21

Applicant: Nokia Technologies Oy

Inventor： Antti ERONEN ,  Miikka VILERMO ,  Arto LEHTINIEMI ,  Jussi LEPPANEN

IPC: G06T15/00 ,  G10L21/038 ,  H04S7/00 ,  H04S3/00 ,  G06T19/20

CPC classification number: G06T15/005 ,  G06F3/165 ,  G06T19/20 ,  G10L21/038 ,  H04S3/008 ,  H04S7/303 ,  H04S2400/01 ,  H04S2400/11 ,  H04S2420/01

Abstract: A method comprising: causing detection of a modification of a visual appearance of a portion of the visual scene; causing determination that the portion of the visual scene that has been modified is or includes a first portion of the visual scene that has a corresponding first sound object; causing modification of the first sound object to modify a spatial extent of the first sound object; and causing rendering of the visual scene and the corresponding sound scene including rendering of the modified portion of the visual scene in the visual scene and rendering of the modified first sound object with modified spatial extent in the corresponding sound scene.