公开(公告)号：US11190898B2

公开(公告)日：2021-11-30

申请号：US16674924

申请日：2019-11-05

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/08 ,  G06N3/04

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.

公开(公告)号：US20220060842A1

公开(公告)日：2022-02-24

申请号：US17515918

申请日：2021-11-01

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/08 ,  G06N3/04

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.

公开(公告)号：US20210136510A1

公开(公告)日：2021-05-06

申请号：US16674924

申请日：2019-11-05

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/04 ,  G06N3/08

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.

公开(公告)号：US11812254B2

公开(公告)日：2023-11-07

申请号：US17515918

申请日：2021-11-01

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/08 ,  G06N3/04

CPC classification number: H04S7/305 ,  G06N3/04 ,  G06N3/08 ,  H04S7/307 ,  H04S2400/11

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.