公开(公告)号：US20210136510A1

公开(公告)日：2021-05-06

申请号：US16674924

申请日：2019-11-05

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/04 ,  G06N3/08

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.

公开(公告)号：US10701303B2

公开(公告)日：2020-06-30

申请号：US15937349

申请日：2018-03-27

Applicant: Adobe Inc.

Inventor： Oliver Wang ,  Pedro Morgado ,  Timothy Langlois

IPC: H04N5/60 ,  H04N5/04 ,  H04S7/00 ,  G06F3/16

Abstract: Certain embodiments involve generating and providing spatial audio using a predictive model. For example, a generates, using a predictive model, a visual representation of visual content provideable to a user device by encoding the visual content into the visual representation that indicates a visual element in the visual content. The system generates, using the predictive model, an audio representation of audio associated with the visual content by encoding the audio into the audio representation that indicates an audio element in the audio. The system also generates, using the predictive model, spatial audio based at least in part on the audio element and associating the spatial audio with the visual element. The system can also augment the visual content using the spatial audio by at least associating the spatial audio with the visual content.

公开(公告)号：US11967011B2

公开(公告)日：2024-04-23

申请号：US17653094

申请日：2022-03-01

Applicant: Adobe Inc.

Inventor： Kazi Rubaiat Habib ,  Timothy Langlois ,  Li-Yi Wei ,  John Simpson ,  James Corbett ,  Christopher Nuuja ,  Brooke Hopper

IPC: G06F3/04845 ,  G06T13/80

CPC classification number: G06T13/80 ,  G06F3/04845 ,  G06T2200/24

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and modifying digital animations based on user interactions with a unique user interface portraying a one-dimensional layer motion element and/or elements for generating and utilizing animation path for digital design objects and animation layers. The disclosed system can provide a dynamic one-dimensional layer motion element that adapts to a selected animation layer and portrays selectable animation frames from the animation layer. The disclosed systems can provide options for generating and modifying various frames of the digital animation based on user interactions with the one-dimensional layer motion element, an animation timeline, and/or a corresponding animation canvas. Additionally, in some embodiments, the disclosed systems also generate path animations with complex animation effects based on user selection of animation paths, digital design objects of animation layers, and corresponding selectable path animation feature tools.

公开(公告)号：US11812254B2

公开(公告)日：2023-11-07

申请号：US17515918

申请日：2021-11-01

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/08 ,  G06N3/04

CPC classification number: H04S7/305 ,  G06N3/04 ,  G06N3/08 ,  H04S7/307 ,  H04S2400/11

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.

公开(公告)号：US20230281903A1

公开(公告)日：2023-09-07

申请号：US17653090

申请日：2022-03-01

Applicant: Adobe Inc.

Inventor： Kazi Rubaiat Habib ,  Timothy Langlois ,  Li-Yi Wei ,  John Simpson ,  James Corbett ,  Christopher Nuuja ,  Brooke Hopper

IPC: G06T13/80 ,  G06T11/60 ,  G06F3/04845 ,  G06F3/04847

CPC classification number: G06T13/80 ,  G06T11/60 ,  G06F3/04845 ,  G06F3/04847 ,  G06T2200/24

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and modifying digital animations based on user interactions with a unique user interface portraying a one-dimensional layer motion element and/or elements for generating and utilizing animation path for digital design objects and animation layers. The disclosed system can provide a dynamic one-dimensional layer motion element that adapts to a selected animation layer and portrays selectable animation frames from the animation layer. The disclosed systems can provide options for generating and modifying various frames of the digital animation based on user interactions with the one-dimensional layer motion element, an animation timeline, and/or a corresponding animation canvas. Additionally, in some embodiments, the disclosed systems also generate path animations with complex animation effects based on user selection of animation paths, digital design objects of animation layers, and corresponding selectable path animation feature tools.

公开(公告)号：US11190898B2

公开(公告)日：2021-11-30

申请号：US16674924

申请日：2019-11-05

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/08 ,  G06N3/04

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.

公开(公告)号：US20190306451A1

公开(公告)日：2019-10-03

申请号：US15937349

申请日：2018-03-27

Applicant: Adobe Inc.

Inventor： Oliver Wang ,  Pedro Morgado ,  Timothy Langlois

IPC: H04N5/60 ,  H04N5/04

Abstract: Certain embodiments involve generating and providing spatial audio using a predictive model. For example, a generates, using a predictive model, a visual representation of visual content provideable to a user device by encoding the visual content into the visual representation that indicates a visual element in the visual content. The system generates, using the predictive model, an audio representation of audio associated with the visual content by encoding the audio into the audio representation that indicates an audio element in the audio. The system also generates, using the predictive model, spatial audio based at least in part on the audio element and associating the spatial audio with the visual element. The system can also augment the visual content using the spatial audio by at least associating the spatial audio with the visual content.

公开(公告)号：US12051143B2

公开(公告)日：2024-07-30

申请号：US17653090

申请日：2022-03-01

Applicant: Adobe Inc.

Inventor： Kazi Rubaiat Habib ,  Timothy Langlois ,  Li-Yi Wei ,  John Simpson ,  James Corbett ,  Christopher Nuuja ,  Brooke Hopper

IPC: G06T13/80 ,  G06F3/04845 ,  G06F3/04847 ,  G06T11/60

CPC classification number: G06T13/80 ,  G06F3/04845 ,  G06F3/04847 ,  G06T11/60 ,  G06T2200/24

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and modifying digital animations based on user interactions with a unique user interface portraying a one-dimensional layer motion element and/or elements for generating and utilizing animation path for digital design objects and animation layers. The disclosed system can provide a dynamic one-dimensional layer motion element that adapts to a selected animation layer and portrays selectable animation frames from the animation layer. The disclosed systems can provide options for generating and modifying various frames of the digital animation based on user interactions with the one-dimensional layer motion element, an animation timeline, and/or a corresponding animation canvas. Additionally, in some embodiments, the disclosed systems also generate path animations with complex animation effects based on user selection of animation paths, digital design objects of animation layers, and corresponding selectable path animation feature tools.

公开(公告)号：US20230281904A1

公开(公告)日：2023-09-07

申请号：US17653094

申请日：2022-03-01

Applicant: Adobe Inc.

Inventor： Kazi Rubaiat Habib ,  Timothy Langlois ,  Li-Yi Wei ,  John Simpson ,  James Corbett ,  Christopher Nuuja ,  Brooke Hopper

IPC: G06T13/80 ,  G06F3/04845

CPC classification number: G06T13/80 ,  G06F3/04845 ,  G06T2200/24

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and modifying digital animations based on user interactions with a unique user interface portraying a one-dimensional layer motion element and/or elements for generating and utilizing animation path for digital design objects and animation layers. The disclosed system can provide a dynamic one-dimensional layer motion element that adapts to a selected animation layer and portrays selectable animation frames from the animation layer. The disclosed systems can provide options for generating and modifying various frames of the digital animation based on user interactions with the one-dimensional layer motion element, an animation timeline, and/or a corresponding animation canvas. Additionally, in some embodiments, the disclosed systems also generate path animations with complex animation effects based on user selection of animation paths, digital design objects of animation layers, and corresponding selectable path animation feature tools.

公开(公告)号：US20220060842A1

公开(公告)日：2022-02-24

申请号：US17515918

申请日：2021-11-01

Applicant: Adobe Inc.

Inventor： Zhenyu Tang ,  Timothy Langlois ,  Nicholas Bryan ,  Dingzeyu Li

IPC: H04S7/00 ,  G06N3/08 ,  G06N3/04

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for rendering scene-aware audio based on acoustic properties of a user environment. For example, the disclosed system can use neural networks to analyze an audio recording to predict environment equalizations and reverberation decay times of the user environment without using a captured impulse response of the user environment. Additionally, the disclosed system can use the predicted reverberation decay times with an audio simulation of the user environment to optimize material parameters for the user environment. The disclosed system can then generate an audio sample that includes scene-aware acoustic properties based on the predicted environment equalizations, material parameters, and an environment geometry of the user environment. Furthermore, the disclosed system can augment training data for training the neural networks using frequency-dependent equalization information associated with measured and synthetic impulse responses.