公开(公告)号：US12039657B2

公开(公告)日：2024-07-16

申请号：US17204571

申请日：2021-03-17

Applicant: ADOBE INC.

Inventor： Oliver Wang ,  Simon Niklaus ,  Zhengqi Li

IPC: G06T15/04 ,  G06T7/557 ,  G06T7/90 ,  G06T15/50

CPC classification number: G06T15/04 ,  G06T7/557 ,  G06T7/90 ,  G06T15/506 ,  G06T2207/10016 ,  G06T2207/20084 ,  G06T2207/30244

Abstract: Embodiments of the technology described herein, provide a view and time synthesis of dynamic scenes captured by a camera. The technology described herein represents a dynamic scene as a continuous function of both space and time. The technology may parameterize this function with a deep neural network (a multi-layer perceptron (MLP)), and perform rendering using volume tracing. At a very high level, a dynamic scene depicted in the video may be used to train the MLP. Once trained, the MLP is able to synthesize a view of the scene at a time and/or camera pose not found in the video through prediction. As used herein, a dynamic scene comprises one or more moving objects.

公开(公告)号：US20220301252A1

公开(公告)日：2022-09-22

申请号：US17204571

申请日：2021-03-17

Applicant: ADOBE INC.

Inventor： Oliver Wang ,  Simon Niklaus ,  Zhengqi Li

IPC: G06T15/04 ,  G06T7/557 ,  G06T7/90 ,  G06T15/50

Abstract: Embodiments of the technology described herein, provide a view and time synthesis of dynamic scenes captured by a camera. The technology described herein represents a dynamic scene as a continuous function of both space and time. The technology may parameterize this function with a deep neural network (a multi-layer perceptron (MLP)), and perform rendering using volume tracing. At a very high level, a dynamic scene depicted in the video may be used to train the MLP. Once trained, the MLP is able to synthesize a view of the scene at a time and/or camera pose not found in the video through prediction. As used herein, a dynamic scene comprises one or more moving objects.