公开(公告)号：US20230123532A1

公开(公告)日：2023-04-20

申请号：US18083354

申请日：2022-12-16

申请人： SAMSUNG ELECTRONICS CO., LTD.

发明人： Gleb STERKIN ,  Pavel Ilyich SOLOVEV ,  Denis Mikhaylovich KORZHENKOV ,  Victor Sergeevich LEMPITSKY ,  Taras Andreevich KHAKHULIN

IPC分类号： G06T15/50 ,  G06T15/08 ,  G06T15/10 ,  G06T7/90 ,  G06T7/50 ,  G06T17/20

摘要： The present disclosure relates to the field of artificial intelligence (AI) and neural rendering, and particularly to a method of generating a multi-layer representation of a scene using neural networks trained in an end-to-end fashion and to a computing device implementing the method. The method of generating a multi-layer representation of a scene includes: obtaining a pair of images of the scene, the pair of the images comprising a reference image and a source image; performing a reprojection operation on the pair of images to generate a plane-sweep volume; predicting, using a geometry network, a layered structure of the scene based on the plane-sweep volume; and estimating, using a coloring network, color values and opacity values for the predicted layered structure of the scene to obtain the multi-layer representation of the scene; wherein the geometry network and the coloring network are trained in end-to-end manner.