公开(公告)号：US20240013497A1

公开(公告)日：2024-01-11

申请号：US18252118

申请日：2020-12-21

Applicant: Google LLC

Inventor： Deqing Sun ,  Varun Jampani ,  Gengshan Yang ,  Daniel Vlasic ,  Huiwen Chang ,  Forrester H. Cole ,  Ce Liu ,  William Tafel Freeman

IPC: G06T19/20 ,  G06T7/55 ,  G06T17/20 ,  G06T7/20 ,  G06T7/40

CPC classification number: G06T19/20 ,  G06T7/55 ,  G06T17/20 ,  G06T7/20 ,  G06T7/40 ,  G06T2207/30244 ,  G06T2207/10016 ,  G06T2207/20084 ,  G06T2219/2021 ,  G06T2207/20081

Abstract: A computing system and method can be used to render a 3D shape from one or more images. In particular, the present disclosure provides a general pipeline for learning articulated shape reconstruction from images (LASR). The pipeline can reconstruct rigid or nonrigid 3D shapes. In particular, the pipeline can automatically decompose non-rigidly deforming shapes into rigid motions near rigid-bones. This pipeline incorporates an analysis-by-synthesis strategy and forward-renders silhouette, optical flow, and color images which can be compared against the video observations to adjust the internal parameters of the model. By inverting a rendering pipeline and incorporating optical flow, the pipeline can recover a mesh of a 3D model from the one or more images input by a user.