-
1.
公开(公告)号:US11961205B2
公开(公告)日:2024-04-16
申请号:US17282214
申请日:2019-11-07
发明人: Artur Andreevich Grigoriev , Victor Sergeevich Lempitsky , Artem Mikhailovich Sevastopolsky , Alexander Timurovich Vakhitov
CPC分类号: G06T3/18 , G06N3/045 , G06N3/08 , G06T5/77 , G06T2207/20081 , G06T2207/20084
摘要: An image resynthesis system, a system for training a gap filling module to be used in the image resynthesis system, an image resynthesis method, a computer program product, and a computer-readable medium are provided. The image resynthesis system comprises a source image input module, a forward warping module predicting, for each source image pixel of a source image, a corresponding position in a target image, and predicting a forward warping field which is aligned with the source image, and a gap filling module filling in gaps resulting from application of the forward warping module.
-
公开(公告)号:US11367239B2
公开(公告)日:2022-06-21
申请号:US17284253
申请日:2019-11-08
发明人: Aliaksandra Petrovna Shysheya , Kara-Ali Alibulatovich Aliev , Renat Maratovich Bashirov , Egor Andreevich Burkov , Karim Zhamalovich Iskakov , Aleksei Aleksandrovich Ivakhnenko , Viktor Sergeevich Lempitsky , Yury Andreevich Malkov , Igor Igorevich Pasechnik , Dmitry Vladimirovich Ulyanov , Alexander Timurovich Vakhitov , Egor Olegovich Zakharov
摘要: The present invention relates generally to the field of computer vision and computer graphics to produce full body renderings of a person for varying person pose and camera positions and, in particular, to a system and method for synthesizing 2-D image of a person. The method for synthesizing 2-D image of a person comprises: receiving (S101) 3D coordinates of body joint positions of the person defined in a camera coordinate frame, wherein the 3D coordinates of the body joint positions define a pose of the person and a viewpoint of the 2-D image; predicting (S102), using a trained machine learning predictor, a map stack of body part assignments and a map stack of body part coordinates based on the 3D coordinates of the body joint positions, wherein the map stack of body part coordinates defines texture coordinates of pixels of the body parts of the person, the map stack of body part assignments defines weights, each weight indicating a probability of particular pixel to belong to a particular body part of the person; retrieving (S103), from a memory, a map stack of textures for the body parts of the person previously initialized, wherein the map stack of textures comprises values of the pixels of the body parts of the person; and reconstructing (S104) the 2-D image of the person as a weighted combination of the values of the pixels by using the map stack of body part assignments, the map stack of body part coordinates and the map stack of textures. The system for synthesizing 2-D image of a person implements the method for synthesizing 2-D image of a person.
-