公开(公告)号：US11688116B2

公开(公告)日：2023-06-27

申请号：US17411432

申请日：2021-08-25

Applicant: SONY GROUP CORPORATION ,  Sony Corporation of America

Inventor： Hiroyuki Takeda ,  Kendai Furukawa ,  Mohammad Gharavi-Alkhansari

IPC: G06T13/40 ,  G06T17/20 ,  G06T7/246 ,  H04N5/04 ,  H04N23/90

CPC classification number: G06T13/40 ,  G06T7/251 ,  G06T17/205 ,  H04N5/04 ,  H04N23/90 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201

Abstract: An electronic device and method of preservation of geometry details in tracked meshes is provided. A set of three-dimensional (3D) scans and a sequence of tracked meshes of an object of interest are acquired. The sequence of tracked meshes comprises a set of tracked meshes which temporally corresponds to the set of 3D scans. Based on differences between the set of tracked meshes and the set of 3D scans, a set of displacement maps is generated. A plurality of vectors is computed, each of which includes surface tension values associated with mesh vertices of a corresponding tracked mesh. Based on the set of displacement maps and a corresponding set of vectors, a neural network is trained on a task of displacement map generation. The trained neural network model is applied on the plurality of vectors to generate displacement maps. Each tracked mesh is updated based on a corresponding displacement map.

公开(公告)号：US11006135B2

公开(公告)日：2021-05-11

申请号：US16319909

申请日：2017-07-21

Applicant: SONY CORPORATION

Inventor： Tetsuya Fukuyasu ,  Kendai Furukawa

IPC: H04N19/30 ,  H04N19/597 ,  G09G5/14 ,  H04N13/00 ,  H04N21/462 ,  H04N21/4728

Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to suppress deterioration of picture quality of an image within a viewing range of a viewer. An image processing apparatus includes an image processing section that performs, based on priorities between a plurality of encoded streams obtained by encoding a plurality of projection images that are obtained by projecting an omnidirectional image to a plurality of faces or a plurality of viewpoint images from different viewpoints, decoding of the encoded streams and generation or selection of an image to be used for generation of a display image, and a drawing section that generates the display image based on the generated or selected image.

公开(公告)号：US11328379B2

公开(公告)日：2022-05-10

申请号：US16331379

申请日：2017-09-29

Applicant: SONY CORPORATION

Inventor： Kendai Furukawa ,  Junichi Tanaka ,  Yuichi Araki

IPC: G06T15/00 ,  G06T13/20 ,  G06T17/00 ,  G06T1/00 ,  G06T7/00 ,  G06T19/00 ,  B60R1/00

Abstract: There is provided an image processing apparatus and an image processing method that enable selection of viewpoints of depth images suitable for creation of a 3D model. A viewpoint determination unit determines that a candidate viewpoint be a viewpoint of a depth image of a 3D model on the basis of the 3D model projected on a screen from the candidate viewpoint. The present disclosure can be applied to, for example, an encoding device or the like that generates and encodes color images and depth images from predetermined viewpoints, from color images and depth images from a plurality of viewpoints of a 3D model of a subject.

公开(公告)号：US10694081B2

公开(公告)日：2020-06-23

申请号：US16081568

申请日：2017-02-24

Applicant: SONY CORPORATION

Inventor： Kendai Furukawa

IPC: H04N5/247 ,  H04N19/597 ,  G03B35/08 ,  G06T1/00 ,  G06T7/60 ,  H04N5/222 ,  H04N5/232 ,  G06T7/593

Abstract: The present disclosure relates to an information processing apparatus and an information processing method that are configured to be capable of efficiently acquiring information for use in generating three-dimensional data from two-dimensional image data. A grouping block sorts two or more virtual cameras for acquiring two-dimensional image data into two or more groups. A global table generation block generates a global table in which group information related with each of two or more groups is registered. A group table generation block generates, for each group, a group table in which camera information for use in generating three-dimensional data from two-dimensional image data acquired by a virtual camera sorted into a group is registered. The present disclosure is applicable to an encoding apparatus and the like, for example.

公开(公告)号：US10887571B2

公开(公告)日：2021-01-05

申请号：US16318431

申请日：2017-07-14

Applicant: SONY CORPORATION

Inventor： Kendai Furukawa ,  Junichi Tanaka ,  Hiroshi Oryoji ,  Yuichi Hasegawa ,  Goh Kobayashi

IPC: H04N13/117 ,  H04N13/00 ,  G06T19/00 ,  G06T15/20 ,  H04N13/282

Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.