公开(公告)号：US20220294935A1

公开(公告)日：2022-09-15

申请号：US17617728

申请日：2019-07-01

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Kazuyuki ARIMATSU ,  Hideki MORI

IPC: H04N5/225 ,  G06F3/044

Abstract: Provided is an information processing device coupled to a device which a user operates with a hand of the user and on the surface of which a plurality of sensors that each output information associated with a spatial positional relation with the surface of the hand of the user are arranged, the information processing device being configured to receive output from each of the sensors included in the device and generate an image in which an image element having been drawn with a pixel value determined on the basis of a value represented by the output from each of the sensors is arranged at a position corresponding to a position at which each of the sensors is arranged, on a mapping space obtained by plane-unfolding a portion that constitutes the surface of the device and on which the sensors are arranged, Further, the information processing device is configured to, upon receipt of input of the generated image, estimate information associated with the position of each of joints of the hand of the user who operates the device and output the estimated information as coordinate information in a three-dimensional space whose origin is placed on a point that moves with the device.

公开(公告)号：US20240223738A1

公开(公告)日：2024-07-04

申请号：US18561729

申请日：2021-05-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Kazuyuki ARIMATSU ,  Masaaki HAMADA ,  Hiroyuki KAWAHARA

IPC: H04N13/117 ,  G06T7/50 ,  G06T7/90 ,  G06T15/06 ,  H04N13/194

CPC classification number: H04N13/117 ,  G06T7/50 ,  G06T7/90 ,  G06T15/06 ,  H04N13/194 ,  G06T2207/10024

Abstract: A viewpoint setting unit of an image data generation device sets a reference viewpoint on a basis of position and orientation information regarding a head-mounted display, and a reference image drawing unit generates a reference image in a field of view corresponding to the reference viewpoint. An additional data generation unit acquires color information regarding an occluded part not represented in the reference image from a different viewpoint as additional sampling data. A reprojection unit of the head-mounted display transforms the reference image into an image from a latest viewpoint and determines a pixel value of the hidden part using the additional sampling data.