公开(公告)号：US11050993B2

公开(公告)日：2021-06-29

申请号：US16630061

申请日：2018-05-21

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Nobuo Sasaki

IPC: H04N13/122 ,  H04N13/15 ,  H04N13/366 ,  H04N13/106 ,  H04N13/344 ,  H04N13/117

Abstract: A position and posture acquiring section 250 of an image generating apparatus 200 acquires information related to the position and posture of the user's head. A view screen control section 252 sets a view screen corresponding to a viewpoint of the user. An original image manipulating section 254 determines displacement of pixels and acquires color values for an image corresponding to the viewpoint of the user such that an object appears fixed according to movement of the viewpoint of the user, and performs synthesis of color values in a color map corresponding to the viewpoint of a preceding frame, to acquire a new color map. A display image generating section 268 determines a value for each of the pixels in the view screen in accordance with a color map for a corresponding position to generate a display image. An output section 270 outputs the display image.

公开(公告)号：US10721456B2

公开(公告)日：2020-07-21

申请号：US16301828

申请日：2017-03-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nobuo Sasaki

IPC: G06K9/00 ,  G06T15/10 ,  H04N13/00 ,  B60R1/00 ,  H04N13/221 ,  H04N13/117 ,  H04N13/366 ,  H04N13/376 ,  H04N13/344 ,  H04N13/15 ,  H04N13/111

Abstract: A position and posture acquisition unit acquires viewpoint position information of a user. A viewscreen setting unit sets a viewscreen for the user. An original image operation unit calculates a correction amount for a pixel of the image from a parallax value of each pixel of an original image and an amount of movement of the viewpoint such that the object looks fixed, and generates, for each of left and right viewpoint, an image reference vector map. The image reference vector map includes an image reference vector that refers to the position of the object before correction from coordinates of each pixel after correction. A display image generation unit refers to the original image on the basis of the image reference vector corresponding to each pixel of the viewscreen to determine a color value.

公开(公告)号：US11120614B2

公开(公告)日：2021-09-14

申请号：US16642423

申请日：2018-06-14

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nobuo Sasaki

IPC: G06T15/20 ,  G06T15/04

Abstract: In an image generation apparatus, a virtual space generation section generates a virtual space in which an object and a virtual camera are arranged in accordance with input information acquired by an input information acquisition section. An intermediate image generation section draws the virtual space by a past technique. A curved surface generation section of a display image generation section generates, for each polygon of an object, a curved surface corresponding to the polygon. A pixel displacement acquisition section acquires a correspondence in pixel position between an image drawn with a planar polygon and a curved surface image. A drawing section determines color values of the pixels of the display image in accordance with the correspondence by referring to an original image. An output section outputs data of the display image generated as described above to a display apparatus.

公开(公告)号：US10607417B2

公开(公告)日：2020-03-31

申请号：US16301809

申请日：2017-01-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nobuo Sasaki ,  Atsushi Takizawa

IPC: G06T19/00 ,  H04N13/30 ,  H04N13/00 ,  H04N13/363 ,  G02B27/01 ,  G06F3/01 ,  G06T19/20

Abstract: A position/posture acquiring unit of image generating apparatus acquires information on the position and posture of the head of a user. A view screen control unit sets a view screen according to the point of view of a user. An original image operating unit disposes an original image in a virtual space and moves the position thereof in response to movement of the point of view of the user. In addition, the original image operating unit calculates the amount of displacement of pixels in such a manner that an object looks fixed. Thereby, the original image operating unit sets a reference vector for each pixel of the image plane. The original image operating unit decides the reference vector by interpolation regarding a pixel for which the reference vector is not set. A displayed image generating unit carries out mapping of the original image onto the view screen by using the obtained reference vectors to generate a displayed image. An output unit outputs the displayed image.

公开(公告)号：US10719991B2

公开(公告)日：2020-07-21

申请号：US16301014

申请日：2017-02-16

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nobuo Sasaki

IPC: H04N13/117 ,  G06T19/00 ,  H04N13/30 ,  H04N13/00 ,  H04N13/128 ,  H04N13/111 ,  H04N13/363 ,  G02B27/01 ,  G06F3/01 ,  G06T19/20

Abstract: A position and posture acquisition unit of an image generation apparatus acquires position information relating to a point of view of a user. A viewscreen setting unit sets a viewscreen. An original image operation unit calculates a correction amount for a pixel from parallax values of pixels of an original image and an amount of movement of the point of view such that an object looks fixed. Then, an image reference vector map in which an image reference vector that refers to a position before correction from coordinates of each pixel after correction is stored for each pixel is generated. A display image generation unit specifies an image reference vector corresponding to each pixel of the viewscreen and generates, based on the image reference vectors, a color value by filtering pixel values of reference destinations in the original image. An outputting unit outputs a display image.

公开(公告)号：US20190164354A1

公开(公告)日：2019-05-30

申请号：US16301809

申请日：2017-01-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nobuo Sasaki ,  Atsushi Takizawa

IPC: G06T19/20 ,  H04N13/363 ,  G02B27/01 ,  G06F3/01

Abstract: A position/posture acquiring unit of image generating apparatus acquires information on the position and posture of the head of a user. A view screen control unit sets a view screen according to the point of view of a user. An original image operating unit disposes an original image in a virtual space and moves the position thereof in response to movement of the point of view of the user. In addition, the original image operating unit calculates the amount of displacement of pixels in such a manner that an object looks fixed. Thereby, the original image operating unit sets a reference vector for each pixel of the image plane. The original image operating unit decides the reference vector by interpolation regarding a pixel for which the reference vector is not set. A displayed image generating unit carries out mapping of the original image onto the view screen by using the obtained reference vectors to generate a displayed image. An output unit outputs the displayed image.

公开(公告)号：US10999567B2

公开(公告)日：2021-05-04

申请号：US16629887

申请日：2017-08-01

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Nobuo Sasaki

IPC: H04N13/117 ,  H04N13/167 ,  H04N13/156 ,  H04N13/366 ,  H04N13/15 ,  H04N13/324

Abstract: When a predetermined condition based on an instruction input from a user or a change in a posture of the user is satisfied (N in S300), an original image manipulating section of an image generating apparatus acquires amounts of displacement of viewpoints of a viewer from base points with respect to an image stereoscopically viewed by the user on the basis of display of left and right parallax images (S302). On the basis of the amounts of displacement, the original image manipulating section acquires the amount of adjustment of the position of an image plane in a virtual space in which the parallax images are expressed (S304). In generating, from each pixel on the image plane, an image reference vector for referencing the original images of the parallax images, the original image manipulating section executes calculation reflecting the amount of adjustment of the position of the image plane to achieve adjustment of the position of the image plane (S306).

公开(公告)号：US10362297B2

公开(公告)日：2019-07-23

申请号：US15519295

申请日：2015-08-26

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Atsushi Takizawa ,  Nobuo Sasaki

IPC: H04N13/111 ,  H04N13/327 ,  G06T7/70 ,  H04N13/302 ,  H04N13/366 ,  H04N13/117

Abstract: A marker detection block 20 scans a taken image of a plurality of markers of a fixture worn on the head of a user so as to detect a two-dimensional coordinate on the taken image of the plurality of markers. A viewpoint position correction block 30 corrects a viewpoint position of the user without use of a coordinate in a Z direction of the markers but by use of the detected two-dimensional coordinate of the plurality of markers. A stereoscopic image generation block 40 generates a parallax image obtained when a three-dimensional object is viewed from the corrected viewpoint position.

公开(公告)号：US20190158809A1

公开(公告)日：2019-05-23

申请号：US16301828

申请日：2017-03-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nobuo Sasaki

IPC: H04N13/221 ,  H04N13/111 ,  H04N13/15

Abstract: A position and posture acquisition unit of an image generation apparatus acquires position information relating to a view point of a user. A viewscreen setting unit sets a viewscreen. An original image operation unit calculates a correction amount for a pixel from a parallax value of each pixel of an original image and an amount of movement of the view point such that an object looks fixed, and generates, for each of left and right view points, an image reference vector map in which an image reference vector that refers to the position before correction from coordinates of each pixel after correction is stored for each pixel. Along with this, depending upon the view point, the reference destination is set to an original image from a different view point. A display image generation unit refers to an original image on the basis of the image reference vector corresponding to each pixel of the viewscreen to determine a color value. An outputting unit outputs a display image.