公开(公告)号：US11474361B2

公开(公告)日：2022-10-18

申请号：US16872916

申请日：2020-05-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nicolas Doucet ,  Yutaka Yokokawa ,  Masafumi Noda ,  Takumi Yoshida ,  Keiichiro Ishihara ,  Gento Morita ,  Yuki Miyamae ,  Ngo Tuyen Thibaud ,  Kazutomo Sasaki

IPC: G06F3/01 ,  G02B27/01 ,  A63F13/212 ,  A63F13/40 ,  A63F13/211 ,  A63F13/825 ,  A63F13/95 ,  A63F13/26 ,  G06F3/03 ,  G06F3/04815

Abstract: A display control apparatus includes: a head mounted display information acquisition block configured to acquire information indicative of a position of a head mounted display worn on a head of a user; an input apparatus information acquisition block configured to acquire information indicative of a position of an input apparatus for use by the user; an instruction input acquisition block configured to acquire information indicative of an instruction entered in the input apparatus; and an image generation block configured to generate an image to be displayed on the head mounted display on a basis of an instruction acquired by the instruction input acquisition block. The image generation block displays an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus.

公开(公告)号：US20220163800A1

公开(公告)日：2022-05-26

申请号：US17104539

申请日：2020-11-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yutaka Yokokawa

IPC: G02B27/01 ,  G06F3/041 ,  G02B27/00 ,  A63F13/23 ,  G06N3/02

Abstract: An image from a camera on, e.g., a VR HMD is identified of a hand grasping a computer game controller. The image may be cropped to a region containing the controller and the hand to simplify processing, and a virtual representation of the hand is presented on a display such as the HMD, with the virtual representation being generated based on both image analysis of the region and a touch signal from the controller.

公开(公告)号：US20200171385A1

公开(公告)日：2020-06-04

申请号：US16784338

申请日：2020-02-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nicolas Doucet ,  Yutaka Yokokawa ,  Gento Morita ,  Keiichiro Ishihara ,  Yuki Miyamae ,  Kazutomo Sasaki ,  Ngo Tuyen Thibaud ,  Masafumi Noda ,  Takumi Yoshida

IPC: A63F13/52 ,  A63F13/213 ,  A63F13/53 ,  G06F3/0481 ,  A63F13/26 ,  A63F13/212 ,  A63F13/5255 ,  A63F13/211 ,  G06T19/00 ,  G06F3/01 ,  A63F13/214 ,  A63F13/235 ,  A63F13/25

Abstract: Methods and apparatus for controlling a display include: acquiring information indicative of first entered instructions from a first input apparatus used by a first user wearing a head mounted display and information indicative of second entered instructions from a second input apparatus used by a second user enabled to view a display apparatus; controlling, in a virtual three-dimensional space, an event on the basis of one or more of the first entered instructions and the second entered instructions acquired; generating a first image of said virtual three-dimensional space to be displayed on said head mounted display; and generating a second image of said virtual three-dimensional space to be displayed on said display apparatus, where the first image includes the first input apparatus, and where the second image does not include the second input apparatus.

公开(公告)号：US10166477B2

公开(公告)日：2019-01-01

申请号：US15312495

申请日：2015-03-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yuki Miyamae ,  Masafumi Noda ,  Takumi Yoshida ,  Keiichiro Ishihara ,  Gento Morita ,  Yutaka Yokokawa ,  Nicolas Doucet

IPC: A63F13/655 ,  A63F13/428 ,  G06F3/01 ,  G06K9/78 ,  G06T19/00 ,  H04N5/262 ,  A63F13/20 ,  A63F13/25 ,  A63F13/35 ,  A63F13/52 ,  G06T7/246 ,  G06K9/00 ,  G06T5/00 ,  G06T19/20 ,  A63F13/65 ,  A63F13/213 ,  A63F13/5372

Abstract: A game device includes: a detecting section configured to obtain an imaged image imaged by an imaging device, and detect a tracking object included in the obtained imaged image; a control section configured to calculate a position in which to display a predetermined image according to a position in which the tracking object is detected; and an image generating section configured to generate a display image displaying the predetermined image in the position calculated by the control section in the imaged image such that the predetermined image is superimposed on the imaged image, and display the generated display image on a display device.

公开(公告)号：US20180015367A1

公开(公告)日：2018-01-18

申请号：US15714264

申请日：2017-09-25

Applicant: c/o Sony Interactive Entertainment Inc.

Inventor： Yutaka Yokokawa ,  Nicolas Doucet ,  Keiichiro Ishihara

IPC: A63F13/428 ,  A63F13/426 ,  A63F13/2145 ,  G06F3/01 ,  A63F13/31 ,  A63F13/23 ,  A63F13/20

CPC classification number: A63F13/428 ,  A63F13/20 ,  A63F13/2145 ,  A63F13/23 ,  A63F13/31 ,  A63F13/426 ,  G06F3/011

Abstract: Disclosed herein is an information processing apparatus, including: an image acceptance section configured to accept an image of an operation inputting apparatus picked up by an imaging section; an operation signal acceptance section configured to accept an operation signal representative of an operation for the operation inputting apparatus from the operation inputting apparatus; and a process execution section configured to execute a process in response to the position of the operation inputting apparatus in the image accepted by the image acceptance section and the operation signal accepted by the operation signal acceptance section.

公开(公告)号：US11996066B2

公开(公告)日：2024-05-28

申请号：US16742200

申请日：2020-01-14

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yutaka Yokokawa ,  Jeffrey R. Stafford

IPC: G09G5/02 ,  G02B27/01 ,  G09G3/36

CPC classification number: G09G5/026 ,  G02B27/0172 ,  G09G3/3607 ,  G02B2027/0178 ,  G09G2310/0291 ,  G09G2340/06

Abstract: Alpha values from an image frame buffer are used to control one or more of a transparent display and an occlusion screen adjacent to the transparent display to render images with coloring perceptible to a person viewing the transparent display.

公开(公告)号：US11660536B2

公开(公告)日：2023-05-30

申请号：US17486200

申请日：2021-09-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nicolas Doucet ,  Yutaka Yokokawa ,  Gento Morita ,  Keiichiro Ishihara ,  Yuki Miyamae ,  Kazutomo Sasaki ,  Ngo Tuyen Thibaud ,  Masafumi Noda ,  Takumi Yoshida

IPC: A63F13/52 ,  A63F13/25 ,  A63F13/5255 ,  A63F13/53 ,  G06F3/01 ,  G06T19/00 ,  G02B27/01 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/214 ,  A63F13/235 ,  A63F13/26 ,  G06F3/0481

CPC classification number: A63F13/52 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/214 ,  A63F13/235 ,  A63F13/25 ,  A63F13/26 ,  A63F13/5255 ,  A63F13/53 ,  G06F3/012 ,  G06F3/0481 ,  G06T19/006 ,  A63F2300/8082 ,  G02B27/017 ,  G06T19/003

Abstract: Methods and apparatus provide for carrying out a method for rendering a virtual-three dimensional space on a display, including: acquiring information indicative of a position of a head mounted display worn on a head of a user; acquiring information indicative of a position of an input apparatus for use by the user; acquiring information indicative of an instruction entered in the input apparatus; and generating an image of the virtual three-dimensional space to be displayed on the head mounted display at a viewpoint position and a sightline direction, where the generating includes generating an image of the input apparatus at the position in the image determined on a basis of a relative position with the head mounted display of the input apparatus, and where the generating includes generating an image of a hand of the user when the user controls the input apparatus.

公开(公告)号：US11635802B2

公开(公告)日：2023-04-25

申请号：US16741285

申请日：2020-01-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey R. Stafford ,  Xiaoyong Ye ,  Yutaka Yokokawa

IPC: G02B27/01 ,  G06F3/01 ,  H04N23/11

Abstract: To facilitate control of an AR HMD, a camera unit in a camera sensor system generates RGB/IR images and the system also extrapolates images for times in the future based on light intensity change signals from an event detection sensor (EDS) for HMD pose tracking, hand tracking, and eye tracking. The times in the future are provided by an HMD application which defines the future times, and the RGB/IR images and extrapolated images are sent back to the application. In this way, the camera sensor system enables improved performance tracking (equivalent to using very high-speed camera) at lower bandwidth and power consumption.

公开(公告)号：US11448884B2

公开(公告)日：2022-09-20

申请号：US17104539

申请日：2020-11-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Yutaka Yokokawa

IPC: G02B27/01 ,  G02B27/00 ,  G06F3/041 ,  G06N3/02 ,  A63F13/23

Abstract: An image from a camera on, e.g., a VR HMD is identified of a hand grasping a computer game controller. The image may be cropped to a region containing the controller and the hand to simplify processing, and a virtual representation of the hand is presented on a display such as the HMD, with the virtual representation being generated based on both image analysis of the region and a touch signal from the controller.

公开(公告)号：US11373342B2

公开(公告)日：2022-06-28

申请号：US16742046

申请日：2020-01-14

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey R. Stafford ,  Yutaka Yokokawa

IPC: G06T11/00 ,  G02B27/01 ,  G06F3/01

Abstract: To improve the social interaction and interaction with external objects for a user wearing an AR head-mounted display (HMD), cameras on the HMD detect that other users (“social targets”) are looking at and/or speaking to the user. The region around the social target in the AR user's view is determined and in response an optical occlusion system in the HMD is changed to allow more outside light to reveal the HMD user's eyes to the other users, The HMD optionally decreases the brightness of the virtual images presented in the HMD to allow the HMD user to improve his real world social and scene interaction.