公开(公告)号：US20250037621A1

公开(公告)日：2025-01-30

申请号：US18360736

申请日：2023-07-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G09G3/00 ,  G02B27/01 ,  G02C5/02 ,  G06F3/01

Abstract: A wearable device is described. The wearable device includes a first display portion and a second display portion. The first display portion is located in front of eyes of a user to provide a high-resolution view of a virtual image of a virtual scene. The second display portion is located in front of the eyes of the user to provide a view of the user's nose. The second display portion can optionally occlude an area around the nose and optionally provide an effect of virtual lighting falling on the nose. The wearable device presents a view of the user's real nose as it would appear in a virtual scene.

公开(公告)号：US12189837B2

公开(公告)日：2025-01-07

申请号：US17731174

申请日：2022-04-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G06F3/01 ,  G01B5/004 ,  G01C19/5783 ,  G01P13/00 ,  G06T7/70

Abstract: Systems and methods for determining movement of a hand-held controller (HHC) with respect to a head-mounted display (HMD) are described. A camera is located at a lower region of the HMD for capturing images of the HHC. The images of the HHC are used to determine a position and an orientation of the HHC with reference to the HMD. Also, the camera or another camera can be used to determine a position and orientation of the HMD with respect to a real-world environment. The position and orientation of the HMD and the position and orientation of the HHC are used to change to state of an application executed on a game cloud.

公开(公告)号：US11969650B2

公开(公告)日：2024-04-30

申请号：US17530329

申请日：2021-11-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Todd Tokubo

IPC: A63F13/65 ,  A63F13/46 ,  A63F13/56 ,  G06N20/00

CPC classification number: A63F13/46 ,  A63F13/56 ,  A63F13/65 ,  G06N20/00 ,  A63F2300/8082

Abstract: Methods and systems are provided for processing feature similarity for a real-world space used for augmented reality (AR) gameplay is disclosed. The method includes receiving captured sensor data from the real-world space used by a user for said AR gameplay of a game. The sensor data provides data to identify characteristics of physical objects in the real-world space. The method includes generating a user space score using the characteristics of the physical objects identified in the real-world space. The method includes comparing the user space score to a game space score that is predefined for the game. The comparing is used to produce a fit handicap for the AR gameplay of the game in the real-world space by the user. Adjustments to gameplay parameters may be made to compensate or adjust the fit handicap.

公开(公告)号：US11695488B2

公开(公告)日：2023-07-04

申请号：US17390880

申请日：2021-07-31

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey R. Stafford ,  Todd Tokubo

IPC: H04N13/388 ,  H04H60/83 ,  H04H60/88 ,  H04H60/70 ,  H04N21/478 ,  H04N13/183

CPC classification number: H04H60/83 ,  H04H60/70 ,  H04H60/88 ,  H04N13/183 ,  H04N13/388 ,  H04N21/4781

Abstract: Techniques are described for using the Advanced Television Systems Committee (ATSC) 3.0 television protocol to deliver volumetric information for presentation on various displays using ATSC over-the-air communications channels.

公开(公告)号：US11347303B2

公开(公告)日：2022-05-31

申请号：US16207029

申请日：2018-11-30

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: G01C19/5783 ,  G06F3/01 ,  G06T7/70 ,  G01B5/004 ,  G01P13/00

Abstract: Systems and methods for determining movement of a hand-held controller (HHC) with respect to a head-mounted display (HMD) are described. A camera is located at a lower region of the HMD for capturing images of the HHC. The images of the HHC are used to determine a position and an orientation of the HHC with reference to the HMD. Also, the camera or another camera can be used to determine a position and orientation of the HMD with respect to a real-world environment. The position and orientation of the HMD and the position and orientation of the HHC are used to change to state of an application executed on a game cloud.

公开(公告)号：US11327708B2

公开(公告)日：2022-05-10

申请号：US17069832

申请日：2020-10-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn T. Black ,  Michael G. Taylor ,  Todd Tokubo

IPC: G06F3/147 ,  A63F13/211 ,  A63F13/26 ,  A63F13/25 ,  A63F13/86 ,  A63F13/87 ,  A63F13/212 ,  A63F13/213 ,  A63F13/5255 ,  G06F1/16 ,  G06F3/0481 ,  G06F3/04845 ,  G06F3/0488 ,  G06T19/00

Abstract: A computer-implemented method for processing operations for integrating audience participation content into virtual reality (VR) content presented by a head mounted display (HMD) of an HMD user is provided. The method includes providing a VR scene to the HMD of the HMD user and receiving indications from one or more spectator devices of respective one or more spectators. The indications corresponding to requests for audience participation content for participating in the VR scene. The method includes sending audience participation content to the one or more spectator devices. The audience participation content configured to be displayed on respective displays associated with the one or more spectator devices. The audience participation content further includes interactive content for obtaining spectator input from the one or more spectators via the one or more spectator devices, respectively. The method includes augmenting the VR scene based on the spectator inputs in response to the interactive content of the audience participation content.

公开(公告)号：US20210370172A1

公开(公告)日：2021-12-02

申请号：US17386468

申请日：2021-07-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn T. Black ,  Michael G. Taylor ,  Todd Tokubo

IPC: A63F13/537 ,  A63F13/58 ,  A63F13/5375 ,  A63F13/26 ,  A63F13/56 ,  A63F13/5372 ,  A63F13/213 ,  A63F13/5378 ,  A63F13/86 ,  G06T7/73 ,  G06F3/01 ,  G06K9/00 ,  G06T11/60 ,  G10L17/22

Abstract: Systems and methods for receiving a scene by a head mounted display (HMD) of an HMD user. One method includes receiving image data of a real world space where the HMD is located. The image data is analyzed to identify positional data on the one or more spectators present in the real world space. The method includes identifying, based on the positional data, that a personal space of a spectator is being encroached. The identifying causing an indicator to alert the HMD user of said encroachment of said personal space of the spectator.

公开(公告)号：US20210312301A1

公开(公告)日：2021-10-07

申请号：US16837969

申请日：2020-04-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mahdi Azmandian ,  Xiaoyong Ye ,  Todd Tokubo

IPC: G06N5/04 ,  G06N20/00 ,  G06K9/00 ,  A63F13/79

Abstract: Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model. The processing is configured to generate a recommendation to the user regarding an action to take to progress in the game during said current gameplay.

公开(公告)号：US11128730B2

公开(公告)日：2021-09-21

申请号：US16749225

申请日：2020-01-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran ,  Todd Tokubo

IPC: G06F15/16 ,  H04L29/08 ,  H04L29/06 ,  H04N19/597 ,  H04N21/2343 ,  H04N21/6373 ,  H04N21/81

Abstract: Predictive pre-fetching of streams for 360 degree video is described. User view orientation metadata is obtained for a 360 degree video stream that includes data for a plurality of viewports. Data corresponding to one or more high-resolution frames for a particular one of the viewports is pre-fetched based on the user view orientation metadata and those frames are displayed. The high resolution frames are characterized by a higher resolution than for remaining viewports.

公开(公告)号：US10585472B2

公开(公告)日：2020-03-10

申请号：US15337469

申请日：2016-10-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Todd Tokubo ,  Steven Osman ,  Jeffrey Roger Stafford ,  Crusoe Xiadong Mao ,  Glenn Black

IPC: G02B27/01 ,  G06F3/01 ,  G09G5/14 ,  H04S7/00 ,  A63F13/53 ,  A63F13/213 ,  A63F13/25 ,  A63F13/211 ,  G09G3/00 ,  G06F3/147 ,  G06F3/16 ,  A63F13/32 ,  A63F13/54 ,  A63F13/30

Abstract: A method is provided, including the following method operations: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images and the inertial data to determine a current and predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; generating image data depicting a view of a virtual environment for the HMD, wherein regions of the view are differentially rendered; generating audio data depicting sounds from the virtual environment, the audio data being configured to enable localization of the sounds by the user; transmitting the image data and the audio data via the RF transceiver to the HMD.