公开(公告)号：US20200264701A1

公开(公告)日：2020-08-20

申请号：US16814873

申请日：2020-03-10

Applicant: Sony Interactive Entertainment Inc.

Inventor： Todd Tokubo ,  Steven Osman ,  Jeffrey Roger Stafford ,  Crusoe Xiadong Mao ,  Glenn Black

IPC: G06F3/01 ,  G09G5/14 ,  H04S7/00 ,  A63F13/53 ,  A63F13/213 ,  A63F13/25 ,  A63F13/211 ,  G09G3/00 ,  G06F3/147 ,  G06F3/16 ,  A63F13/32 ,  A63F13/54

Abstract: A method is provided, including: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images of the interactive environment and the inertial data to determine a predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver in a direction that is towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; predicting a movement of the gaze of the user; generating video depicting a view of a virtual environment for the HMD; wherein the regions of the view are rendered differently based on the predicted movement of the gaze of the user; wirelessly transmitting the video via the RF transceiver to the HMD using the adjusted beamforming direction.

公开(公告)号：US10389841B2

公开(公告)日：2019-08-20

申请号：US15481324

申请日：2017-04-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran ,  Todd Tokubo

IPC: G06F15/16 ,  H04L29/08 ,  H04L29/06

Abstract: Predictive pre-fetching of streams for 360 degree video is described. User view orientation metadata is obtained for a 360 degree video stream that includes data for a plurality of viewports. Data corresponding to one or more high-resolution frames for a particular one of the viewports is pre-fetched based on the user view orientation metadata and those frames are displayed. The high resolution frames are characterized by a higher resolution than for remaining viewports.

公开(公告)号：US20190113967A1

公开(公告)日：2019-04-18

申请号：US16209903

申请日：2018-12-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Todd Tokubo

IPC: G06F3/01 ,  A63F13/53 ,  A63F13/332 ,  G06F3/03 ,  H04B7/06 ,  A63F13/212 ,  A63F13/5255 ,  A63F13/211 ,  A63F13/25 ,  H04B7/04 ,  A63F13/327 ,  A63F13/235 ,  A63F13/213 ,  G02B27/01

Abstract: A wireless communication system for use by a head-mounted display (HMD), including: the HMD having a band for attachment to a head of a user; the wireless communication system includes an antenna disposed on a top side of the band of the HMD, the antenna configured to receive an RF signal from an RF transmitter, the RF signal including video data that is encoded in a compressed format; the wireless communication system includes a receiver configured to decode the RF signal received through the antenna; the HMD includes a display configured to render the video data.

公开(公告)号：US20180096519A1

公开(公告)日：2018-04-05

申请号：US15283144

申请日：2016-09-30

Applicant: Sony Interactive Entertainment Inc.

Inventor： Todd Tokubo

IPC: G06T15/20 ,  G06F3/01 ,  G06T19/00 ,  G06T19/20 ,  A63F13/25 ,  A63F13/213 ,  A63F13/30

CPC classification number: G06T15/205 ,  A63F13/211 ,  A63F13/213 ,  A63F13/25 ,  A63F13/30 ,  A63F13/5255 ,  A63F13/537 ,  A63F13/56 ,  A63F13/843 ,  A63F13/92 ,  A63F2300/8082 ,  G02B27/01 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/0187 ,  G06F1/1626 ,  G06F1/1686 ,  G06F1/1694 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0346 ,  G06F3/04815 ,  G06T19/006 ,  G06T19/20

Abstract: A method is provided, including the following method operations: tracking a location of a head-mounted display (HMD) in a real space; rendering to the HMD a first view of a virtual reality (VR) space, the first view of the VR space being defined from a perspective determined by the location of the HMD in the real space; tracking a location of a portable device in the real space; rendering to the portable device a second view of the VR space, the second view of the VR space being defined from a perspective determined by the location of the portable device in the real space relative to the location of the HMD in the real space.

公开(公告)号：US20170045941A1

公开(公告)日：2017-02-16

申请号：US15337469

申请日：2016-10-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Todd Tokubo ,  Steven Osman ,  Jeffrey Roger Stafford ,  Xiadong Mao ,  Glenn Black

IPC: G06F3/01 ,  G06F3/16 ,  G06T3/40 ,  G09G5/14 ,  A63F13/211 ,  A63F13/53 ,  A63F13/30 ,  A63F13/213 ,  A63F13/25 ,  G06T7/00 ,  H04S7/00

CPC classification number: G06F3/013 ,  A63F13/211 ,  A63F13/213 ,  A63F13/25 ,  A63F13/30 ,  A63F13/32 ,  A63F13/53 ,  A63F13/54 ,  A63F2300/6081 ,  A63F2300/6615 ,  G06F3/147 ,  G06F3/167 ,  G09G3/003 ,  G09G5/14 ,  G09G2340/0407 ,  G09G2354/00 ,  G09G2370/16 ,  H04S7/303 ,  H04S7/304 ,  H04S2400/11 ,  H04S2420/01

Abstract: A method is provided, including the following method operations: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images and the inertial data to determine a current and predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; generating image data depicting a view of a virtual environment for the HMD, wherein regions of the view are differentially rendered; generating audio data depicting sounds from the virtual environment, the audio data being configured to enable localization of the sounds by the user; transmitting the image data and the audio data via the RF transceiver to the HMD.

Abstract translation: 提供了一种方法，包括以下方法操作：接收其中设置头戴式显示器（HMD）的交互式环境的捕获图像; 接收从HMD的至少一个惯性传感器处理的惯性数据; 分析捕获的图像和惯性数据以确定HMD的当前和预测的未来位置; 使用HMD的预测未来位置来调整RF收发器的波束成形方向朝向HMD的预测未来位置; 跟踪HMD用户的目光; 生成描绘用于HMD的虚拟环境的视图的图像数据，其中视图的区域被差分地呈现; 生成描绘来自所述虚拟环境的声音的音频数据，所述音频数据被配置为使得所述用户能够对所述声音进行定位; 通过RF收发器将图像数据和音频数据发送到HMD。

公开(公告)号：US12290753B2

公开(公告)日：2025-05-06

申请号：US16674827

申请日：2019-11-05

Applicant: Sony Interactive Entertainment Inc.

Inventor： Joshua M. Eads ,  Matthew D. Bennett ,  Brendan Matera Rehon ,  Mahdi Azmandian ,  Zhenhao Ge ,  Todd Tokubo

IPC: A63F13/67 ,  A63F13/45

Abstract: The performance of a player of a computer game is noted and the player accorded a latency handicap based thereon. The latency handicap is used to slow down play of the computer game, preferably only during times of high player activity. The latency handicap can be reduced over time or owing to improvement in the player's performance.

公开(公告)号：US20240335740A1

公开(公告)日：2024-10-10

申请号：US18296054

申请日：2023-04-05

Applicant: Sony Interactive Entertainment Inc.

Inventor： Celeste Bean ,  Todd Tokubo

IPC: A63F13/42 ,  A63F13/213 ,  A63F13/58 ,  G06F3/01 ,  G06F40/58 ,  G06T11/00 ,  G06V20/40 ,  G06V40/20

CPC classification number: A63F13/42 ,  A63F13/213 ,  A63F13/58 ,  G06F3/017 ,  G06F40/58 ,  G06T11/00 ,  G06V20/40 ,  G06V40/28

Abstract: A method is provided, including the following operations: receiving video of a first user; processing the video to identify signed communications in a first sign language made by the first user; translating the signed communications in the first sign language into signed communications in a second sign language; rendering an avatar of the user performing the translated signed communications in the second sign language; presenting the avatar on a display for viewing by a second user.

公开(公告)号：US12092834B2

公开(公告)日：2024-09-17

申请号：US18308559

申请日：2023-04-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Dennis Castleman ,  Todd Tokubo ,  Victoria Dorn

IPC: G02B27/01 ,  B81B7/02 ,  G01L19/14

CPC classification number: G02B27/0176 ,  B81B7/02 ,  G01L19/14 ,  B81B2201/0264 ,  G02B2027/0178

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

公开(公告)号：US11813517B2

公开(公告)日：2023-11-14

申请号：US17574478

申请日：2022-01-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Todd Tokubo

IPC: A63F13/213 ,  A63F13/212 ,  G06F3/01 ,  A63F13/211 ,  A63F13/5255 ,  G06F3/03 ,  G06V40/10

CPC classification number: A63F13/213 ,  A63F13/211 ,  A63F13/212 ,  A63F13/5255 ,  G06F3/011 ,  G06F3/014 ,  G06F3/017 ,  G06F3/0304 ,  G06V40/11 ,  A63F2300/1012 ,  A63F2300/1031 ,  A63F2300/1087 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/303 ,  A63F2300/308 ,  A63F2300/538

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

公开(公告)号：US20230149809A1

公开(公告)日：2023-05-18

申请号：US17530329

申请日：2021-11-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Todd Tokubo

IPC: A63F13/46 ,  G06N20/00 ,  A63F13/56

CPC classification number: A63F13/46 ,  G06N20/00 ,  A63F13/56 ,  A63F2300/8082

Abstract: Methods and systems are provided for processing feature similarity for a real-world space used for augmented reality (AR) gameplay is disclosed. The method includes receiving captured sensor data from the real-world space used by a user for said AR gameplay of a game. The sensor data provides data to identify characteristics of physical objects in the real-world space. The method includes generating a user space score using the characteristics of the physical objects identified in the real-world space. The method includes comparing the user space score to a game space score that is predefined for the game. The comparing is used to produce a fit handicap for the AR gameplay of the game in the real-world space by the user. Adjustments to gameplay parameters may be made to compensate or adjust the fit handicap.