-
公开(公告)号:US20180011545A1
公开(公告)日:2018-01-11
申请号:US15694511
申请日:2017-09-01
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey Roger Stafford , Todd Tokubo
IPC: G06F3/01
CPC classification number: G06F3/017 , A63F13/211 , A63F13/212 , A63F13/213 , A63F13/5255 , A63F2300/1012 , A63F2300/1031 , A63F2300/1087 , A63F2300/1093 , A63F2300/301 , A63F2300/303 , A63F2300/308 , A63F2300/538 , G06F3/011 , G06F3/014 , G06F3/0304 , G06K9/00382
Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.
-
公开(公告)号:US09753549B2
公开(公告)日:2017-09-05
申请号:US15472786
申请日:2017-03-29
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey Roger Stafford , Todd Tokubo
IPC: G06F3/01
CPC classification number: G06F3/017 , A63F13/211 , A63F13/212 , A63F13/213 , A63F13/5255 , A63F2300/1012 , A63F2300/1031 , A63F2300/1087 , A63F2300/1093 , A63F2300/301 , A63F2300/303 , A63F2300/308 , A63F2300/538 , G06F3/011 , G06F3/014 , G06F3/0304 , G06K9/00382
Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.
-
公开(公告)号:US20170197142A1
公开(公告)日:2017-07-13
申请号:US15472786
申请日:2017-03-29
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey Roger Stafford , Todd Tokubo
IPC: A63F13/213 , G06F3/01 , A63F13/5255 , G06K9/00 , A63F13/211 , A63F13/212
CPC classification number: G06F3/017 , A63F13/211 , A63F13/212 , A63F13/213 , A63F13/5255 , A63F2300/1012 , A63F2300/1031 , A63F2300/1087 , A63F2300/1093 , A63F2300/301 , A63F2300/303 , A63F2300/308 , A63F2300/538 , G06F3/011 , G06F3/014 , G06F3/0304 , G06K9/00382
Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.
-
公开(公告)号:US12051011B2
公开(公告)日:2024-07-30
申请号:US16837969
申请日:2020-04-01
Applicant: Sony Interactive Entertainment Inc.
Inventor: Mahdi Azmandian , Xiaoyong Ye , Todd Tokubo
IPC: G06N5/04 , A63F13/79 , G06N20/00 , G06V40/20 , H04L67/131
CPC classification number: G06N5/04 , A63F13/79 , G06N20/00 , G06V40/20 , H04L67/131
Abstract: Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model. The processing is configured to generate a recommendation to the user regarding an action to take to progress in the game during said current gameplay.
-
55.
公开(公告)号:US20230258948A1
公开(公告)日:2023-08-17
申请号:US18308559
申请日:2023-04-27
Applicant: Sony Interactive Entertainment Inc.
Inventor: Dennis Castleman , Todd Tokubo , Victoria Dorn
CPC classification number: G02B27/0176 , G01L19/14 , B81B7/02 , G02B2027/0178 , B81B2201/0264
Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.
-
56.
公开(公告)号:US20230162448A1
公开(公告)日:2023-05-25
申请号:US17535522
申请日:2021-11-24
Applicant: Sony Interactive Entertainment Inc.
Inventor: Hadi Alamdar , Andrew Young , Todd Tokubo
CPC classification number: G06T19/006 , G06T3/40 , G06T7/70 , A63F13/52 , A63F2300/8082
Abstract: Methods and systems for normalizing views of real world space and virtual environment of an interactive application as viewed through a pair of augmented reality glasses include receiving content of the interactive application for rendering on a display screen of the pair of augmented reality glasses. The content is streaming content provided in response to inputs provided by the user and includes virtual objects. The virtual objects are dynamically scaled to match a scale of the real world objects to a scale of the virtual objects. The content of the interactive application dynamically scaled is projected as an overlay over the real world objects of the real world space viewed through the pair of augmented reality glasses. The content that is dynamically scaled enables a normalized view between the real world space and the virtual environment.
-
57.
公开(公告)号:US20230144578A1
公开(公告)日:2023-05-11
申请号:US17522710
申请日:2021-11-09
Applicant: Sony Interactive Entertainment Inc.
Inventor: Dennis Castleman , Todd Tokubo , Victoria Dorn
CPC classification number: G02B27/0176 , G01L19/14 , B81B7/02 , B81B2201/0264 , G02B2027/0178
Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.
-
公开(公告)号:US20230041294A1
公开(公告)日:2023-02-09
申请号:US17392846
申请日:2021-08-03
Applicant: Sony Interactive Entertainment Inc.
Inventor: Todd Tokubo
IPC: G06F3/01
Abstract: An AR system tracks a person's hand and an object being held in the hand. The manner in which the hand is gripping the object is correlated to a particular haptic signal that is implemented on the object.
-
公开(公告)号:US20220253132A1
公开(公告)日:2022-08-11
申请号:US17731174
申请日:2022-04-27
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey Roger Stafford , Todd Tokubo
IPC: G06F3/01 , G06T7/70 , G01C19/5783
Abstract: Systems and methods for determining movement of a hand-held controller (HHC) with respect to a head-mounted display (HMD) are described. A camera is located at a lower region of the HMD for capturing images of the HHC. The images of the HHC are used to determine a position and an orientation of the HHC with reference to the HMD. Also, the camera or another camera can be used to determine a position and orientation of the HMD with respect to a real-world environment. The position and orientation of the HMD and the position and orientation of the HHC are used to change to state of an application executed on a game cloud.
-
公开(公告)号:US11224799B2
公开(公告)日:2022-01-18
申请号:US16848389
申请日:2020-04-14
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jeffrey Roger Stafford , Todd Tokubo
IPC: A63F13/213 , A63F13/212 , G06F3/01 , A63F13/211 , A63F13/5255 , G06K9/00 , G06F3/03
Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.
-
-
-
-
-
-
-
-
-