公开(公告)号：US10475332B2

公开(公告)日：2019-11-12

申请号：US15793232

申请日：2017-10-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Marks ,  Joshua Michael Eads

IPC: G08C17/02 ,  H04B1/20 ,  G08C19/28

Abstract: The disclosure provides methods and systems for spatially remote controlling a network controllable device in a physical user environment. An exemplary method may include tracking, by a processor, a position and orientation of a remote control device based on sensor data. The sensors may be one or more of a gyroscope, accelerometer, and a magnetometer. Based on the tracking, a ray extending from the remote control device in a direction the remote control device is pointing is determined. The determined ray is compared to a predefined map, the predefined map including a spatial location associated with each of one or more network controllable devices. The method may include, based on the comparing, selecting a network controllable device of the one or more network controllable devices corresponding to the determined ray. In response to receiving a user input, a control signal is then transmitted to the selected network controllable device.

公开(公告)号：US10376785B2

公开(公告)日：2019-08-13

申请号：US15199384

申请日：2016-06-30

Applicant: Sony Interactive Entertainment Inc.

Inventor： Gustavo Hernandez-Abrego ,  Xavier Menendez-Pidal ,  Steven Osman ,  Ruxin Chen ,  Rishi Deshpande ,  Care Michaud-Wideman ,  Richard Marks ,  Eric J. Larsen ,  Xiaodong Mao

IPC: A63F13/428 ,  G10L17/04 ,  A63F13/213 ,  A63F13/217 ,  G06F3/01 ,  G10L17/00 ,  G06F3/00

Abstract: Consumer electronic devices have been developed with enormous information processing capabilities, high quality audio and video outputs, large amounts of memory, and may also include wired and/or wireless networking capabilities. Additionally, relatively unsophisticated and inexpensive sensors, such as microphones, video camera, GPS or other position sensors, when coupled with devices having these enhanced capabilities, can be used to detect subtle features about users and their environments. A variety of audio, video, simulation and user interface paradigms have been developed to utilize the enhanced capabilities of these devices. These paradigms can be used separately or together in any combination. One paradigm automatically creating user identities using speaker identification. Another paradigm includes a control button with 3-axis pressure sensitivity for use with game controllers and other input devices.

公开(公告)号：US09799121B2

公开(公告)日：2017-10-24

申请号：US14725260

申请日：2015-05-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Marks ,  Anton Mikhailov ,  Ennin Huang ,  Gary M. Zalewski

IPC: A63F9/24 ,  G06T7/20 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0346 ,  A63F13/211 ,  A63F13/219 ,  A63F13/213 ,  A63F13/22 ,  A63F13/28 ,  A63F13/216 ,  A63F13/235 ,  A63F13/24 ,  A63F13/25 ,  A63F13/825 ,  G06F3/038 ,  G06F3/0484

CPC classification number: G06T7/20 ,  A63F13/211 ,  A63F13/213 ,  A63F13/216 ,  A63F13/219 ,  A63F13/22 ,  A63F13/235 ,  A63F13/24 ,  A63F13/25 ,  A63F13/28 ,  A63F13/825 ,  G06F3/016 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0346 ,  G06F3/0383 ,  G06F3/04842 ,  G06F2203/013 ,  G06F2203/0333 ,  G06F2203/0381 ,  G06F2203/0383 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/30241 ,  G06T2207/30242

Abstract: Methods and systems for processing input by a computing device are presented. One method includes operations for receiving images of a control device that includes an object section, and for determining a location of the control device utilizing image analysis for each captured image. Additionally, the movement of the control device is tracked based on the determined locations, where the tracking of the movement includes receiving inertial sensor information obtained by sensors in the control device, and determining an orientation of the control device based on the sensor information. Additionally, the method includes an operation for translating the movement and orientation of the control device into input for a game executing in the computing device, where the input is translated into a motion and orientation of an object in the game based on the movement of the control device.

公开(公告)号：US20170269685A1

公开(公告)日：2017-09-21

申请号：US15461434

申请日：2017-03-16

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Marks ,  Steven Osman

IPC: G06F3/01 ,  G06F3/0346 ,  A63F13/533

CPC classification number: G06F3/013 ,  A63F13/212 ,  A63F13/26 ,  A63F13/5252 ,  A63F13/533 ,  A63F13/86 ,  A63F2300/303 ,  G06F3/0346

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes generating a virtual reality environment to be rendered for a head mounted display (HMD) of an HMD player. The HMD player is provided with an HMD view that is controlled by movement of the HMD by the HMD player. Then, providing a spectator view into the virtual reality environment. The spectator view is associated with a viewing spot directed into the virtual reality environment. The viewing spot is decoupled from the HMD view. In some examples, multiple viewing spots are pre-authored and the spectator is provided with different ones of the viewing spots as the HMD players move around the virtual reality environment.

公开(公告)号：US20170092235A1

公开(公告)日：2017-03-30

申请号：US15268482

申请日：2016-09-16

Applicant: Sony Interactive Entertainment Inc.

Inventor： Steven Osman ,  Richard Marks

IPC: G09G5/38 ,  G06T19/00 ,  G06F3/16 ,  G06F3/01

CPC classification number: G09G5/38 ,  G02B27/017 ,  G02B2027/0181 ,  G06F3/012 ,  G06F3/013 ,  G06F3/16 ,  G06T19/006 ,  G09G2320/0693 ,  G09G2354/00

Abstract: A system and method of adjusting content displayed to a user during an interactive HMD session to compensate for the user's head tilt. The user's head tilt causes the displayed content to be displayed offset from the user's comfortable viewing area of the screen in the HMD. The offset is determined a number of ways and then the displayed images are adjusted to reduce or substantially eliminate the offset. The adjusting can compensate for different user postures for standing, sitting, reclining, lying down, etc. as may occur during an interactive HMD session. The user's head tilt can be caused by the user's physical posture, physical shape or due to corrective lenses that cause the user to inadvertently tilt his head.

公开(公告)号：US11731044B2

公开(公告)日：2023-08-22

申请号：US17218056

申请日：2021-03-30

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Marks ,  Hrishikesh Deshpande ,  Gary M. Zalewski

IPC: A63F13/00 ,  A63F13/42 ,  A63F13/213 ,  A63F13/24 ,  A63F13/235 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0346 ,  A63F13/211

CPC classification number: A63F13/42 ,  A63F13/213 ,  A63F13/235 ,  A63F13/24 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0325 ,  G06F3/0346 ,  A63F13/211 ,  A63F2300/1006 ,  A63F2300/1043 ,  A63F2300/1087

Abstract: A system and controller are provided. In one example, the system includes a controller for playing a video game. The controller includes input buttons for controlling interaction during play of the video game. The controller includes an inertial sensor for detecting translational or rotational movement of the controller and a vibrational device. A voice input device is associated with the controller. A wireless communication circuit of the controller is provided for communicating data between the controller and a local computing device. The local computing device is connectable to a network. The data includes control responsive to presses of said input buttons or control received from said voice input device.

公开(公告)号：USRE48417E1

公开(公告)日：2021-02-02

申请号：US15210816

申请日：2016-07-14

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Marks ,  Gary M. Zalewski

IPC: A63F13/42 ,  A63F13/211 ,  A63F13/213 ,  G06F3/0346 ,  G06K9/00

Abstract: A method for use in obtaining input data from an object includes capturing a live image of the object with an image capture device, receiving information related to a tilt angle of the object from one or more sensors other than the image capture device, using the information related to a tilt angle of the object to obtain at least one rotated reference image of the object, comparing the live image of the object with the rotated reference image of the object, and generating an indication in response to the live image matching the rotated reference image. An apparatus and a storage medium storing a computer program executable by a processor based system are also disclosed

公开(公告)号：US10463962B2

公开(公告)日：2019-11-05

申请号：US16175786

申请日：2018-10-30

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Marks ,  Steven Osman

IPC: A63F13/525 ,  A63F13/352 ,  A63F13/86 ,  A63F13/5255

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. By allowing the spectator to move closer or further away from specific content, the spectators movement toward or away will cause an automatic scaling of content within the virtual-reality content being generated by an HMD player, that is sharing the content with the spectator. Other features include allowing a spectator to adjust the viewing angle of the content. The viewing angle of the content can be moved by allowing the spectator to reach into the content or control the content scene, and then position the content in the viewing angle that is most comfortable to the position of the spectator.

公开(公告)号：US10369466B2

公开(公告)日：2019-08-06

申请号：US15628601

申请日：2017-06-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Gary M. Zalewski ,  Richard Marks ,  Xiadong Mao

IPC: A63F13/424 ,  G06F3/00 ,  A63F13/213 ,  A63F13/211 ,  G06F3/03 ,  G06F3/0346 ,  A63F13/40 ,  G06F3/038 ,  G06F3/0484

Abstract: Computer implemented methods, apparatus and systems for enabling interactive interfacing with a computer game program are provided. One system includes an input device to accept and transmit user input to the computer game program. The system also includes a computing device for executing the computer game having an interactive component that is responsive to the user input. The computing devices is in communication with the input device for receiving and processing the user input. The computer device is also configured to apply a gearing parameter during processing of the user input, wherein the applied gearing parameter defines a scaling ratio between the user input and a rate at which the interactive component responds during execution of the computer game.

公开(公告)号：US20190105564A1

公开(公告)日：2019-04-11

申请号：US16209912

申请日：2018-12-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Richard Marks ,  Hrishikesh Deshpande ,  Gary M. Zalewski

IPC: A63F13/42 ,  G06F3/0346 ,  G06F3/03 ,  G06F3/01 ,  A63F13/213 ,  A63F13/235 ,  A63F13/24

Abstract: A controller is provided. A controller body to be held by a user, the controller body includes an input mechanism for receiving control inputs, an accelerometer for detecting translational or rotational movement of the controller body, and a vibrational device for providing vibration. The controller further includes a light for tracking by a camera, a voice input device and a wireless communication module. The wireless communication module communicates data between the controller and a computer for driving interaction with the video game. The data communicated between the controller and the computer includes control inputs and voice inputs from the voice input device.