公开(公告)号：US11219837B2

公开(公告)日：2022-01-11

申请号：US15721673

申请日：2017-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Erik Beran ,  Michael Taylor ,  Ruxin Chen

IPC: G06F3/00 ,  A63F13/90 ,  B25J5/00 ,  H04N9/31 ,  B25J11/00 ,  B25J15/10 ,  B25J9/04 ,  B25J15/04 ,  A63F13/213 ,  B25J13/08 ,  G06F3/01 ,  G06F3/042 ,  G06F3/0481 ,  G06F3/16

Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

公开(公告)号：US20210352254A1

公开(公告)日：2021-11-11

申请号：US16871819

申请日：2020-05-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Michael Taylor

IPC: H04N13/117 ,  G06F3/01 ,  H04N5/225 ,  H04N5/247 ,  H04N13/156

Abstract: A space in which an augmented reality (AR) computer simulation is played is mapped by multiple cameras. An AR video game player can select a location in space from which the AR player wishes to have a view of the space, including himself. Using the mapping of the space a synthesized video is generated as if from a camera located at the location in space selected by the player.

公开(公告)号：US11113862B1

公开(公告)日：2021-09-07

申请号：US16872242

申请日：2020-05-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black

IPC: G06T13/40 ,  G06T13/80

Abstract: An injury to a computer game character is simulated by changing the length or weight of an injured body part, or by adding additional links to the skeleton of the character to make the character harder to control. The facial expression of the character also can change. A generative adversarial network (GAN) may be used to learn motion under circumstances of injury to better mimic motion of an injured human as may be derived from, e.g., motion capture (MOCAP) video.

公开(公告)号：US20210158141A1

公开(公告)日：2021-05-27

申请号：US16693093

申请日：2019-11-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Sergey Bashkirov

IPC: G06N3/08 ,  G05B13/02 ,  G06N3/04 ,  B25J9/16

Abstract: A method, system and non-transitory instructions for control input, comprising, taking an integral of an output value from a Motion Decision Neural Network for a movable joint to generate an integrated output value. Generating a subsequent output value using a machine learning algorithm that includes a sensor value and the integrated output value as inputs to the Motion Decision Neural Network and imparting movement with the moveable joint according to an integral of the subsequent output value.

公开(公告)号：US10814235B2

公开(公告)日：2020-10-27

申请号：US15892208

申请日：2018-02-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black

IPC: A63F9/24 ,  A63F13/86 ,  A63F13/537 ,  A63F13/44 ,  A63F13/58 ,  A63F13/31 ,  A63F13/54 ,  G06N3/04 ,  A63F13/285

Abstract: A media system employs techniques to create a framework for evaluating gameplay content in a vector-space. These techniques include monitoring frames for content streams that correspond to gameplay in a game environment, determining feature-values for features associated with the frames, mapping the content streams to position vectors in the vector-space based on the feature-values, and assigning a set of position vectors in the vector-space to an area in the game environment based on a relative proximity of the set of position vectors in the vector-space.

公开(公告)号：US20200301553A1

公开(公告)日：2020-09-24

申请号：US16783070

申请日：2020-02-05

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black

IPC: G06F3/0484 ,  G06F3/16 ,  G06F3/0481 ,  G06F3/0488

Abstract: A method includes identifying a tangible object, establishing a virtual overlay on the tangible object in a manner that is visible to a user, detecting the user's interaction with the virtual overlay that is established on the tangible object, and using the user's interaction with the virtual overlay as a basis for input to a processor based system. A system includes a display and a processor based apparatus in communication with the display. A storage medium storing one or more computer programs is also provided.

公开(公告)号：US10732710B2

公开(公告)日：2020-08-04

申请号：US16018966

申请日：2018-06-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: G06F3/01 ,  G06T19/00 ,  A63F13/87

Abstract: Player-to-player eye contact is used to establish a private chat channel in an augmented reality (AR) or virtual reality (VR) setting. Since maintaining eye contact requires agreement from both parties, it allows both players an equal amount of control when performing the mutual action. Eye tracking may be used for determining whether mutual eye contact has been established. In the case of AR, “inside out” eye tracking can be used, whereas in a VR setting only inside eye tracking need be used. Techniques are described to confirm and establish a channel once eye contact has been held.

公开(公告)号：US20200034610A1

公开(公告)日：2020-01-30

申请号：US16044804

申请日：2018-07-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: G06K9/00 ,  G06F21/36 ,  A63F13/213

Abstract: Image data from two different devices is used to identify a physical interaction between two users to authenticate a digital interaction between the users.

公开(公告)号：US10377484B2

公开(公告)日：2019-08-13

申请号：US15393875

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Michael Taylor ,  Dennis Dale Castleman ,  Glenn Black ,  Javier Fernandez Rico

IPC: G05D1/00 ,  G05D3/00 ,  G06F7/00 ,  G06F17/00 ,  B64C39/02 ,  G01S1/00 ,  A63H27/00 ,  A63H30/04 ,  A63F13/00 ,  G01S19/48 ,  G01S5/02

Abstract: Systems and methods for unmanned aerial vehicle (UAV) positional anchors. Signals may be broadcast via a signal interface of an anchor in a defined space which also includes a UAV. The UAV is at one location within the defined space, and the anchor is at another location within the defined space. A virtual environment may be generated that corresponds to the defined space. The virtual environment may include at least one virtual element, and a location of the virtual element within the virtual environment may be based on the location of the anchor within the defined space. A visual indication may be generated when the UAV is detected within a predetermined distance from the location of the anchor. In some embodiments, a visual element may be generated to augment the anchor where a location of the visual element is based on a location of the anchor within the defined space. The visual element may be changed when the UAV is flown to the location of the anchor within the defined space.

公开(公告)号：US20190197768A1

公开(公告)日：2019-06-27

申请号：US15853667

申请日：2017-12-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Erik Beran

IPC: G06T17/05 ,  G06T7/50 ,  G06T19/00 ,  G06F3/0481

Abstract: A method is provided, including the following method operations: using a robot having a plurality of sensors to acquire sensor data about a local environment; processing the sensor data to generate a spatial model of the local environment, the spatial model defining virtual surfaces that correspond to real surfaces in the local environment; further processing the sensor data to generate texture information that is associated to the virtual surfaces defined by the spatial model; tracking a location and orientation of a head-mounted display (HMD) in the local environment; using the spatial model, the texture information, and the tracked location and orientation of the HMD to render a view of a virtual space that corresponds to the local environment; presenting the view of the virtual environment through the HMD.