公开(公告)号：US11861777B2

公开(公告)日：2024-01-02

申请号：US17680912

申请日：2022-02-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sergey Bashkirov ,  Michael Taylor

IPC: G06T13/40 ,  G06T7/70

CPC classification number: G06T13/40 ,  G06T7/70 ,  G06T2207/10016 ,  G06T2207/20084

Abstract: Computer animation involving monocular pose prediction is disclosed. A plurality of candidate pose sequences of a three-dimensional model of an animation character is generated such that each candidate pose of each sequence has a segmentation map that matches a segmentation map of a corresponding character derived from a corresponding frame of a video. A distance between candidate poses at each time step is maximized. An optimum pose sequence is determined and used to generate a corresponding sequence of frames of animation.

公开(公告)号：US20230400934A1

公开(公告)日：2023-12-14

申请号：US17837226

申请日：2022-06-10

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Celeste Bean ,  Sergey Bashkirov ,  Michael Taylor

IPC: G06F3/033 ,  A63F13/24

CPC classification number: G06F3/0334 ,  A63F13/24

Abstract: A foot operated controller apparatus is disclosed. The apparatus includes a ball large enough for a human to manipulate with two feet, and a support apparatus configured to support the ball from below, restrict translation of the ball and permit rotation of the ball about its center with respect to at least two axes. One or more position encoders are disposed proximate a surface of the ball. The encoder(s) are configured to determine a rotational displacement of the ball with respect to two or more axes.

公开(公告)号：US11801446B2

公开(公告)日：2023-10-31

申请号：US16355560

申请日：2019-03-15

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Javier Fernandez Rico ,  Glenn Black

IPC: A63F13/00 ,  A63F13/58 ,  A63F13/35 ,  G06N20/00

CPC classification number: A63F13/58 ,  A63F13/35 ,  G06N20/00 ,  A63F2300/65

Abstract: A method for training a character for a game is described. The method includes facilitating a display of one or more scenes of the game. The one or more scenes include the character and virtual objects. The method further includes receiving input data for controlling the character by a user to interact with the virtual objects and analyzing the input data to identify interaction patterns for the character in the one or more scenes. The interaction patterns define inputs to train an artificial intelligence (AI) model associated with a user account of the user. The method includes enabling the character to interact with a new scene based on the AI model. The method includes tracking the interaction with the new scene by the character to perform additional training of the AI model.

公开(公告)号：US20230264104A1

公开(公告)日：2023-08-24

申请号：US18309431

申请日：2023-04-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black

IPC: A63F13/54 ,  A63F13/60 ,  A63F13/67

CPC classification number: A63F13/54 ,  A63F13/60 ,  A63F13/67 ,  A63F2300/6009 ,  A63F2300/6081

Abstract: A method for dynamically modifying audio playback of a video game is provided. The method includes ascertaining game music data associated with the video game. The game music data may include a plurality of game soundtracks classified according to predetermined criteria. The method may include collecting feedback while the user is playing the video game, the feedback including data associated with the user’s performance; an express user action; an evaluation of game results; the user’s emotional state; and a user input. The method may continue with determining one or more replacement soundtracks based on criteria associated with the one or more replacement soundtracks. The method may further include dynamically modifying the game music data while the user is playing the video game by replacing at least one of the plurality of game soundtracks with the one or more replacement soundtracks to obtain modified game music data.

公开(公告)号：US11689704B2

公开(公告)日：2023-06-27

申请号：US17819624

申请日：2022-08-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Michael Taylor

IPC: H04N13/117 ,  G06F3/01 ,  H04N13/156 ,  H04N23/54 ,  H04N23/90 ,  A63F13/35 ,  A63F13/65 ,  A63F13/525

CPC classification number: H04N13/117 ,  G06F3/013 ,  G06F3/017 ,  H04N13/156 ,  H04N23/54 ,  H04N23/90 ,  A63F13/35 ,  A63F13/525 ,  A63F13/65 ,  A63F2300/53 ,  A63F2300/69

Abstract: A space in which an augmented reality (AR) computer simulation is played is mapped by multiple cameras. An AR video game player can select a location in space from which the AR player wishes to have a view of the space, including himself. Using the mapping of the space a synthesized video is generated as if from a camera located at the location in space selected by the player.

公开(公告)号：US11590416B2

公开(公告)日：2023-02-28

申请号：US16780858

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: A63F13/00 ,  A63F13/26 ,  G06T7/579 ,  G06T19/00 ,  A63F13/213 ,  A63F13/35 ,  A63F13/5378

Abstract: “Feature points” in “point clouds” that are visible to multiple respective cameras (i.e., aspects of objects imaged by the cameras) are reported via wired and/or wireless communication paths to a compositing processor which can determine whether a particular feature point “moved” a certain amount relative to another image. In this way, the compositing processor can determine, e.g., using triangulation and recognition of common features, how much movement occurred and where any particular camera was positioned when a latter image from that camera is captured. Thus, “overlap” of feature points in multiple images is used so that the system can close the loop to generate a SLAM map. The compositing processor, which may be implemented by a server or other device, generates the SLAM map by merging feature point data from multiple imaging devices.

公开(公告)号：US11568265B2

公开(公告)日：2023-01-31

申请号：US15684830

申请日：2017-08-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Javier Fernandez-Rico ,  Sergey Bashkirov ,  Jaekwon Yoo ,  Ruxin Chen

IPC: G06N3/08 ,  G06N3/00 ,  G06N20/00

Abstract: An autonomous personal companion executing a method including capturing data related to user behavior. Patterns of user behavior are identified in the data and classified using predefined patterns associated with corresponding predefined tags to generate a collected set of one or more tags. The collected set is compared to sets of predefined tags of a plurality of scenarios, each to one or more predefined patterns of user behavior and a corresponding set of predefined tags. A weight is assigned to each of the sets of predefined tags, wherein each weight defines a corresponding match quality between the collected set of tags and a corresponding set of predefined tags. The sets of predefined tags are sorted by weight in descending order. A matched scenario is selected for the collected set of tags that is associated with a matched set of predefined tags having a corresponding weight having the highest match quality.

公开(公告)号：US20220358713A1

公开(公告)日：2022-11-10

申请号：US17308011

申请日：2021-05-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Michael Taylor

IPC: G06T15/20 ,  G10L15/26 ,  G06T17/10 ,  G06N3/04 ,  G06T15/50

Abstract: A computer simulation object such as a chair is described by voice or photo input to render a 2D image. Machine learning may be used to convert voice input to the 2D image. The 2D image is converted to a 3D asset and the 3D asset or portions thereof are used in the computer simulation, such as a computer game, as the object such as a chair.

公开(公告)号：US20220357914A1

公开(公告)日：2022-11-10

申请号：US17307988

申请日：2021-05-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sudha Krishnamurthy ,  Michael Taylor

IPC: G06F3/16 ,  G06T19/20 ,  G06T11/00 ,  G10L15/22 ,  G10L15/26 ,  A63F13/215 ,  A63F13/424 ,  A63F13/537

Abstract: A 3D scene is generated consisting of one or more objects from a natural language description that may consist of text or voice. Relevant keywords like asset attributes and placement are extracted from the description. Using these keywords, a 2D image is generated using a generative model. Another neural model is used to reconstruct the 3D objects from the 2D. The 3D objects can be assembled to meet the placement specifications. Alternatively, the 3D object is generated by either transforming existing 3D objects or by using a 3D generative model to meet the specifications in the description.

公开(公告)号：US11210651B2

公开(公告)日：2021-12-28

申请号：US16870048

申请日：2020-05-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: G06Q20/32 ,  G06F3/01 ,  G06K9/00

Abstract: Image data from two different devices is used to identify a physical interaction between two users to authenticate a digital interaction between the users.