公开(公告)号：US11328488B2

公开(公告)日：2022-05-10

申请号：US16905388

申请日：2020-06-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nigel John Williams ,  Fabio Cappello

IPC: G06T19/00 ,  H04N13/111 ,  G06N20/00 ,  G06F3/01

Abstract: Methods and apparatus provide for generating content for display including one or more objects to be rendered, including: defining a plurality of virtual elements; setting one or more parameters associated with each of the plurality of virtual elements; and generating content for display using the plurality of virtual elements and corresponding parameter values, where setting the one or more parameters includes setting one or more parameters in accordance with the output of a machine learning algorithm adapted to determine appropriate parameters for the plurality of virtual elements so as to simulate an object to be rendered.

公开(公告)号：US11312002B2

公开(公告)日：2022-04-26

申请号：US16390303

申请日：2019-04-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Jason Gordon Doig ,  Michael Eder ,  Rajeev Gupta

IPC: B25J9/16 ,  B25J9/00 ,  A63H30/04 ,  B25J15/00 ,  B25J15/06 ,  G06N3/00

Abstract: A system for controlling a configurable apparatus includes a configuration identification unit operable to identify a preferred configuration of the apparatus in response to media content to be provided to a user, and a configuration modification unit operable to modify the configuration of the apparatus in dependence upon the identified preferred configuration, where different configurations of the apparatus correspond to the shapes of different objects relating to the media content.

公开(公告)号：US20210357026A1

公开(公告)日：2021-11-18

申请号：US17315429

申请日：2021-05-10

Applicant: Sony Interactive Entertainment Inc.

Inventor： Maria Chiara Monti ,  Fabio Cappello

IPC: G06F3/01

Abstract: A system configured to perform an eye tracking process using a head-mountable eye-tracking arrangement, the system comprising an eye tracking unit, located on the head-mountable arrangement, operable to detect motion of one or both of the user's eyes, a relative motion identification unit operable to identify motion of the head-mountable arrangement relative to the user's head, and a correction unit operable to determine a correction to the eye tracking process in dependence upon the identified motion of the user's head relative to the head-mountable arrangement.

公开(公告)号：US20210183146A1

公开(公告)日：2021-06-17

申请号：US17114596

申请日：2020-12-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Maurizio Cerrato ,  Rosario Leonardi ,  Gregory James Bedwell ,  Nigel John Williams

IPC: G06T19/00 ,  H04N13/282 ,  H04N13/279 ,  H04N13/117

Abstract: A system for modifying data representing a virtual environment includes: an environment navigation unit operable to control navigation within the virtual environment to generate one or more viewpoints within the virtual environment, an environment identification unit operable to identify one or more aspects of the geometry of the virtual environment visible in the one or more viewpoints, a geometry evaluation unit operable to evaluate the visibility of one or more aspects of the geometry based upon the identification for each of one or more viewpoints, and a data modification unit operable to modify one or more elements of data representing the virtual environment.

公开(公告)号：US20210125398A1

公开(公告)日：2021-04-29

申请号：US17075243

申请日：2020-10-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Timothy Bradley ,  Fabio Cappello

IPC: G06T15/20 ,  G06T7/70 ,  G06T19/00 ,  G06T7/62 ,  G06T19/20

Abstract: A method of obtaining real world scale information for a scene comprises includes obtaining at least one image of a plurality of objects in a scene; detecting at least some of the objects in the at least one image as corresponding to pre-determined objects; generating a 3D reconstruction of the scene based on the image content of the at least one image; determining a relative size of each object in the 3D reconstruction of the scene in at least one dimension, the relative size being defined in dimensions of the generated 3D reconstruction; wherein where the relative size of each object is determined based on a distance between at least two points corresponding to that object as transformed into 3D space; obtaining a size probability distribution function for each object detected in the at least one image, each size probability distribution function defining a range of sizes in at least one dimension that a corresponding object is likely to possess in real world units; resealing the size probability distribution function for each detected object based on a corresponding relative size of that object in the 3D reconstruction; and estimating a geometry of the scene in real world units by combining the re-scaled probability distribution function for at least one detected object with the re-scaled probability distribution function for at least one other detected object.

公开(公告)号：US20210001216A1

公开(公告)日：2021-01-07

申请号：US16906198

申请日：2020-06-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Matthew William Sanders ,  Fabio Cappello ,  Timothy Bradley ,  Jessica Rose Grant ,  Maurizio Cerrato

IPC: A63F13/352 ,  G06N3/08 ,  A63F13/573 ,  A63F13/525 ,  A63F13/335 ,  A63F13/327 ,  G06N20/00

Abstract: A method of generating video frames for a cloud-based video game includes obtaining, via a communications network, a plurality of frames of a video game rendered at a cloud device; obtaining a player input received at an input device, the input device being used to play the video game, the player input being received in response to the display of at least one of the obtained video frames; inputting at least one of the obtained video frames and the player input to a prediction model; and synthesizing, based on the output of the prediction model, a subsequent frame for output at a display, and outputting the synthesized video frame at the display.

公开(公告)号：US20200329331A1

公开(公告)日：2020-10-15

申请号：US16841953

申请日：2020-04-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Marina Villanueva-Barreiro ,  Oliver Hume

IPC: H04S7/00 ,  H04S3/00

Abstract: A system for generating audio content in dependence upon an input audio track comprising audio corresponding to one or more sound sources, the system comprising an audio input unit operable to input the input audio track to one or more models, each representing one or more of the sound sources, and an audio generation unit operable to generate, using the one or more models, one or more audio tracks each comprising a representation of the audio contribution of the corresponding sound sources of the input audio track, wherein the generated audio tracks comprise one or more variations relative to the corresponding portion of the input audio track.

公开(公告)号：US20200167984A1

公开(公告)日：2020-05-28

申请号：US16682841

申请日：2019-11-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Oliver Hume

IPC: G06T13/40 ,  G06T7/73 ,  A63F13/57

Abstract: A method of determining identifiers for tagging frames of animation with is provided. The method comprises obtaining data indicating motion of an animated object in a plurality of frames and detecting the object as performing a pre-determined motion in at least some of the plurality of frames. For a given frame, it is determined based on the detected pre-determined motion, whether to associate an identifier with the pre-determined motion, the identifier indicating an event that is to be triggered in response to the pre-determined motion. The frames of the animation comprising the detected pre-determined motion are tagged, in response to a determination of an identifier. The pre-determined motion and corresponding identifier are determined by inputting the obtained data to machine learning model. A corresponding system is also provided.

公开(公告)号：US20200035073A1

公开(公告)日：2020-01-30

申请号：US16516355

申请日：2019-07-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello

IPC: G08B6/00 ,  G06F3/01 ,  A63F13/24 ,  A63F13/285

Abstract: A system, mountable upon a user's body, for simulating interaction with a virtual environment, the system including a communication unit operable to receive information relating to operation of the system, and an interactive element operable to simulate contact with a virtual surface in the virtual environment by moving relative to the user's body in dependence upon the received information.

公开(公告)号：US20200035019A1

公开(公告)日：2020-01-30

申请号：US16517853

申请日：2019-07-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Matthew William Sanders ,  David Erwan Damien Uberti ,  Andrew William Walker

IPC: G06T17/00 ,  G06T7/70 ,  H04N13/111 ,  A63F13/52 ,  A63F13/497

Abstract: A method of generating an image includes receiving a video stream, the video stream having a two-dimensional video of a three-dimensional scene captured by a video camera; determining a mapping between locations in the two-dimensional video of the scene and locations in a three-dimensional representation of the scene, the mapping being determined based on a known parameter of the video camera and a known size of a feature in the three-dimensional scene; generating a three-dimensional graphical representation of the scene based on the determined mapping; determining a virtual camera angle from which the three-dimensional graphical representation of the scene is to be viewed; rendering an image corresponding to the graphical representation of the scene viewed from the determined virtual camera angle, and outputting the rendered image for display.