公开(公告)号：US11785328B2

公开(公告)日：2023-10-10

申请号：US16816526

申请日：2020-03-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nigel John Williams ,  Fabio Cappello ,  Rajeev Gupta ,  Mark Jacobus Breugelmans

IPC: H04N23/61 ,  G06T7/73 ,  G06N20/00 ,  G06T7/80

CPC classification number: H04N23/61 ,  G06N20/00 ,  G06T7/74 ,  G06T7/80 ,  G06T2207/20081 ,  G06T2207/30244

Abstract: A system for adjusting the pose of a camera relative to a subject in a scene is provided. The system comprises a camera operable to capture images of a scene; an identification unit configured to identify an object of interest in images of the scene; a pose processor configured to obtain a pose of the object of interest in the scene relative to the camera; a scene analyser operable to determine, based on at least one of the obtained pose of the object of interest and images captured by the camera, a scene quality associated with images captured by the camera. A controller is configured to cause the pose of the camera to be adjusted based on a determination that the scene quality of an image captured at a current pose is less than a threshold value. A corresponding device is also provided.

公开(公告)号：US11717755B2

公开(公告)日：2023-08-08

申请号：US17408684

申请日：2021-08-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Maria Chiara Monti ,  Matthew Sanders ,  Timothy Bradley ,  Oliver Hume ,  Jason Craig Millson

IPC: A63F13/63 ,  A63F13/215 ,  A63F13/86 ,  A63F13/213 ,  A63F13/5372 ,  A63F13/5378 ,  A63F13/537 ,  A63F13/87 ,  A63F13/424 ,  G06F40/20

CPC classification number: A63F13/63 ,  A63F13/213 ,  A63F13/215 ,  A63F13/424 ,  A63F13/537 ,  A63F13/5372 ,  A63F13/5378 ,  A63F13/86 ,  A63F13/87 ,  G06F40/20

Abstract: A content generation system, the system comprising an input obtaining unit operable to obtain one or more samples of input text and/or audio relating to a first content, an input analysis unit operable to generate n-grams representing one or more elements of the obtained inputs, a representation generating unit operable to generate a visual representation of one or more of the generated n-grams, and a display generation unit operable to generate second content comprising one or more elements of the visual representation in association with the first content.

公开(公告)号：US11688127B2

公开(公告)日：2023-06-27

申请号：US17470225

申请日：2021-09-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Maria Chiara Monti ,  Fabio Cappello ,  Matthew Sanders ,  Timothy Edward Bradley ,  Oliver Hume

IPC: G06T15/20 ,  A63F13/26 ,  A63F13/525 ,  G06F3/01

CPC classification number: G06T15/20 ,  A63F13/26 ,  A63F13/525 ,  G06F3/013

Abstract: A data processing apparatus includes input circuitry to receive viewpoint data indicative of respective viewpoints for a plurality of spectators of a virtual environment, detection circuitry to detect a portion of the virtual environment viewed by each of the respective viewpoints in dependence upon the viewpoint data, selection circuitry to select one or more regions of the virtual environment in dependence upon at least some of the detected portions, and output circuitry to output data indicative of one or more of the selected regions.

公开(公告)号：US20230146564A1

公开(公告)日：2023-05-11

申请号：US18053037

申请日：2022-11-07

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Danjeli Schembri ,  Mandana Jenabzadeh ,  Oliver Hume ,  Michael Lee Jones

IPC: G06T19/20 ,  A63F13/56

CPC classification number: G06T19/20 ,  A63F13/56 ,  G06T2219/2004

Abstract: A system for positioning objects within an environment includes: an input unit operable to receive data representative of at least a portion of an environment comprising one or more features associated with the environment; an object determining unit operable to identify, for one or more objects, one or more features associated with each respective object, and operable to determine which of the one or more objects are to be positioned within the environment; and an object positioning unit operable to position the one or more determined objects within the environment in dependence upon at least one of the features associated with the environment and at least one of the features associated with each respective determined object, where the object positioning unit is operable to utilise a machine learning model, trained using one or more examples of one or more other objects positioned within at least a portion of one or more other environments in dependence upon at least one feature associated with each respective other environment and at least one feature associated with each respective other object as an input, to position the one or more determined objects within the environment.

公开(公告)号：US20230133049A1

公开(公告)日：2023-05-04

申请号：US17968300

申请日：2022-10-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Mandana Jenabzadeh ,  Michael Lee Jones

IPC: G06T17/00 ,  G06T19/20 ,  G06T13/20 ,  G06T7/62 ,  G06V10/764 ,  G06F3/16

Abstract: A data processing apparatus includes receiving circuitry to receive graphics data for at least a portion of a virtual environment, the graphics data including a plurality of virtual objects, a machine learning model trained to output data indicative of an object classification for one or more of the virtual objects in dependence upon the graphics data, assignment circuitry to assign one or more of the virtual objects to one or more virtual object groups in dependence upon the object classification for one or more of the virtual objects, where the virtual objects assigned to a same virtual object group have a same object classification, and control circuitry to share first interaction data associated with a first virtual object assigned to a virtual object group with a second virtual object assigned to the virtual object group to thereby permit use of the first interaction data for the second virtual object in response to a user interaction with the second virtual object in the virtual environment.

公开(公告)号：US11579690B2

公开(公告)日：2023-02-14

申请号：US17315429

申请日：2021-05-10

Applicant: Sony Interactive Entertainment Inc.

Inventor： Maria Chiara Monti ,  Fabio Cappello

IPC: G06F3/01

Abstract: A system configured to perform an eye tracking process using a head-mountable eye-tracking arrangement, the system comprising an eye tracking unit, located on the head-mountable arrangement, operable to detect motion of one or both of the user's eyes, a relative motion identification unit operable to identify motion of the head-mountable arrangement relative to the user's head, and a correction unit operable to determine a correction to the eye tracking process in dependence upon the identified motion of the user's head relative to the head-mountable arrangement.

公开(公告)号：US11538223B2

公开(公告)日：2022-12-27

申请号：US17114596

申请日：2020-12-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Maurizio Cerrato ,  Rosario Leonardi ,  Gregory James Bedwell ,  Nigel John Williams

IPC: G06T19/00 ,  H04N13/279 ,  H04N13/117 ,  H04N13/282

Abstract: A system for modifying data representing a virtual environment includes: an environment navigation unit operable to control navigation within the virtual environment to generate one or more viewpoints within the virtual environment, an environment identification unit operable to identify one or more aspects of the geometry of the virtual environment visible in the one or more viewpoints, a geometry evaluation unit operable to evaluate the visibility of one or more aspects of the geometry based upon the identification for each of one or more viewpoints, and a data modification unit operable to modify one or more elements of data representing the virtual environment.

公开(公告)号：US11497999B2

公开(公告)日：2022-11-15

申请号：US16740707

申请日：2020-01-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Oliver Hume

IPC: A63F13/52 ,  A63F13/60 ,  G06N20/00

Abstract: A method of determining blending coefficients for respective animations includes: obtaining animation data, the animation data defining at least two different animations that are at least in part to be simultaneously applied to the animated object, each animation comprising a plurality of frames; obtaining corresponding video game data, the video game data comprising an in-game state of the object; inputting the animation data and video game data into a machine learning model, the machine learning model being trained to determine, based on the animation data and corresponding video game data, a blending coefficient for each of the animations in the animation data; determining, based on the output of the machine learning model, one or more blending coefficients for at least one of the animations, the or each blending coefficient defining a relative weighting with which each animation is to be applied to the animated object; and blending the at least simultaneously applied part of the two animations using the or each determined blending coefficient, the contribution from each of the at least two animations being in accordance with the or each determined blending coefficient.

公开(公告)号：US20220309730A1

公开(公告)日：2022-09-29

申请号：US17700668

申请日：2022-03-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Matthew Sanders ,  Andrew James Bigos

IPC: G06T15/00 ,  G06T15/06 ,  G06T15/50 ,  G06N3/04

Abstract: An image rendering method includes: selecting at least a first trained machine learning model from among a plurality of machine learning models, the machine learning model having been trained to generate data contributing to a render of at least a part of an image, where the at least first trained machine learning model has an architecture based learning capability that is responsive to at least a first aspect of a virtual environment for which it is trained to generate the data, and using the at least first trained machine learning model to generate data contributing to a render of at least a part of an image.

公开(公告)号：US20220232201A1

公开(公告)日：2022-07-21

申请号：US17574007

申请日：2022-01-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Maurizio Cerrato ,  Maria Chiara Monti ,  Rosario Leonardi

IPC: H04N13/363 ,  H04N13/383 ,  H04N13/344 ,  G02B27/01 ,  G02B27/18 ,  G06N20/00

Abstract: An image generation system comprising an image rendering unit operable to render a first image for display to a first one of a user's eyes, an image obtaining unit operable to obtain a second image for a second one of the user's eyes, the obtained image having been rendered for display at an earlier time, an image reprojection unit operable to reproject the first image from a viewpoint associated with the first one of the user's eyes to a viewpoint associated with the second one of the user's eyes, and an image generation unit operable to generate an output image for the second one of the user's eyes in dependence upon the reprojected first image and the obtained second image.