公开(公告)号：US12219297B2

公开(公告)日：2025-02-04

申请号：US17690588

申请日：2022-03-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Oliver Hume ,  Fabio Cappello ,  Timothy Bradley

IPC: H04N9/64 ,  G06T7/174 ,  G06T7/90 ,  G06V10/22 ,  G06V10/56 ,  G06V10/70 ,  G06V40/10 ,  G06V40/16

Abstract: An image processing system for modifying one or more images of a user to change a cardiovascular activity that is measurable from the one or more images, the system comprising: an image receiving section configured to receive image data comprising a plurality of image frames; a region selection section configured to select one or more regions where the colour of the skin of the user changes temporally in the image data, wherein the colour changes are indicative of the cardiovascular activity of the user; and a modifying section configured to modify the colour change of the one or more selected regions in one or more image frames to create modified image data, as described elsewhere herein.

公开(公告)号：US12214277B2

公开(公告)日：2025-02-04

申请号：US16906198

申请日：2020-06-19

Applicant: Sony Interactive Entertainment Inc.

Inventor： Matthew William Sanders ,  Fabio Cappello ,  Timothy Bradley ,  Jessica Rose Grant ,  Maurizio Cerrato

IPC: A63F13/352 ,  A63F13/327 ,  A63F13/335 ,  A63F13/525 ,  A63F13/573 ,  G06N3/08 ,  G06N20/00

Abstract: A method of generating video frames for a cloud-based video game includes obtaining, via a communications network, a plurality of frames of a video game rendered at a cloud device; obtaining a player input received at an input device, the input device being used to play the video game, the player input being received in response to the display of at least one of the obtained video frames; inputting at least one of the obtained video frames and the player input to a prediction model; and synthesizing, based on the output of the prediction model, a subsequent frame for output at a display, and outputting the synthesized video frame at the display.

公开(公告)号：US12143561B2

公开(公告)日：2024-11-12

申请号：US17574007

申请日：2022-01-12

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Maurizio Cerrato ,  Maria Chiara Monti ,  Rosario Leonardi

IPC: H04N13/344 ,  G02B27/01 ,  G02B27/18 ,  H04N13/363 ,  H04N13/383 ,  G06N20/00

Abstract: An image generation system comprising an image rendering unit operable to render a first image for display to a first one of a user's eyes, an image obtaining unit operable to obtain a second image for a second one of the user's eyes, the obtained image having been rendered for display at an earlier time, an image reprojection unit operable to reproject the first image from a viewpoint associated with the first one of the user's eyes to a viewpoint associated with the second one of the user's eyes, and an image generation unit operable to generate an output image for the second one of the user's eyes in dependence upon the reprojected first image and the obtained second image.

公开(公告)号：US11941772B2

公开(公告)日：2024-03-26

申请号：US17273573

申请日：2019-09-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Nigel John Williams ,  Rajeev Gupta

IPC: G06T19/20 ,  G06N3/04 ,  G06N3/08 ,  G06T7/10 ,  G06T7/50 ,  G06T7/90 ,  G06T15/04 ,  G06T17/00

CPC classification number: G06T19/20 ,  G06N3/04 ,  G06N3/08 ,  G06T7/10 ,  G06T7/50 ,  G06T7/90 ,  G06T15/04 ,  G06T17/00 ,  G06T2200/08 ,  G06T2207/10024 ,  G06T2207/20084 ,  G06T2207/30196 ,  G06T2219/2021

Abstract: A method of generating a three-dimensional (3D) reconstruction of a human includes obtaining at least one colour image and corresponding depth image of a scene comprising a human subject that is at least partially occluded by one or more items. The regions in the at least one colour image corresponding to a human subject are identified. A point cloud of the scene is generated based on the at least one colour image and corresponding depth image. One or more parameters of a parametric model are then adjusted based on the regions of the point cloud identified as corresponding to the human subject. The adjusted parametric model is then used to generate a 3D reconstruction of the human subject; where the parametric model provides an estimate for points in the point cloud corresponding to the occluded parts of the human subject. A corresponding system is also provided.

公开(公告)号：US11878250B2

公开(公告)日：2024-01-23

申请号：US17408687

申请日：2021-08-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Maria Chiara Monti ,  Fabio Cappello ,  Matthew Sanders ,  Timothy Bradley ,  Oliver Hume ,  Jason Craig Millson

IPC: A63F13/63 ,  A63F13/215 ,  A63F13/86 ,  A63F13/213 ,  A63F13/5372 ,  A63F13/5378 ,  A63F13/537 ,  A63F13/87 ,  A63F13/424 ,  G06F40/20

CPC classification number: A63F13/63 ,  A63F13/213 ,  A63F13/215 ,  A63F13/424 ,  A63F13/537 ,  A63F13/5372 ,  A63F13/5378 ,  A63F13/86 ,  A63F13/87 ,  G06F40/20

Abstract: A content modification system comprising a content receiving unit operable to receive content comprising a virtual environment and one or more active elements, an input receiving unit operable to receive inputs from one or more users, an element addition unit operable to generate one or more virtual elements within the virtual environment in response to the received inputs, the virtual elements being unable to be interacted with by the one or more active elements, and a content generation unit operable to generate modified content comprising the virtual environment, the one or more active elements, and the one or more generated virtual elements.

公开(公告)号：US11823045B2

公开(公告)日：2023-11-21

申请号：US17074827

申请日：2020-10-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark Jacobus Breugelmans ,  Oliver Hume ,  Fabio Cappello ,  Nigel John Williams

IPC: G06N3/08 ,  G06V10/30 ,  G06V10/40 ,  G06F21/62 ,  H04N1/44 ,  G06F18/214 ,  G06F18/241 ,  G06V10/764 ,  G06V10/82

CPC classification number: G06N3/08 ,  G06F18/214 ,  G06F18/241 ,  G06F21/6218 ,  G06V10/30 ,  G06V10/40 ,  G06V10/764 ,  G06V10/82 ,  H04N1/4486

Abstract: An encoding apparatus is provided. The apparatus comprises an input unit operable to obtain a plurality of training images, said training images being for use in training a machine learning model. The apparatus also comprises a label unit operable to obtain a class label associated with the training images; and a key unit operable to obtain a secret key for use in encoding the training images. The apparatus further comprises an image noise generator operable to generate, based on the obtained secret key, noise for introducing into the training images. The image noise generator is configured to generate noise that correlates with the class label associated with the training images such that a machine learning model subsequently trained with the modified training images learns to associate the introduced noise with the class label for those images. A corresponding decoding apparatus is also provided.

公开(公告)号：US11748072B2

公开(公告)日：2023-09-05

申请号：US17114543

申请日：2020-12-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Gregory James Bedwell ,  Daryl Cooper ,  Timothy Edward Bradley ,  Guy Moss

IPC: G06F8/41 ,  G06N20/00 ,  G06F8/30 ,  G06F11/30 ,  G06F11/34 ,  G06N5/04

CPC classification number: G06F8/443 ,  G06F8/30 ,  G06F8/4441 ,  G06F11/302 ,  G06F11/3447 ,  G06N5/04 ,  G06N20/00

Abstract: A data processing apparatus adapted to output recommendation information for modifying source code, includes: compiler circuitry to compile the source code and to output compiled code for the source code, processing circuitry to execute the compiled code, profile circuitry to monitor the execution of the compiled code by the processing circuitry and to generate profile information for the execution of the compiled code, the profile information including one or more statistical properties for the execution of the compiled code, and recommendation circuitry to output the recommendation information for the source code, the recommendation circuitry including a machine learning model to receive at least a portion of the profile information and trained to output the recommendation information for the source code in dependence upon one or more of the statistical properties, in which the recommendation information is indicative of one or more editing instructions for modifying the source code.

公开(公告)号：US11500459B2

公开(公告)日：2022-11-15

申请号：US17361495

申请日：2021-06-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Alexei Smith ,  Maria Chiara Monti

IPC: G06F3/01 ,  G06F3/04842 ,  G06F3/16 ,  G06T13/40 ,  G06T19/00 ,  H04N13/344

Abstract: A data processing apparatus includes processing circuitry to generate at least one of video content and audio content for a virtual reality environment, input circuitry to receive gaze data for two or more users indicative of a gaze point for each user with respect to the virtual reality environment, and selection circuitry to select at least one object in the virtual reality environment in dependence upon a number of the gaze points corresponding to the object, in which the processing circuitry is configured to adapt at least one of the video content and the audio content in response to the selection of the object.

公开(公告)号：US20220303514A1

公开(公告)日：2022-09-22

申请号：US17690588

申请日：2022-03-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Oliver Hume ,  Fabio Cappello ,  Timothy Bradley

IPC: H04N9/64 ,  G06V40/10 ,  G06T7/90 ,  G06V10/22 ,  G06T7/174 ,  G06V10/70 ,  G06V40/16 ,  G06V10/56

Abstract: An image processing system for modifying one or more images of a user to change a cardiovascular activity that is measurable from the one or more images, the system comprising: an image receiving section configured to receive image data comprising a plurality of image frames; a region selection section configured to select one or more regions where the colour of the skin of the user changes temporally in the image data, wherein the colour changes are indicative of the cardiovascular activity of the user; and a modifying section configured to modify the colour change of the one or more selected regions in one or more image frames to create modified image data, as described elsewhere herein.

公开(公告)号：US11335220B2

公开(公告)日：2022-05-17

申请号：US16745526

申请日：2020-01-17

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Eder ,  Fabio Cappello ,  Robert Keith John Withey ,  Nicola Penny Ann Cavalla ,  Hsinpei Yang

IPC: G02B27/14 ,  G09G3/00 ,  G06F1/16 ,  G03B21/00 ,  G03B35/18 ,  G02B30/31 ,  A63J5/02 ,  G02B30/22 ,  G09G5/38 ,  G02B5/32 ,  G02B30/00 ,  G02B30/56 ,  G06F3/041

Abstract: A cone for use in a Pepper's Ghost illusion includes a conical wall of semi-reflective material, and an attachment member for removably attaching the cone to the surface of a light emissive display, and a method of displaying a Pepper's Ghost illusion includes positioning a cone of semi-reflective material onto a light emissive display; and displaying on the light emissive display an image that has been distorted by an inverse of a distortion caused by a reflection of the cone.