公开(公告)号：US11823045B2

公开(公告)日：2023-11-21

申请号：US17074827

申请日：2020-10-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Mark Jacobus Breugelmans ,  Oliver Hume ,  Fabio Cappello ,  Nigel John Williams

IPC: G06N3/08 ,  G06V10/30 ,  G06V10/40 ,  G06F21/62 ,  H04N1/44 ,  G06F18/214 ,  G06F18/241 ,  G06V10/764 ,  G06V10/82

CPC classification number: G06N3/08 ,  G06F18/214 ,  G06F18/241 ,  G06F21/6218 ,  G06V10/30 ,  G06V10/40 ,  G06V10/764 ,  G06V10/82 ,  H04N1/4486

Abstract: An encoding apparatus is provided. The apparatus comprises an input unit operable to obtain a plurality of training images, said training images being for use in training a machine learning model. The apparatus also comprises a label unit operable to obtain a class label associated with the training images; and a key unit operable to obtain a secret key for use in encoding the training images. The apparatus further comprises an image noise generator operable to generate, based on the obtained secret key, noise for introducing into the training images. The image noise generator is configured to generate noise that correlates with the class label associated with the training images such that a machine learning model subsequently trained with the modified training images learns to associate the introduced noise with the class label for those images. A corresponding decoding apparatus is also provided.

公开(公告)号：US11762459B2

公开(公告)日：2023-09-19

申请号：US17359845

申请日：2021-06-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Andrew William Walker ,  Nigel John Williams ,  Mandana Jenabzadeh ,  Rosario Leonardi

IPC: G06F3/01 ,  H04N13/371 ,  H04N13/383 ,  H04N13/282

CPC classification number: G06F3/013 ,  G06F3/012 ,  H04N13/282 ,  H04N13/371 ,  H04N13/383

Abstract: An apparatus includes a video display to display video images to a user; a gaze detector configured to detect a gaze direction for one or both eyes of the user while the user views the display; a head tracker configured to detect a head orientation of the user; an image processor configured to generate the video images for display by the video display; the image processor being responsive to one or more control functions dependent upon the gaze direction detected by the gaze detector; and a controller configured to detect a predetermined condition and, in response to detection of the predetermined condition, to control the image processor to be responsive to one or more control functions dependent upon the head orientation detected by the head tracker in place of the one or more control functions dependent upon the gaze direction detected by the gaze detector.

公开(公告)号：US11650417B2

公开(公告)日：2023-05-16

申请号：US17381466

申请日：2021-07-21

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nigel John Williams ,  Patrick John Connor

IPC: G02B27/00 ,  G02B27/01 ,  G06F3/01

CPC classification number: G02B27/0093 ,  G02B27/017 ,  G06F3/013 ,  G02B2027/014 ,  G02B2027/0112 ,  G02B2027/0118 ,  G02B2027/0138

Abstract: Apparatus comprises an image processor configured to provide output video images to a head mountable display, HMD, having one or more display elements to display video images to a wearer of the HMD, for display by the one or more display elements in response to input video images, in which each output video image corresponds to a respective input video image; in which: the image processor comprises a detector configured to detect whether an input image brightness at image locations in the input video images exceeds a threshold image brightness; and the image processor is configured to vary a relationship between the display properties at a given image location in a given output video image and the input image display properties at the given image location in the corresponding input video image in response to a detection that image brightness at the given image location in one or more input video images preceding that corresponding input video image exceeded the threshold image brightness.

公开(公告)号：US11498223B2

公开(公告)日：2022-11-15

申请号：US16401221

申请日：2019-05-02

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nigel John Williams

IPC: B25J11/00 ,  B25J9/16 ,  A63F13/803 ,  A63F13/23

Abstract: A system for controlling interactions between a plurality of real and virtual robots, includes one or more real robots present in the real environment, one or more virtual robots present in a virtual environment corresponding to the real environment, and a processing device operable to control interactions between one or more of the real robots and one or more of the virtual robots, where the interactions between the real and virtual robots are dependent upon at least the positions of the one or more real robots in the real environment and the positions of the one or more virtual robots in the virtual environment.

公开(公告)号：US20210256776A1

公开(公告)日：2021-08-19

申请号：US17273573

申请日：2019-09-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Fabio Cappello ,  Nigel John Williams ,  Rajeev Gupta

IPC: G06T19/20 ,  G06T7/90 ,  G06T7/50 ,  G06T17/00 ,  G06T15/04 ,  G06T7/10 ,  G06N3/04 ,  G06N3/08

Abstract: A method of generating a three-dimensional (3D) reconstruction of a human includes obtaining at least one colour image and corresponding depth image of a scene comprising a human subject that is at least partially occluded by one or more items. The regions in the at least one colour image corresponding to a human subject are identified. A point cloud of the scene is generated based on the at least one colour image and corresponding depth image. One or more parameters of a parametric model are then adjusted based on the regions of the point cloud identified as corresponding to the human subject. The adjusted parametric model is then used to generate a 3D reconstruction of the human subject; where the parametric model provides an estimate for points in the point cloud corresponding to the occluded parts of the human subject. A corresponding system is also provided.

公开(公告)号：US10971115B2

公开(公告)日：2021-04-06

申请号：US16559965

申请日：2019-09-04

Applicant: Sony Interactive Entertainment Inc.

Inventor： Matthew William Sanders ,  Nigel John Williams ,  Richard James Forster ,  Andrew William Walker ,  Jessica Rose Grant

IPC: G09G5/373 ,  G06F3/01 ,  H04L29/08

Abstract: A foveated rendering system for modifying content to be displayed includes a user profile obtaining unit operable to obtain a user profile comprising information about head motion and eye motion for a user, and a foveated rendering unit operable to apply a foveated rendering process to the content to be displayed in dependence upon obtained user profile information.

公开(公告)号：US20210035354A1

公开(公告)日：2021-02-04

申请号：US16939393

申请日：2020-07-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Nigel John Williams ,  Fabio Cappello ,  Timothy Edward Bradley ,  Rajeev Gupta

IPC: G06T15/20 ,  G01B11/30 ,  G01N21/55 ,  G06K9/00 ,  G06T7/529 ,  G06K9/46 ,  G06T15/50

Abstract: A system for characterising surfaces in a real-world scene, the system comprising an object identification unit operable to identify one or more objects within one or more captured images of the real-world scene, a characteristic identification unit operable to identify one or more characteristics of one or more surfaces of the identified objects, and an information generation unit operable to generate information linking an object and one or more surface characteristics associated with that object.