-
公开(公告)号:US20250045568A1
公开(公告)日:2025-02-06
申请号:US18779294
申请日:2024-07-22
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew James Bigos , Roc Ramon Currius
IPC: G06N3/0455
Abstract: A hybrid codec for training a neural coding system, the hybrid codec including a real codec for encoding data pre-processed by a first neural network, and for decoding the encoded data for post-processing by a second neural network; and a proxy codec that is a differentiable representation of the real codec, and is for back-propagating a loss function, representative of a coding bit-rate and a coding distortion between the post-processed data and the original data, for training the weights of at least the first neural network.
-
公开(公告)号:US11908066B2
公开(公告)日:2024-02-20
申请号:US17699424
申请日:2022-03-21
Applicant: Sony Interactive Entertainment Inc.
Inventor: Marina Villanueva Barreiro , Andrew James Bigos , Gilles Christian Rainer , Fabio Cappello , Timothy Edward Bradley
Abstract: An image rendering method for rendering a pixel of a virtual scene at a viewpoint includes: downloading a machine learning system corresponding to a current or anticipated state an application determining the virtual scene to be rendered from among a plurality of machine learning systems corresponding to a plurality of states of the application; providing a position and a direction based on the viewpoint to the machine learning system previously trained to predict a factor; combining the predicted factor from the machine learning system with a distribution function that characterises an interaction of light with a predetermined surface to generate the pixel value corresponding to an illuminated first element of the virtual scene at the position; and incorporating the pixel value into a rendered image for display.
-
公开(公告)号:US20220309741A1
公开(公告)日:2022-09-29
申请号:US17699424
申请日:2022-03-21
Applicant: Sony Interactive Entertainment Inc.
Inventor: Marina Villanueva Barreiro , Andrew James Bigos , Gilles Christian Rainer , Fabio Cappello , Timothy Edward Bradley
Abstract: An image rendering method for an entertainment device for rendering a pixel at a viewpoint includes: for a first element of a virtual scene, having a predetermined surface at a position within that scene, obtaining a machine learning system previously trained to predict a factor that, when combined with a distribution function that characterises an interaction of light with the predetermined surface, generates a pixel value corresponding to the first element of the virtual scene as illuminated at the position; providing the position and a direction based on the viewpoint to the machine learning system; combining the predicted factor from the machine learning system with the distribution function to generate the pixel value corresponding to the illuminated first element of the virtual scene at the position; and incorporating the pixel value into a rendered image for display; where the obtaining step comprises: identifying a current or anticipated state of an application determining the virtual scene to be rendered; requesting a download of a machine learning system corresponding to the current or anticipated state, from among a plurality of machine learning systems corresponding to a plurality of states of the application, accessible via a remote server; and downloading the requested machine learning system.
-
公开(公告)号:US20220309740A1
公开(公告)日:2022-09-29
申请号:US17698186
申请日:2022-03-18
Applicant: Sony Interactive Entertainment Inc.
Inventor: Fabio Cappello , Matthew Sanders , Marina Villanueva Barreiro , Timothy Edward Bradley , Andrew James Bigos
Abstract: An image rendering method for rendering a pixel at a viewpoint includes, for a first element of a virtual scene, having a predetermined surface at a position within that scene; providing the position and a direction based on the viewpoint to a machine learning system previously trained to predict a factor that, when combined with a distribution function that characterises an interaction of light with the predetermined surface, generates a pixel value corresponding to the first element of the virtual scene as illuminated at the position, combining the predicted factor from the machine learning system with the distribution function to generate the pixel value corresponding to the illuminated first element of the virtual scene at the position, and incorporating the pixel value into a rendered image for display, where the machine learning system was previously trained with a training set based on images comprising multiple lighting conditions.
-
公开(公告)号:US11315309B2
公开(公告)日:2022-04-26
申请号:US16220173
申请日:2018-12-14
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jason Gordon Doig , Andrew James Bigos
Abstract: An apparatus includes: an object data storage section that stores polygon identification data for polygons of an object to be displayed; a reference image data storage section that stores data of reference images each representing an image when a space including the object to be displayed is viewed from one of a plurality of prescribed reference viewing points, and further stores polygon identification data corresponding to each reference image; a viewing point information acquisition section that acquires information relating to a viewing point; a projection section that represents on a plane of a display image the position and shape of an image of the object when the space is viewed from the viewing point; a pixel value determination section that determines the values of pixels constituting the image of the object in the display image, using the values of the pixels representing the same image in one or more of the plurality of reference images; and an output section that outputs the data of the display image; wherein for a subject pixel, the pixel value determination section is arranged to determine the position on a reference image corresponding to the position of the subject pixel on the object, obtain the polygon identification corresponding to the determined position on the reference image, compare the obtained polygon identification with the polygon identification of the polygon corresponding to the position of the subject pixel on the object; and select the reference image if the compared polygon identifications match.
-
公开(公告)号:US11097486B2
公开(公告)日:2021-08-24
申请号:US16627852
申请日:2018-07-04
Applicant: Sony Interactive Entertainment Inc.
Inventor: Andrew James Bigos
IPC: B33Y50/02 , B29C64/386 , G06T17/00 , B33Y10/00
Abstract: A method of 3D print modelling includes: generating a point cloud representation of a target virtual object for 3D printing, generating a voxel representation of the point cloud by adding a respective first voxel when a respective first point from the point cloud representation is located in the notional volume occupied by that first voxel, assigning a first colour associated with the first point to the faces of the first voxel, and if a second point from the point cloud representation is located within the volume of the first voxel, assigning a second colour associated with the second point to a respective face of the new voxel corresponding to the normal of the second point; and thickening the voxel representation of the point cloud by generating a duplicate voxel adjacent to the first voxel along a first axis passing through two opposing faces of the first voxel respectively having the first and second colours.
-
公开(公告)号:US10974459B2
公开(公告)日:2021-04-13
申请号:US16520394
申请日:2019-07-24
Applicant: Sony Interactive Entertainment Inc.
Inventor: Robert Keith John Withey , Andrew James Bigos
IPC: B29C64/393 , G06T15/80 , G06T17/00 , G06F30/00 , B33Y50/02
Abstract: A flood-fill method for parallel implementation includes the steps of receiving an image including first elements having a flood fill source colour to be replaced with a flood fill target colour, and second elements not having the flood fill source colour; dividing the image according to a hierarchical space-partitioning scheme to form cells at a plurality of levels in the hierarchy; detecting the occupancy of each cell by second elements; for any cell having no occupancy by second elements, set a depth elevation value for child cells of that cell to be one greater than the value for that cell, indicating that the flood fill shall navigate levels towards a root cell by the depth elevation amount of a cell whilst only occupying nodes without any second elements, thereby reaching the largest parent cell which can be flood-filled; and filling the flood fill source colour of cells having no occupancy by second elements with the flood fill target colour, thereby modifying the received image.
-
公开(公告)号:US20200234486A1
公开(公告)日:2020-07-23
申请号:US16652463
申请日:2018-11-07
Inventor: Andrew James Bigos
IPC: G06T15/08
Abstract: A method of generating a model for 3D printing includes selecting a target object within a virtual environment; sampling the target object to form a point cloud, the point cloud comprising points corresponding to an outer surface of the target object and also one or more internal features of the target object; rendering the point cloud from a plurality of viewpoints using voxels in place of the points in the point cloud; detecting which voxels and hence which points of the cloud were rendered over the plurality of renders; forming a surface-only point cloud comprising those points of the cloud that were rendered; and generating a model for 3D printing based on the surface-only point cloud.
-
公开(公告)号:US20190188902A1
公开(公告)日:2019-06-20
申请号:US16220173
申请日:2018-12-14
Applicant: Sony Interactive Entertainment Inc.
Inventor: Jason Gordon Doig , Andrew James Bigos
CPC classification number: G06T15/205 , G02B27/017 , G06T15/005 , G06T15/04 , G06T15/06 , G06T15/20 , G06T17/00 , G06T17/05
Abstract: An apparatus includes: an object data storage section that stores polygon identification data for polygons of an object to be displayed; a reference image data storage section that stores data of reference images each representing an image when a space including the object to be displayed is viewed from one of a plurality of prescribed reference viewing points, and further stores polygon identification data corresponding to each reference image; a viewing point information acquisition section that acquires information relating to a viewing point; a projection section that represents on a plane of a display image the position and shape of an image of the object when the space is viewed from the viewing point; a pixel value determination section that determines the values of pixels constituting the image of the object in the display image, using the values of the pixels representing the same image in one or more of the plurality of reference images; and an output section that outputs the data of the display image; wherein for a subject pixel, the pixel value determination section is arranged to determine the position on a reference image corresponding to the position of the subject pixel on the object, obtain the polygon identification corresponding to the determined position on the reference image, compare the obtained polygon identification with the polygon identification of the polygon corresponding to the position of the subject pixel on the object; and select the reference image if the compared polygon identifications match.
-
公开(公告)号:US09922456B2
公开(公告)日:2018-03-20
申请号:US15084725
申请日:2016-03-30
Applicant: Sony Interactive Entertainment Inc.
Inventor: Richard James Forster , Andrew James Bigos , Joseph Charles Boulter , Neil Jonathan Brown , Masakazu Suzuoki , Masakazu Hayashi , Norihiro Nagai
CPC classification number: G06T17/10 , A63F13/25 , A63F13/63 , B33Y50/00 , B33Y80/00 , G06T15/00 , G06T17/00 , G06T19/20
Abstract: Aspects of the technology include method of selecting an object from a videogame for 3D printing. The method involves periodically rendering a virtual environment of a videogame for display at a succession of points in time. Information is periodically recorded that enables visual reconstruction of at least part of the virtual environment at a succession of points in time. A predetermined set of values is periodically recorded responsive to the state of the rendered virtual environment at a succession of points in time. The predetermined set of values enables a model of a selected part of the rendered virtual environment to be generated that is configured for 3D printing.
-
-
-
-
-
-
-
-
-