-
公开(公告)号:US12056807B2
公开(公告)日:2024-08-06
申请号:US17698186
申请日:2022-03-18
Applicant: Sony Interactive Entertainment Inc.
Inventor: Fabio Cappello , Matthew Sanders , Marina Villanueva Barreiro , Timothy Edward Bradley , Andrew James Bigos
CPC classification number: G06T15/20 , G06T15/506 , G06N20/00
Abstract: An image rendering method for rendering a pixel at a viewpoint includes, for a first element of a virtual scene, having a predetermined surface at a position within that scene; providing the position and a direction based on the viewpoint to a machine learning system previously trained to predict a factor that, when combined with a distribution function that characterises an interaction of light with the predetermined surface, generates a pixel value corresponding to the first element of the virtual scene as illuminated at the position, combining the predicted factor from the machine learning system with the distribution function to generate the pixel value corresponding to the illuminated first element of the virtual scene at the position, and incorporating the pixel value into a rendered image for display, where the machine learning system was previously trained with a training set based on images comprising multiple lighting conditions.
-
公开(公告)号:US20210031110A1
公开(公告)日:2021-02-04
申请号:US16929448
申请日:2020-07-15
Applicant: Sony Interactive Entertainment Inc.
Inventor: Timothy Edward Bradley , David Erwan Damien Uberti
IPC: A63F13/655 , G06T7/73 , G06T7/90 , G06T7/66 , G06F3/0346 , G06K9/62 , G06T11/00 , G06K9/48 , A63F13/428 , A63F13/533 , G06N20/00
Abstract: A system for generating video game inputs is provided. The system comprises an input unit operable to obtain images of a passive non-luminous object being held by a user as a video games controller. The system also comprises an object detector and object pose detector for detecting the object and its respective pose in the obtained images. The pose detector is configured to detect the pose of the object based on at least one of a (i) contour detection operation and (ii) the output of a machine learning model that has been trained to detect the poses of passive non-luminous objects in images. A user input generator is configured to generate user inputs based on the detected changes in pose of the passive non-luminous object and to transmit these to a video game unit at which a video game is being executed. A corresponding method is also provided.
-
公开(公告)号:US20240284011A1
公开(公告)日:2024-08-22
申请号:US18440024
申请日:2024-02-13
Applicant: Sony Interactive Entertainment Inc.
Inventor: Ryan Spick , Timothy Edward Bradley , Guy David Moss , Ayush Raina , Pierluigi Amadori
IPC: H04N21/488 , G06T7/20 , G10L13/08 , H04N5/278
CPC classification number: H04N21/4884 , G06T7/20 , G10L13/08 , H04N5/278 , G06T2207/20084
Abstract: A data processing apparatus for determining description data for describing content includes: a video captioning model to receive an input comprising at least video images associated with the content, wherein the video captioning model is trained to detect one or more predetermined motions of one or more animated objects in the video images and determine one or more captions in dependence on one or more of the predetermined motions, one or more of the captions comprising respective caption data comprising one or more words for describing one or more of the predetermined motions, the respective caption data comprising one or more of audio data, text data and image data; and output circuitry to output description data in dependence on one or more of the captions.
-
公开(公告)号:US11748072B2
公开(公告)日:2023-09-05
申请号:US17114543
申请日:2020-12-08
Applicant: Sony Interactive Entertainment Inc.
Inventor: Fabio Cappello , Gregory James Bedwell , Daryl Cooper , Timothy Edward Bradley , Guy Moss
CPC classification number: G06F8/443 , G06F8/30 , G06F8/4441 , G06F11/302 , G06F11/3447 , G06N5/04 , G06N20/00
Abstract: A data processing apparatus adapted to output recommendation information for modifying source code, includes: compiler circuitry to compile the source code and to output compiled code for the source code, processing circuitry to execute the compiled code, profile circuitry to monitor the execution of the compiled code by the processing circuitry and to generate profile information for the execution of the compiled code, the profile information including one or more statistical properties for the execution of the compiled code, and recommendation circuitry to output the recommendation information for the source code, the recommendation circuitry including a machine learning model to receive at least a portion of the profile information and trained to output the recommendation information for the source code in dependence upon one or more of the statistical properties, in which the recommendation information is indicative of one or more editing instructions for modifying the source code.
-
公开(公告)号:US20210035354A1
公开(公告)日:2021-02-04
申请号:US16939393
申请日:2020-07-27
Applicant: Sony Interactive Entertainment Inc.
Inventor: Nigel John Williams , Fabio Cappello , Timothy Edward Bradley , Rajeev Gupta
Abstract: A system for characterising surfaces in a real-world scene, the system comprising an object identification unit operable to identify one or more objects within one or more captured images of the real-world scene, a characteristic identification unit operable to identify one or more characteristics of one or more surfaces of the identified objects, and an information generation unit operable to generate information linking an object and one or more surface characteristics associated with that object.
-
公开(公告)号:US11908066B2
公开(公告)日:2024-02-20
申请号:US17699424
申请日:2022-03-21
Applicant: Sony Interactive Entertainment Inc.
Inventor: Marina Villanueva Barreiro , Andrew James Bigos , Gilles Christian Rainer , Fabio Cappello , Timothy Edward Bradley
Abstract: An image rendering method for rendering a pixel of a virtual scene at a viewpoint includes: downloading a machine learning system corresponding to a current or anticipated state an application determining the virtual scene to be rendered from among a plurality of machine learning systems corresponding to a plurality of states of the application; providing a position and a direction based on the viewpoint to the machine learning system previously trained to predict a factor; combining the predicted factor from the machine learning system with a distribution function that characterises an interaction of light with a predetermined surface to generate the pixel value corresponding to an illuminated first element of the virtual scene at the position; and incorporating the pixel value into a rendered image for display.
-
公开(公告)号:US11501486B2
公开(公告)日:2022-11-15
申请号:US16939393
申请日:2020-07-27
Applicant: Sony Interactive Entertainment Inc.
Inventor: Nigel John Williams , Fabio Cappello , Timothy Edward Bradley , Rajeev Gupta
Abstract: A system for characterising surfaces in a real-world scene, the system comprising an object identification unit operable to identify one or more objects within one or more captured images of the real-world scene, a characteristic identification unit operable to identify one or more characteristics of one or more surfaces of the identified objects, and an information generation unit operable to generate information linking an object and one or more surface characteristics associated with that object.
-
公开(公告)号:US20220309741A1
公开(公告)日:2022-09-29
申请号:US17699424
申请日:2022-03-21
Applicant: Sony Interactive Entertainment Inc.
Inventor: Marina Villanueva Barreiro , Andrew James Bigos , Gilles Christian Rainer , Fabio Cappello , Timothy Edward Bradley
Abstract: An image rendering method for an entertainment device for rendering a pixel at a viewpoint includes: for a first element of a virtual scene, having a predetermined surface at a position within that scene, obtaining a machine learning system previously trained to predict a factor that, when combined with a distribution function that characterises an interaction of light with the predetermined surface, generates a pixel value corresponding to the first element of the virtual scene as illuminated at the position; providing the position and a direction based on the viewpoint to the machine learning system; combining the predicted factor from the machine learning system with the distribution function to generate the pixel value corresponding to the illuminated first element of the virtual scene at the position; and incorporating the pixel value into a rendered image for display; where the obtaining step comprises: identifying a current or anticipated state of an application determining the virtual scene to be rendered; requesting a download of a machine learning system corresponding to the current or anticipated state, from among a plurality of machine learning systems corresponding to a plurality of states of the application, accessible via a remote server; and downloading the requested machine learning system.
-
公开(公告)号:US20220309740A1
公开(公告)日:2022-09-29
申请号:US17698186
申请日:2022-03-18
Applicant: Sony Interactive Entertainment Inc.
Inventor: Fabio Cappello , Matthew Sanders , Marina Villanueva Barreiro , Timothy Edward Bradley , Andrew James Bigos
Abstract: An image rendering method for rendering a pixel at a viewpoint includes, for a first element of a virtual scene, having a predetermined surface at a position within that scene; providing the position and a direction based on the viewpoint to a machine learning system previously trained to predict a factor that, when combined with a distribution function that characterises an interaction of light with the predetermined surface, generates a pixel value corresponding to the first element of the virtual scene as illuminated at the position, combining the predicted factor from the machine learning system with the distribution function to generate the pixel value corresponding to the illuminated first element of the virtual scene at the position, and incorporating the pixel value into a rendered image for display, where the machine learning system was previously trained with a training set based on images comprising multiple lighting conditions.
-
公开(公告)号:US11759701B2
公开(公告)日:2023-09-19
申请号:US16929448
申请日:2020-07-15
Applicant: Sony Interactive Entertainment Inc.
Inventor: Timothy Edward Bradley , David Erwan Damien Uberti
IPC: A63F13/213 , A63F13/428 , A63F13/533 , A63F13/655 , G06T7/66 , G06T7/73 , G06T7/90 , G06N20/00 , G06F3/0346 , G06T11/00 , G06F18/24 , G06F18/214 , G06V10/56 , G06V10/764 , G06V10/82 , G06V20/20
CPC classification number: A63F13/213 , A63F13/428 , A63F13/533 , A63F13/655 , G06F3/0346 , G06F18/214 , G06F18/24 , G06N20/00 , G06T7/66 , G06T7/73 , G06T7/90 , G06T11/00 , G06V10/56 , G06V10/764 , G06V10/82 , G06V20/20 , A63F2300/308 , A63F2300/6045 , A63F2300/695 , G06T2207/20081
Abstract: A system for generating video game inputs is provided. The system comprises an input unit operable to obtain images of a passive non-luminous object being held by a user as a video games controller. The system also comprises an object detector and object pose detector for detecting the object and its respective pose in the obtained images. The pose detector is configured to detect the pose of the object based on at least one of a (i) contour detection operation and (ii) the output of a machine learning model that has been trained to detect the poses of passive non-luminous objects in images. A user input generator is configured to generate user inputs based on the detected changes in pose of the passive non-luminous object and to transmit these to a video game unit at which a video game is being executed. A corresponding method is also provided.
-
-
-
-
-
-
-
-
-