公开(公告)号：US20240185135A1

公开(公告)日：2024-06-06

申请号：US18513849

申请日：2023-11-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ryan Spick ,  Guy Moss ,  Timothy Bradley ,  Pierluigi Vito Amadori

IPC: G06N20/00

CPC classification number: G06N20/00

Abstract: A system for generating a training dataset for a machine learning process, and training a machine learning model, the system comprising a data obtaining unit configured to obtain training data comprising a plurality of events of interest and the behaviour of an agent corresponding to those events, an event identifying unit configured to identify, based upon one or more corresponding indicators, the occurrence of an event of interest in the training data, a list generating unit configured to generate a list of identified events in the training data, wherein identified events are added to the list with a probability that is inversely proportional to the frequency of the occurrence of that event within the training data, a dataset generating unit configured to generate a dataset comprising information about the events contained in the generated list, and a training unit configured to train a machine learning model using the generated dataset, wherein the machine learning model is trained to generate behaviour for an agent corresponding to events within the generated dataset.

公开(公告)号：US20240265679A1

公开(公告)日：2024-08-08

申请号：US18430733

申请日：2024-02-02

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ryan Spick ,  Timothy Bradley ,  Guy Moss ,  Pierluigi Vito Amadori ,  Ayush Raina

IPC: G06V10/774

CPC classification number: G06V10/774

Abstract: An apparatus for generating datasets for training machine learning models includes: a receiving unit configured to receive video data comprising sequential image frames; a storage unit configured to store a plurality of the sequential image frames; and a selecting unit configured to select, for a target image frame, a subset of stored image frames, the subset providing contextual data relating to the target image frame for the machine learning model. The selecting unit is configured to successively generate sampling values, wherein a difference between successive sampling values increases with each successively generated sampling value; and the selecting unit is configured to select a given image frame from the stored image frames in dependence upon whether a number of sequential image frames between the given image frame and the target image frame coincides with one of the successively generated sampling values.

公开(公告)号：US20240284011A1

公开(公告)日：2024-08-22

申请号：US18440024

申请日：2024-02-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ryan Spick ,  Timothy Edward Bradley ,  Guy David Moss ,  Ayush Raina ,  Pierluigi Amadori

IPC: H04N21/488 ,  G06T7/20 ,  G10L13/08 ,  H04N5/278

CPC classification number: H04N21/4884 ,  G06T7/20 ,  G10L13/08 ,  H04N5/278 ,  G06T2207/20084

Abstract: A data processing apparatus for determining description data for describing content includes: a video captioning model to receive an input comprising at least video images associated with the content, wherein the video captioning model is trained to detect one or more predetermined motions of one or more animated objects in the video images and determine one or more captions in dependence on one or more of the predetermined motions, one or more of the captions comprising respective caption data comprising one or more words for describing one or more of the predetermined motions, the respective caption data comprising one or more of audio data, text data and image data; and output circuitry to output description data in dependence on one or more of the captions.