公开(公告)号：US20240284011A1

公开(公告)日：2024-08-22

申请号：US18440024

申请日：2024-02-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ryan Spick ,  Timothy Edward Bradley ,  Guy David Moss ,  Ayush Raina ,  Pierluigi Amadori

IPC: H04N21/488 ,  G06T7/20 ,  G10L13/08 ,  H04N5/278

CPC classification number: H04N21/4884 ,  G06T7/20 ,  G10L13/08 ,  H04N5/278 ,  G06T2207/20084

Abstract: A data processing apparatus for determining description data for describing content includes: a video captioning model to receive an input comprising at least video images associated with the content, wherein the video captioning model is trained to detect one or more predetermined motions of one or more animated objects in the video images and determine one or more captions in dependence on one or more of the predetermined motions, one or more of the captions comprising respective caption data comprising one or more words for describing one or more of the predetermined motions, the respective caption data comprising one or more of audio data, text data and image data; and output circuitry to output description data in dependence on one or more of the captions.

公开(公告)号：US20240265679A1

公开(公告)日：2024-08-08

申请号：US18430733

申请日：2024-02-02

Applicant: Sony Interactive Entertainment Inc.

Inventor： Ryan Spick ,  Timothy Bradley ,  Guy Moss ,  Pierluigi Vito Amadori ,  Ayush Raina

IPC: G06V10/774

CPC classification number: G06V10/774

Abstract: An apparatus for generating datasets for training machine learning models includes: a receiving unit configured to receive video data comprising sequential image frames; a storage unit configured to store a plurality of the sequential image frames; and a selecting unit configured to select, for a target image frame, a subset of stored image frames, the subset providing contextual data relating to the target image frame for the machine learning model. The selecting unit is configured to successively generate sampling values, wherein a difference between successive sampling values increases with each successively generated sampling value; and the selecting unit is configured to select a given image frame from the stored image frames in dependence upon whether a number of sequential image frames between the given image frame and the target image frame coincides with one of the successively generated sampling values.