公开(公告)号：US20250140291A1

公开(公告)日：2025-05-01

申请号：US18431139

申请日：2024-02-02

Applicant: ADOBE INC.

Inventor： Hanieh DEILAMSALEHY ,  Jui-Hsien WANG ,  Zhengyang MA ,  Dingzeyu LI ,  Hijung SHIN ,  Aseem Omprakash AGARWALA ,  Kim Pascal PIMMEL ,  Lubomira Assenova DONTCHEVA

IPC: G11B27/031 ,  G06V20/40 ,  G10L15/04 ,  G10L15/183 ,  G10L21/0272 ,  G10L25/57 ,  G11B27/06 ,  G11B27/34

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for identifying the relevant segments that effectively summarize the larger input video and/or form a rough cut, and assembling them into one or more smaller trimmed videos. For example, visual scenes and corresponding scene captions are extracted from the input video and associated with an extracted diarized and timestamped transcript to generate an augmented transcript. The augmented transcript is applied to a large language model to extract sentences that characterize a trimmed version of the input video (e.g., a natural language summary, a representation of identified sentences from the transcript). As such, corresponding video segments are identified (e.g., using similarity to match each sentence in a generated summary with a corresponding transcript sentence) and assembled into one or more trimmed videos. In some embodiments, the trimmed video is generated based on a user's query and/or desired length.