公开(公告)号：US20240020337A1

公开(公告)日：2024-01-18

申请号：US17811963

申请日：2022-07-12

Applicant: ADOBE INC.

Inventor： Adyasha Maharana ,  Quan Hung Tran ,  Seunghyun Yoon ,  Franck Dernoncourt ,  Trung Huu Bui ,  Walter W. Chang

IPC: G06F16/738 ,  G10L13/08 ,  G06F40/284 ,  G06F16/783

CPC classification number: G06F16/739 ,  G10L13/08 ,  G06F40/284 ,  G06F16/7844

Abstract: Systems and methods for intent discovery and video summarization are described. Embodiments of the present disclosure receive a video and a transcript of the video, encode the video to obtain a sequence of video encodings, encode the transcript to obtain a sequence of text encodings, apply a visual gate to the sequence of text encodings based on the sequence of video encodings to obtain gated text encodings, and generate an intent label for the transcript based on the gated text encodings.

公开(公告)号：US12124508B2

公开(公告)日：2024-10-22

申请号：US17811963

申请日：2022-07-12

Applicant: ADOBE INC.

Inventor： Adyasha Maharana ,  Quan Hung Tran ,  Seunghyun Yoon ,  Franck Dernoncourt ,  Trung Huu Bui ,  Walter W. Chang

IPC: G06F16/73 ,  G06F16/738 ,  G06F16/783 ,  G06F40/284 ,  G10L13/08

CPC classification number: G06F16/739 ,  G06F16/7844 ,  G06F40/284 ,  G10L13/08

Abstract: Systems and methods for intent discovery and video summarization are described. Embodiments of the present disclosure receive a video and a transcript of the video, encode the video to obtain a sequence of video encodings, encode the transcript to obtain a sequence of text encodings, apply a visual gate to the sequence of text encodings based on the sequence of video encodings to obtain gated text encodings, and generate an intent label for the transcript based on the gated text encodings.