公开(公告)号：US12067365B2

公开(公告)日：2024-08-20

申请号：US17398554

申请日：2021-08-10

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Jin-Young Moon ,  Jung-Kyoo Shin ,  Hyung-Il Kim

IPC: G06F40/30 ,  G06F18/2411 ,  G06F40/205 ,  G06V20/40

CPC classification number: G06F40/30 ,  G06F18/2411 ,  G06F40/205 ,  G06V20/41

Abstract: Disclosed herein are an apparatus for detecting a moment described by a sentence query in a video and a method using the same. A method for detecting a moment described by a sentence query in a video includes dividing an input video into units of chunks and generating a chunk-level feature sequence based on features that are extracted in a form of vectors from respective chunks, dividing an input sentence query into units of words and generating a sentence-level feature sequence based on features that are extracted in a form of vectors from respective words, generating a chunk-sentence relation feature sequence including contextual information of the video by extracting a relation between the chunk-level feature sequence and the sentence-level feature sequence, and estimating a temporal interval corresponding to the sentence query in the video based on the chunk-sentence relation feature sequence.