公开(公告)号：US20230083476A1

公开(公告)日：2023-03-16

申请号：US17881151

申请日：2022-08-04

Applicant: Electronics and Telecommunications Research Institute

Inventor： Jin Young MOON ,  Jung Kyoo SHIN

IPC: G06F16/732 ,  G06V20/40 ,  G06V10/82 ,  G06F40/279 ,  G06F40/30

Abstract: Provided is a method of detecting a semantics section in a video. The method includes extracting all video features by inputting an inputted video to a pre-trained first deep neural network algorithm, extracting a query sentence feature by inputting an inputted query sentence to a pre-trained second deep neural network algorithm, generating video-query relation integration feature information in which all of the video features and the query sentence feature have been integrated by inputting all of the video features and the query sentence feature to a plurality of scaled-dot product attention layers, and estimating a video segment corresponding to the query sentence in the video based on the video-query relation integration feature information.