公开(公告)号：US20200372116A1

公开(公告)日：2020-11-26

申请号：US16531343

申请日：2019-08-05

Applicant: salesforce.com, inc.

Inventor： Mingfei GAO ,  Richard SOCHER ,  Caiming Xiong

IPC: G06F17/28 ,  G06K9/62 ,  G06N3/08 ,  G06F17/10 ,  G06F16/73

Abstract: Systems and methods are provided for weakly supervised natural language localization (WSNLL), for example, as implemented in a neural network or model. The WSNLL network is trained with long, untrimmed videos, i.e., videos that have not been temporally segmented or annotated. The WSNLL network or model defines or generates a video-sentence pair, which corresponds to a pairing of an untrimmed video with an input text sentence. According to some embodiments, the WSNLL network or model is implemented with a two-branch architecture, where one branch performs segment sentence alignment and the other one conducts segment selection.