-
公开(公告)号：US20230148017A1
公开(公告)日：2023-05-11
申请号：US17960370
申请日：2022-10-05
Applicant: NEC Laboratories America, Inc.
Inventor： Asim Kadav , Farley Lai , Hans Peter Graf , Honglu Zhou
IPC: G06V20/40 , G06V40/10 , G06V10/77 , G06V10/774
CPC classification number: G06V20/41 , G06V10/774 , G06V10/7715 , G06V20/46 , G06V20/49 , G06V40/10
Abstract: A method for compositional reasoning of group activity in videos with keypoint-only modality is presented. The method includes obtaining video frames from a video stream received from a plurality of video image capturing devices, extracting keypoints all of persons detected in the video frames to define keypoint data, tokenizing the keypoint data with time and segment information, clustering groups of keypoint persons in the video frames and passing the clustering groups through multi-scale prediction, and performing a prediction to provide a group activity prediction of a scene in the video frames.
-
公开(公告)号：US11741712B2
公开(公告)日：2023-08-29
申请号：US17463757
申请日：2021-09-01
Applicant: NEC Laboratories America, Inc.
Inventor： Asim Kadav , Farley Lai , Hans Peter Graf , Alexandru Niculescu-Mizil , Renqiang Min , Honglu Zhou
IPC: G06V20/40 , G06T7/73 , G06T7/246 , G06F18/213 , G06N3/045
CPC classification number: G06V20/41 , G06F18/213 , G06N3/045 , G06T7/246 , G06T7/73 , G06V20/46 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06V2201/07
Abstract: A method for using a multi-hop reasoning framework to perform multi-step compositional long-term reasoning is presented. The method includes extracting feature maps and frame-level representations from a video stream by using a convolutional neural network (CNN), performing object representation learning and detection, linking objects through time via tracking to generate object tracks and image feature tracks, feeding the object tracks and the image feature tracks to a multi-hop transformer that hops over frames in the video stream while concurrently attending to one or more of the objects in the video stream until the multi-hop transformer arrives at a correct answer, and employing video representation learning and recognition from the objects and image context to locate a target object within the video stream.
-
公开(公告)号：US20250157353A1
公开(公告)日：2025-05-15
申请号：US18944762
申请日：2024-11-12
Applicant: NEC Laboratories America, Inc.
Inventor： Honglu Zhou , Renqiang Min
Abstract: Systems and methods include predicting a first action step and a last action step based on an initial visual observation and a goal visual state and retrieving multiple procedural plans from a procedural knowledge graph (PKG), trained using a set of training instructional videos, which start with the first action step and end with the last action step. A procedure plan is generated using the retrieved multiple procedural plans. An instructional video is generated based on the procedure plan.
-
公开(公告)号：US20220101007A1
公开(公告)日：2022-03-31
申请号：US17463757
申请日：2021-09-01
Applicant: NEC Laboratories America, Inc.
Inventor： Asim Kadav , Farley Lai , Hans Peter Graf , Alexandru Niculescu-Mizil , Renqiang Min , Honglu Zhou
Abstract: A method for using a multi-hop reasoning framework to perform multi-step compositional long-term reasoning is presented. The method includes extracting feature maps and frame-level representations from a video stream by using a convolutional neural network (CNN), performing object representation learning and detection, linking objects through time via tracking to generate object tracks and image feature tracks, feeding the object tracks and the image feature tracks to a multi-hop transformer that hops over frames in the video stream while concurrently attending to one or more of the objects in the video stream until the multi-hop transformer arrives at a correct answer, and employing video representation learning and recognition from the objects and image context to locate a target object within the video stream.
-
-
-
Search Results
4
records
(took 0.012 seconds)
