公开(公告)号：US11501572B2

公开(公告)日：2022-11-15

申请号：US16363869

申请日：2019-03-25

Applicant: NVIDIA Corporation

Inventor： Milind Naphade ,  Shuo Wang

IPC: G06V40/20 ,  G06V20/52 ,  G06V20/54 ,  G06V20/58 ,  G06V20/62 ,  G06T7/246 ,  G06T7/73 ,  G06T7/292 ,  G06T7/70 ,  H04N5/247 ,  G06K9/62 ,  G06V10/147 ,  G06V10/20

Abstract: In various examples, a set of object trajectories may be determined based at least in part on sensor data representative of a field of view of a sensor. The set of object trajectories may be applied to a long short-term memory (LSTM) network to train the LSTM network. An expected object trajectory for an object in the field of view of the sensor may be computed by the LSTM network based at least in part an observed object trajectory. By comparing the observed object trajectory to the expected object trajectory, a determination may be made that the observed object trajectory is indicative of an anomaly.

公开(公告)号：US11683453B2

公开(公告)日：2023-06-20

申请号：US16991770

申请日：2020-08-12

Applicant: NVIDIA Corporation

Inventor： Milind Naphade ,  Parthasarathy Sriram ,  Farzin Aghdasi ,  Shuo Wang

IPC: H04N7/18 ,  G11B27/30 ,  G11B27/34 ,  G06V20/40

CPC classification number: H04N7/183 ,  G06V20/46 ,  G11B27/3081 ,  G11B27/34 ,  G06V2201/10

Abstract: In various examples, cloud computing systems may store frames of video streams and metadata generated from the frames in separate data stores, with each type of data being indexed using shared timestamps. Thus, the frames of a video stream may be stored and/or processed and corresponding metadata of the frames may be stored and/or generated across any number of devices of the cloud computing system (e.g., edge and/or core devices) while being linked by the timestamps. A client device may provide a request or query to dynamically annotate the video stream using a particular subset of the metadata. In processing the request or query, the timestamps may be used to retrieve video data representing frames of the video stream and metadata extracted from those frames across the data stores. The retrieved metadata and video data may be used to annotate the frames for display on the client device.

公开(公告)号：US20230036879A1

公开(公告)日：2023-02-02

申请号：US17964716

申请日：2022-10-12

Applicant: NVIDIA Corporation

Inventor： Milind Naphade ,  Shuo Wang

IPC: G06V40/20 ,  G06T7/246 ,  G06T7/73 ,  G06T7/292 ,  G06T7/70 ,  H04N5/247 ,  G06K9/62 ,  G06V10/147 ,  G06V10/20 ,  G06V20/52 ,  G06V20/54 ,  G06V20/58

Abstract: In various examples, a set of object trajectories may be determined based at least in part on sensor data representative of a field of view of a sensor. The set of object trajectories may be applied to a long short-term memory (LSTM) network to train the LSTM network. An expected object trajectory for an object in the field of view of the sensor may be computed by the LSTM network based at least in part an observed object trajectory. By comparing the observed object trajectory to the expected object trajectory, a determination may be made that the observed object trajectory is indicative of an anomaly.

公开(公告)号：US20190294869A1

公开(公告)日：2019-09-26

申请号：US16363869

申请日：2019-03-25

Applicant: NVIDIA Corporation

Inventor： Milind Naphade ,  Shuo Wang

IPC: G06K9/00 ,  G06T7/246 ,  G06T7/73

Abstract: In various examples, a set of object trajectories may be determined based at least in part on sensor data representative of a field of view of a sensor. The set of object trajectories may be applied to a long short-term memory (LSTM) network to train the LSTM network. An expected object trajectory for an object in the field of view of the sensor may be computed by the LSTM network based at least in part an observed object trajectory. By comparing the observed object trajectory to the expected object trajectory, a determination may be made that the observed object trajectory is indicative of an anomaly.

公开(公告)号：US20220391639A1

公开(公告)日：2022-12-08

申请号：US17337084

申请日：2021-06-02

Applicant: NVIDIA Corporation

Inventor： Prakash Gurumurthy ,  Milind Naphade ,  Yan Breek ,  Shuo Wang

IPC: G06K9/62 ,  G06N3/08 ,  G06T15/00

Abstract: Apparatuses, systems, and techniques to train neural networks to perform classification. In at least one embodiment, one or more neural networks are trained to perform classification based, at least in part, on grouping one or more sets of neural network training data according to behaviors of one or more objects within one or more images represented by the training data.

公开(公告)号：US20220165304A1

公开(公告)日：2022-05-26

申请号：US17103715

申请日：2020-11-24

Applicant: NVIDIA Corporation

Inventor： Milind Ramesh Naphade ,  Parthasarathy Sriram ,  Shuo Wang

IPC: G11B20/10 ,  H04N5/765 ,  G06N3/04

Abstract: Intelligent Video Analytics system may be implemented using a distributed computing architecture with edge and remote devices, where the edge devices analyze the video stream and transmit detection data corresponding to time segments to the remote device. The detection data may identify an object (e.g., vehicle, pedestrian, etc.) in the video stream. The remote device analyzes the detection data received from one or more edge devices and generates extraction triggers that are transmitted to the one or more edge devices. When an edge device receives an extraction trigger, the edge device extracts a clip from the video stream and stores the clip to persistent storage. The remote device may then retrieve the clip. The edge devices may perform simple identification operations while the remote device implements complex algorithms to detect events, benefitting from a larger context than is available to the individual edge devices.