-
公开(公告)号:US10402987B2
公开(公告)日:2019-09-03
申请号:US15973090
申请日:2018-05-07
Applicant: QUALCOMM Incorporated
Abstract: Techniques and systems are provided for maintaining blob trackers for one or more video frames. For example, a blob tracker can be identified for a current video frame. The blob tracker is associated with a blob detected for the current video frame, and the blob includes pixels of at least a portion of one or more objects in the current video frame. One or more characteristics of the blob tracker are determined. The one or more characteristics are based on a bounding region history of the blob tracker. A confidence value is determined for the blob tracker based on the determined one or more characteristics, and a status of the blob tracker is determined based on the determined confidence value. The status of the blob tracker indicates whether to maintain the blob tracker for the one or more video frames. For example, the determined status can include a first type of blob tracker that is output as an identified blob tracker-blob pair, a second type of blob tracker that is maintained for further analysis, or a third type of blob tracker that is removed from a plurality of blob trackers maintained for the one or more video frames.
-
公开(公告)号:US20180286199A1
公开(公告)日:2018-10-04
申请号:US15655065
申请日:2017-07-20
Applicant: QUALCOMM Incorporated
IPC: G08B13/196 , G06K9/00 , G06T7/215 , G06T7/246
Abstract: Methods, apparatuses, and computer-readable media are provided for splitting one or more merged blobs for one or more video frames. For example, a merged blob detected for a current video frame is identified. The merged blob includes pixels of at least a portion of at least two foreground objects in the current video frame. The merged blob is associated with a first blob tracker and a second blob tracker. A shape of the first blob tracker can be adjusted. For instance, adjusting the shape of the first blob tracker can include shifting at least one boundary of a bounding region of the first blob tracker based on the shape of the merged blob. The merged blob can be split into a first blob and a second blob, with the first blob being associated with the adjusted bounding region of the first blob tracker and the second blob being associated with a bounding region of the a second blob tracker. The first blob and the second blob can then be output for object tracking for the current video frame.
-
公开(公告)号:US10726302B2
公开(公告)日:2020-07-28
申请号:US16204242
申请日:2018-11-29
Applicant: QUALCOMM Incorporated
Inventor: Shuai Zhang , Ying Chen , Yang Zhou
IPC: G06K9/62
Abstract: Methods, systems, and devices for object localization and classification are described. A device may configure a first unit of a detection layer associated with a learning framework when a quantity of output feature channels of an input feature maps is less than or equal to a quantity of input feature channels of the input feature maps. The first set of layers may include a group convolution layer, a pointwise layer, a batch normalization layer, or a rectified linear layer, or a combination thereof. The device may also configure, a second unit of the detection layer associated with the learning framework, when a second quantity of output feature channels of the input feature maps is less than or equal to a second quantity of input feature channels of the input feature maps. The second set of layers may include a depthwise layer or a pointwise layer, or both.
-
公开(公告)号:US20200175334A1
公开(公告)日:2020-06-04
申请号:US16204242
申请日:2018-11-29
Applicant: QUALCOMM Incorporated
Inventor: Shuai Zhang , Ying Chen , Yang Zhou
IPC: G06K9/62
Abstract: Methods, systems, and devices for object localization and classification are described. A device may configure a first unit of a detection layer associated with a learning framework when a quantity of output feature channels of an input feature maps is less than or equal to a quantity of input feature channels of the input feature maps. The first set of layers may include a group convolution layer, a pointwise layer, a batch normalization layer, or a rectified linear layer, or a combination thereof. The device may also configure, a second unit of the detection layer associated with the learning framework, when a second quantity of output feature channels of the input feature maps is less than or equal to a second quantity of input feature channels of the input feature maps. The second set of layers may include a depthwise layer or a pointwise layer, or both.
-
公开(公告)号:US20180374233A1
公开(公告)日:2018-12-27
申请号:US15635059
申请日:2017-06-27
Applicant: QUALCOMM Incorporated
Inventor: Yang Zhou , Ying Chen , Yingyong Qi , Ning Bi
CPC classification number: G06T7/70 , G06K9/4604 , G06K9/6201 , G06T7/248 , G06T7/251 , G06T2207/10016 , G06T2207/20081 , G06T2207/30196 , G06T2207/30232 , G06T2207/30241
Abstract: In various implementations, object tracking in a video content analysis system can be augmented with an image-based object re-identification system (e.g., for person re-identification or re-identification of other objects) to improve object tracking results for objects moving in a scene. The object re-identification system can use image recognition principles, which can be enhanced by considering data provided by object trackers that can be output by an object traffic system. In a testing stage, the object re-identification system can selectively test object trackers against object models. For most input video frames, not all object trackers need be tested against all object models. Additionally, different types of object trackers can be tested differently, so that a context provided by each object tracker can be considered. In a training stage, object models can also be selectively updated.
-
6.
公开(公告)号:US20180285647A1
公开(公告)日:2018-10-04
申请号:US15645455
申请日:2017-07-10
Applicant: QUALCOMM Incorporated
CPC classification number: G06K9/00718 , G06K9/4652 , G06K2009/00738
Abstract: Methods, apparatuses, and computer-readable media are provided for maintaining blob trackers for video frames. For example, a first blob tracker maintained for a current video frame is identified. The first blob tracker is associated with a blob detected in one or more video frames. The blob includes pixels of at least a portion of a foreground object in the one or more video frames. It is determined that the first blob tracker is a first type of tracker. Trackers having the first type are associated with objects that have transitioned at least partially into a background model (referred to as sleeping objects and sleeping trackers). One or more interactions are identified between the first blob tracker and at least one other blob tracker. The at least one other blob tracker can be the first type of tracker or can be a second type of tracker that is not a sleeping tracker (the second type of tracker is not associated with an object that has transitioned at least partially into the background model. A characteristic of the first blob tracker can then be modified based on the identified one or more interactions. Modifying the characteristic of the first blob tracker can include transitioning the first blob tracker from the first type of tracker to the second type of tracker, updating an appearance model of the first blob tracker, and/or other suitable characteristic of the first blob tracker.
-
公开(公告)号:US10553091B2
公开(公告)日:2020-02-04
申请号:US15655065
申请日:2017-07-20
Applicant: QUALCOMM Incorporated
IPC: G06K9/00 , G08B13/196 , G06T7/215 , G06T7/246 , G06K9/34 , G06K9/68 , G06K9/38 , G06T7/277 , G06K9/62 , G06K9/46 , G06K9/48 , G06T7/254 , G06K9/32
Abstract: Methods, apparatuses, and computer-readable media are provided for splitting one or more merged blobs for one or more video frames. For example, a merged blob detected for a current video frame is identified. The merged blob includes pixels of at least a portion of at least two foreground objects in the current video frame. The merged blob is associated with a first blob tracker and a second blob tracker. A shape of the first blob tracker can be adjusted. For instance, adjusting the shape of the first blob tracker can include shifting at least one boundary of a bounding region of the first blob tracker based on the shape of the merged blob. The merged blob can be split into a first blob and a second blob, with the first blob being associated with the adjusted bounding region of the first blob tracker and the second blob being associated with a bounding region of the a second blob tracker. The first blob and the second blob can then be output for object tracking for the current video frame.
-
公开(公告)号:US10395385B2
公开(公告)日:2019-08-27
申请号:US15635059
申请日:2017-06-27
Applicant: QUALCOMM Incorporated
Inventor: Yang Zhou , Ying Chen , Yingyong Qi , Ning Bi
Abstract: In various implementations, object tracking in a video content analysis system can be augmented with an image-based object re-identification system (e.g., for person re-identification or re-identification of other objects) to improve object tracking results for objects moving in a scene. The object re-identification system can use image recognition principles, which can be enhanced by considering data provided by object trackers that can be output by an object traffic system. In a testing stage, the object re-identification system can selectively test object trackers against object models. For most input video frames, not all object trackers need be tested against all object models. Additionally, different types of object trackers can be tested differently, so that a context provided by each object tracker can be considered. In a training stage, object models can also be selectively updated.
-
公开(公告)号:US20180254065A1
公开(公告)日:2018-09-06
申请号:US15637042
申请日:2017-06-29
Applicant: QUALCOMM Incorporated
IPC: G11B27/031 , G11B27/34 , G06T7/73
CPC classification number: G11B27/031 , G06K9/00718 , G06K9/342 , G06K9/38 , G06T7/248 , G06T7/254 , G06T7/74 , G06T2207/30196 , G11B27/34
Abstract: Methods, apparatuses, and computer-readable media are provided for splitting one or more merged blobs for one or more video frames. For example, a merged blob detected for a current video frame is identified. The merged blob includes pixels of at least a portion of at least two foreground objects in a video frame. A first blob tracker and a second blob tracker are associated with the merged blob. A location and/or a size of the first blob tracker associated with the merged blob is adjusted. The merged blob is split into a first blob and a second blob based on a history of blob trackers associated with the merged blob. The first blob is associated with the adjusted first blob tracker and the second blob is associated with the second blob tracker. The first blob and the second blob are then output for object tracking for the current frame.
-
公开(公告)号:US11004209B2
公开(公告)日:2021-05-11
申请号:US16158079
申请日:2018-10-11
Applicant: QUALCOMM Incorporated
Inventor: Ying Chen , Yang Zhou , Karthik Nagarajan , Ning Bi
Abstract: Techniques and systems are provided for tracking objects in one or more video frames. For example, a first set of one or more bounding regions are determined for a video frame based on a trained classification network applied to the video frame. The first set of one or more bounding regions are associated with one or more objects in the video frame. One or more blobs can be detected for the video frame. A blob includes pixels of at least a portion of an object in the video frame. A second set of one or more bounding regions are determined for the video frame that are associated with the one or more blobs. A final set of one or more bounding regions is determined for the video frame using the first set of one or more bounding regions and the second set of one or more bounding regions. Object tracking can then be performed for the video frame using the final set of one or more bounding regions.
-
-
-
-
-
-
-
-
-