-
公开(公告)号:US11636694B2
公开(公告)日:2023-04-25
申请号:US17185800
申请日:2021-02-25
Applicant: QUALCOMM Incorporated
Inventor: Xin Li , Chun-Ting Huang , Lei Wang , Ning Bi
IPC: G06K9/62 , G06V20/59 , G06V20/40 , G06F18/214 , G06F18/20
Abstract: Systems and techniques are provided for performing video-based activity recognition. For example, a process can include extracting, using a first machine learning model, first one or more features from a first frame and second one or more features from a second frame. The first one or more features and the second one or more features are associated with a person driving a vehicle. The process can include processing, using a second machine learning model, the first one or more features and the second one or more features. The process can include determining, based on processing of the first one or more features and the second one or more features using the second machine learning model, at least one activity associated with the person driving the vehicle.
-
公开(公告)号:US10375399B2
公开(公告)日:2019-08-06
申请号:US15134183
申请日:2016-04-20
Applicant: QUALCOMM Incorporated
Inventor: Lei Wang , Ying Chen , Ning Bi , Xuerui Zhang , Lei Ma , Chinchuan Chiu , Jianfeng Ren
IPC: H04N19/159 , H04N19/105 , H04N19/172 , H04N19/182 , H04N19/58 , H04N19/23 , G06T7/254
Abstract: Techniques and systems are provided for generating a background picture. The background picture can be used for coding one or more pictures. For example, a method of generating a background picture includes generating a long-term background model for one or more pixels of a background picture. The long-term background model includes a statistical model for detecting long-term motion of the one or more pixels in a sequence of pictures. The method further includes generating a short-term background model for the one or more pixels of the background picture. The short-term background model detects short-term motion of the one or more pixels between two or more pictures. The method further includes determining a value for the one or more pixels of the background picture using the long-term background model and the short-term background model.
-
公开(公告)号:US10269135B2
公开(公告)日:2019-04-23
申请号:US15645555
申请日:2017-07-10
Applicant: QUALCOMM Incorporated
Inventor: Ying Chen , Zhongmin Wang , Lei Wang
Abstract: Methods, apparatuses, and computer-readable media are provided for maintaining blob trackers for video frames. For example, a blob tracker maintained for a current video frame is identified. The blob tracker is associated with a blob detected in one or more video frames. The blob includes pixels of at least a portion of a foreground object in the one or more video frames. A current bounding region of the blob tracker for the current video frame is compared to a previous bounding region of the blob tracker for a previous video frame that is obtained earlier in time than the current video frame. It can be determined whether the current bounding region has decreased in size as compared to a size of the previous bounding region, and whether a first color characteristic of pixels of the current video frame included in the previous bounding region is within a threshold from a second color characteristic of pixels of the previous video frame included in the previous bounding region. In some examples, the blob is tracked in the current frame using the current bounding region when the current bounding region has decreased in size and when the first color characteristic is within the threshold from the second color characteristic. In some examples, the blob is tracked using the current bounding region when the blob tracker is determined to be lost (e.g., the blob tracker is not associated with the blob in the current video frame).
-
公开(公告)号:US10055669B2
公开(公告)日:2018-08-21
申请号:US15235999
申请日:2016-08-12
Applicant: QUALCOMM Incorporated
Inventor: Ying Chen , Ning Bi , Lei Wang , Jinglun Gao
CPC classification number: G06K9/4642 , G06K9/00711 , G06K9/38 , G06T7/11 , G06T7/136 , G06T7/194 , G06T7/254 , G06T2207/10016 , G06T2207/30232 , G06T2207/30242
Abstract: Techniques and systems are provided for processing video data. For example, techniques and systems are provided for determining blob size thresholds. Blob sizes of blobs generated for a video frame can be determined. A lower boundary of a category of blob sizes can then be determined that corresponds to a minimum blob size of the video frame. The lower boundary is determined from a plurality of possible blob sizes including the blob sizes of the blobs and one or more other possible blob sizes. One of the possible blob sizes is determined as the lower boundary when one or more lower boundary conditions are met by characteristics of the possible blob size. A blob size threshold for the video frame is assigned as the minimum blob size corresponding to the lower boundary.
-
公开(公告)号:US10015504B2
公开(公告)日:2018-07-03
申请号:US15220856
申请日:2016-07-27
Applicant: QUALCOMM Incorporated
Abstract: In an example of this disclosure, a method may include receiving or generating image segmentation data for a plurality of pixels. The image segmentation data may include one or more image segmentation values for each pixel of the plurality of pixels. The method may include converting the one or more image segmentation values into one or more image component values. The method may include sending the one or more image component values corresponding to the one or more image segmentation values to a video encoder.
-
公开(公告)号:US20180047193A1
公开(公告)日:2018-02-15
申请号:US15285441
申请日:2016-10-04
Applicant: QUALCOMM Incorporated
Inventor: Jinglun Gao , Ying Chen , Lei Wang , Ning Bi
CPC classification number: G06T7/248 , G06T2207/10016 , G06T2207/10024 , G06T2207/30232 , G06T2207/30236 , G06T2207/30241 , G06T2210/12
Abstract: Provided are methods, apparatuses, and computer-readable medium for content-adaptive bounding box merging. A system using content-adaptive bounding box merging can adapt its merging criteria according to the objects typically present in a scene. When two bounding boxes overlap, the content-adaptive merge engine can consider the overlap ratio, and compare the merged bounding box against a minimum object size. The minimum object size can be adapted to the size of the blobs detected in the scene. When two bounding boxes do not overlap, the system can consider the horizontal and vertical distances between the bounding boxes. The system can further compare the distances against content-adaptive thresholds. Using a content-adaptive bounding box merge engine, a video content analysis system may be able to more accurately merge (or not merge) bounding boxes and their associated blobs.
-
公开(公告)号:US20180047171A1
公开(公告)日:2018-02-15
申请号:US15384802
申请日:2016-12-20
Applicant: QUALCOMM Incorporated
Inventor: Ying Chen , Lei Wang , Jinglun Gao , Ning Bi
CPC classification number: G06T7/20 , G06K9/00711 , G06K9/4671 , G06T7/13 , G06T7/246 , G06T7/30 , G06T7/60 , G06T2207/30232 , G06T2207/30241
Abstract: Techniques and systems are provided for processing video data. For example, techniques and systems are provided for maintaining blob trackers for one or more video frames. A blob tracker can be associated with a blob generated for a video frame. The blob includes pixels of at least a portion of one or more foreground objects in the video frame. The blob tracker can be determined to be a first type of tracker or a second type of tracker. A first type of tracker has a first bounding box and a second bounding box with an overlapping ratio greater than an alignment threshold for the first type of tracker. A second type of tracker has an irregular size change or an irregular motion change over a threshold duration. The blob tracker can be removed from the plurality of blob trackers maintained for the one or more video frames when the blob tracker is the first type of tracker or the second type of tracker.
-
公开(公告)号:US20180033152A1
公开(公告)日:2018-02-01
申请号:US15262700
申请日:2016-09-12
Applicant: QUALCOMM Incorporated
Inventor: Ying Chen , Lei Wang , Jinglun Gao , Ning Bi
CPC classification number: G06K9/00711 , G06K9/00771 , G06K9/38 , G06K2009/00738 , G06T5/004 , G06T5/30 , G06T7/11 , G06T7/155 , G06T7/194 , G06T2207/10016 , G06T2207/10024 , G06T2207/20012 , G06T2207/20024 , G06T2207/20036 , G06T2207/20192
Abstract: Techniques and systems are provided for processing video data. For example, techniques and systems are provided for performing content-adaptive morphology operations. A first erosion function can be performed on a foreground mask of a video frame, including setting one or more foreground pixels of the frame to one or more background pixels. A temporary foreground mask can be generated based on the first erosion function being performed on the foreground mask. One or more connected components can be generated for the frame by performing connected component analysis to connect one or more neighboring foreground pixels. A complexity of the frame (or of the foreground mask of the frame) can be determined by comparing a number of the one or more connected components to a threshold number. A second erosion function can be performed on the temporary foreground mask when the number of the one or more connected components is higher than the threshold number. The one or more connected components can be output for blob processing when the number of the one or more connected components is lower than the threshold number.
-
公开(公告)号:US20170345179A1
公开(公告)日:2017-11-30
申请号:US15229456
申请日:2016-08-05
Applicant: QUALCOMM Incorporated
Inventor: Jinglun Gao , Ning Bi , Ying Chen , Lei Wang
CPC classification number: G06T7/60 , G06K9/00 , G06K9/4671 , G06T7/251 , G06T7/277 , G06T2207/10004 , G06T2207/30196 , G06T2207/30232
Abstract: Techniques and systems are provided for processing video data. For example, techniques and systems are provided for determining costs for blob trackers and blobs. A blob can be detected in a video frame. The blob includes pixels of at least a portion of a foreground object. A physical distance between a blob tracker and the blob can be determined. A size ratio between the blob tracker and the blob can also be determined. A cost between the blob tracker and the blob can then be determined using the physical distance and the size ratio. In some cases, a spatial relationship between the blob tracker and the blob is determined, in which case the physical distance can be determined based on the spatial relationship. Blob trackers can be associated with blobs based on the determined costs between the blob trackers and the blobs.
-
-
-
-
-
-
-
-