-
公开(公告)号:US20240135549A1
公开(公告)日:2024-04-25
申请号:US18049473
申请日:2022-10-24
Applicant: QUALCOMM Incorporated
Inventor: Xin Li , Jiancheng Lyu , Yingyong Qi
CPC classification number: G06T7/215 , G06T7/11 , G06T7/248 , G06T2207/10016 , G06T2207/20084
Abstract: Methods and systems of frame based image segmentation are provided. For example, a method for feature object tracking between frames of video data is provided. The method comprises receiving a first frame of video data, extracting a mask feature for each of one or more objects of the first frame, adjusting the first frame by applying each initial mask and corresponding identification to a respective object of the first frame, and outputting the adjusted first frame. The method further comprises tracking the one or more objects in one or more consecutive frames. The tracking comprises extracting a masked feature for each of one or more objects in the consecutive frame, adjusting the consecutive frame by applying each initial mask and corresponding identification for the consecutive frame to the respective object of the one or more objects of the consecutive frame, and outputting the adjusted consecutive frame.
-
公开(公告)号:US12236614B2
公开(公告)日:2025-02-25
申请号:US17828962
申请日:2022-05-31
Applicant: QUALCOMM Incorporated
Inventor: Jiancheng Lyu , Dashan Gao , Yingyong Qi , Shuai Zhang , Ning Bi
Abstract: Systems and techniques are provided for performing scene segmentation and object tracking. For example, a method for processing one or more frames. The method may include determining first one or more features from a first frame. The first frame includes a target object. The method may include obtaining a first mask associated with the first frame. The first mask includes an indication of the target object. The method may further include generating, based on the first mask and the first one or more features, a representation of a foreground and a background of the first frame. The method may include determining second one or more features from a second frame and determining, based on the representation of the foreground and the background of the first frame and the second one or more features, a location of the target object in the second frame.
-
公开(公告)号:US12141981B2
公开(公告)日:2024-11-12
申请号:US17669040
申请日:2022-02-10
Applicant: QUALCOMM Incorporated
Inventor: Shuai Zhang , Xiaowen Ying , Jiancheng Lyu , Yingyong Qi
Abstract: Systems and techniques are provided for performing semantic image segmentation using a machine learning system (e.g., including one or more cross-attention transformer layers). For instance, a process can include generating one or more input image features for a frame of image data and generating one or more input depth features for a frame of depth data. One or more fused image features can be determined, at least in part, by fusing the one or more input depth features with the one or more input image features, using a first cross-attention transformer network. One or more segmentation masks can be generated for the frame of image data based on the one or more fused image features.
-
公开(公告)号:US20240233140A9
公开(公告)日:2024-07-11
申请号:US18049473
申请日:2022-10-25
Applicant: QUALCOMM Incorporated
Inventor: Xin Li , Jiancheng Lyu , Yingyong Qi
CPC classification number: G06T7/215 , G06T7/11 , G06T7/248 , G06T2207/10016 , G06T2207/20084
Abstract: Methods and systems of frame based image segmentation are provided. For example, a method for feature object tracking between frames of video data is provided. The method comprises receiving a first frame of video data, extracting a mask feature for each of one or more objects of the first frame, adjusting the first frame by applying each initial mask and corresponding identification to a respective object of the first frame, and outputting the adjusted first frame. The method further comprises tracking the one or more objects in one or more consecutive frames. The tracking comprises extracting a masked feature for each of one or more objects in the consecutive frame, adjusting the consecutive frame by applying each initial mask and corresponding identification for the consecutive frame to the respective object of the one or more objects of the consecutive frame, and outputting the adjusted consecutive frame.
-
-
-