-
公开(公告)号:US11989938B2
公开(公告)日:2024-05-21
申请号:US18312479
申请日:2023-05-04
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20240062335A1
公开(公告)日:2024-02-22
申请号:US18499866
申请日:2023-11-01
Applicant: Snap Inc.
Inventor: Guohui Wang , Sumant Milind Hanumante , Ning Xu , Yuncheng Li
CPC classification number: G06T3/4046 , G06N3/08 , G06N3/04 , G06T1/20 , G06T11/60 , G06N3/063 , G06T2207/20081
Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
-
公开(公告)号:US11676381B2
公开(公告)日:2023-06-13
申请号:US17248393
申请日:2021-01-22
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20220230277A1
公开(公告)日:2022-07-21
申请号:US17714764
申请日:2022-04-06
Applicant: Snap Inc.
Inventor: Guohui Wang , Sumant Milind Hanumante , Ning Xu , Yuncheng Li
Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
-
公开(公告)号:US11087513B1
公开(公告)日:2021-08-10
申请号:US16186164
申请日:2018-11-09
Applicant: Snap Inc.
Inventor: Kun Duan , Nan Hu , Linjie Luo , Chongyang Ma , Guohui Wang
Abstract: Systems and methods are provided for receiving an image from a camera of a mobile device, analyzing the image to determine a subject of the image, segmenting the subject of the image to generate a mask indicating an area of the image comprising the subject of the image, applying a bokeh effect to a background region of the image to generate a processed background region, generating an output image comprising the subject of the image and the processed background region, and causing the generated output image to display on a display of the mobile device.
-
公开(公告)号:US20210224050A1
公开(公告)日:2021-07-22
申请号:US17135365
申请日:2020-12-28
Applicant: Snap Inc.
Inventor: Guohui Wang , Fenglei Tian , Samuel Edward Hare , Sumant Hanumante , Tony Mathew
Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer software and systems by facilitating the automatic performance optimization of a software application based on the particular platform upon which the application runs. In some embodiments, the system can automatically choose a set of parameters or methods at run-time from a design space with pre-selected optimization methods and parameters (e.g., algorithms, software libraries, and/or hardware accelerators) for a specific task.
-
公开(公告)号:US10776663B1
公开(公告)日:2020-09-15
申请号:US16521956
申请日:2019-07-25
Applicant: Snap Inc.
Inventor: Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
IPC: G06K9/62 , G06T7/11 , G06T7/194 , G06N3/08 , G06N3/04 , G06K9/68 , G06K9/74 , H04N5/76 , H04N5/445 , H04N7/14
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
公开(公告)号:US12288309B2
公开(公告)日:2025-04-29
申请号:US18499866
申请日:2023-11-01
Applicant: Snap Inc.
Inventor: Guohui Wang , Sumant Milind Hanumante , Ning Xu , Yuncheng Li
Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
-
公开(公告)号:US20240249522A1
公开(公告)日:2024-07-25
申请号:US18624757
申请日:2024-04-02
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US11645843B2
公开(公告)日:2023-05-09
申请号:US17248393
申请日:2021-01-22
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
-
-
-
-
-
-
-
-