Using portrait images in augmented reality components

    公开(公告)号:US11354872B2

    公开(公告)日:2022-06-07

    申请号:US16949700

    申请日:2020-11-11

    申请人: Snap Inc.

    摘要: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.

    CUSTOMIZING TEXT MESSAGES IN MODIFIABLE VIDEOS OF MULTIMEDIA MESSAGING APPLICATION

    公开(公告)号:US20210368039A1

    公开(公告)日:2021-11-25

    申请号:US16878868

    申请日:2020-05-20

    申请人: Snap Inc.

    摘要: A system for customizing text messages in modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes a processor and a memory storing processor-executable codes, wherein the processor is configured to analyze recent messages of a user in the MMA to determine a context of the recent messages; determine, based on the context, a customized text message; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages; replace the preset text messages in the relevant modifiable videos with the customized message; and render the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.

    Template-based generation of personalized videos

    公开(公告)号:US11694417B2

    公开(公告)日:2023-07-04

    申请号:US17674876

    申请日:2022-02-18

    申请人: Snap Inc.

    IPC分类号: G06T19/20 G06T13/40 G06V40/16

    摘要: Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of skin masks defining positions of a skin area of a part of the at least one body in the frame images. The method may continue with receiving an image of a source face. The method may further include determining color data associated with the source face. The method may include recoloring the skin area of the part of the at least one body in the frame image and inserting the image of the source face into the frame image at a position determined by face area parameters corresponding to the frame image to generate an output frame of an output video.

    FACIAL SYNTHESIS IN AUGMENTED REALITY CONTENT FOR ONLINE COMMUNITIES

    公开(公告)号:US20220319230A1

    公开(公告)日:2022-10-06

    申请号:US17706830

    申请日:2022-03-29

    申请人: Snap Inc.

    IPC分类号: G06V40/16 G06T19/00

    摘要: The subject technology captures first image data by a computing device, the first image data comprising a target face of a target actor and facial expressions of the target actor, the facial expressions including lip movements. The subject technology generates, based at least in part on frames of a source media content, sets of source pose parameters. The subject technology receives a selection of a particular facial expression from a set of facial expressions. The subject technology generates, based at least in part on sets of source pose parameters and the selection of the particular facial expression, an output media content. The subject technology provides augmented reality content based at least in part on the output media content for display on the computing device.

    REAL-TIME PREVIEW PERSONALIZATION
    10.
    发明申请

    公开(公告)号:US20220100534A1

    公开(公告)日:2022-03-31

    申请号:US17399453

    申请日:2021-08-11

    申请人: Snap Inc.

    IPC分类号: G06F9/451 G06F9/445

    摘要: A preview personalization system for generating and presenting previews of personalized media content at a client device, wherein the previews may be personalized, in real-time, based on one or more attributes which may include user profile data and contextual data accessed by the client device, according to certain example embodiments.