公开(公告)号：US20220070291A1

公开(公告)日：2022-03-03

申请号：US17522947

申请日：2021-11-10

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04M1/72439 ,  H04L12/58 ,  G06T11/60 ,  G06T13/80 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72442

Abstract: A system for customizing modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to analyze recent messages of a user to determine a context of the recent messages; determine, based on the context, a customized feature; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with a preset modifiable feature; replace the preset modifiable feature in the relevant modifiable videos with the customized feature; and render a modifiable video from the list of relevant modifiable videos for viewing by the user, the rendering including displaying the customized feature in the relevant modifiable videos.

公开(公告)号：US20250166264A1

公开(公告)日：2025-05-22

申请号：US18947989

申请日：2024-11-14

Applicant: Snap Inc.

Inventor： Aleksandr Belskikh ,  Igor Filippov ,  Roman Golobokov ,  Elena Koritskaya ,  Leonid Kulikov ,  Anton Pankratov ,  Nikolai Smirnov

IPC: G06T11/60 ,  G06T3/40 ,  G06T5/50 ,  G06T5/77 ,  G06T7/194

Abstract: Methods and systems are disclosed for generating personalized images using one or more diffusion models. The methods and systems access first and second artificial personalized images generated by first and second generative machine learning models, the first generative machine learning model trained to generate the first artificial personalized image comprising a depiction of a first person, the second generative machine learning model trained to generate the second artificial personalized image comprising a depiction of a second person. The methods and systems generate a foreground image that combines the depiction of the first person in the first artificial personalized image with the depiction of the second person in the second artificial personalized image. The methods and systems access generate a new artificial image comprising the foreground image on a background having visual attributes that correspond to the background information.

公开(公告)号：US20250148674A1

公开(公告)日：2025-05-08

申请号：US18982758

申请日：2024-12-16

Applicant: Snap Inc.

Inventor： Sergey Smetanin ,  Arnab Ghosh ,  Pavel Savchenkov ,  Jian Ren ,  Sergey Tulyakov ,  Ivan Babanin ,  Timur Zakirov ,  Roman Golobokov ,  Aleksandr Zakharov ,  Dor Ayalon ,  Nikita Demidov ,  Vladimir Gordienko ,  Daniel Moreno ,  Nikita Belosludtcev ,  Sofya Savinova

IPC: G06T11/60 ,  G06F3/0482

Abstract: Examples in the present disclosure relate to prompt-driven, conversation-specific image generation. A first user device of a first user of an interaction application transmits an image generation request. The interaction application enables the first user to interact with at least a second user. An image is automatically generated based on a prompt included in the image generation request, and the image is presented at the first user device. In response to receiving user input to select the image, the image is stored as a conversation-specific image in association with a first user profile of the first user and a second user profile of the second user. The conversation-specific image is presented at both the first user device of the first user and a second user device of the second user, together with conversation data associated with a conversation between the first user and the second user.

公开(公告)号：US20250022246A1

公开(公告)日：2025-01-16

申请号：US18904104

申请日：2024-10-02

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobokov

IPC: G06T19/20 ,  G06T13/40 ,  G06V40/16

Abstract: Provided are systems and methods for template-based generation of personalized videos. An example method includes receiving a sequence of frame images, face area parameters corresponding to positions of a face area in a frame image of the sequence of frame images, and facial landmark parameters corresponding to the frame image of the sequence of frame images, where the facial landmark parameters are absent from the frame images, receiving an image of a source face, modifying, based on the facial landmark parameters corresponding to the frame image, the image of the source face to obtain a further face image featuring the source face adopting a facial expression corresponding to the facial landmark parameters, and inserting the further face image into the frame image at a position determined by the face area parameters corresponding to the frame image, thereby generating an output frame of an output video.

公开(公告)号：US20240397156A1

公开(公告)日：2024-11-28

申请号：US18322397

申请日：2023-05-23

Applicant: Snap Inc.

Inventor： Nikita Belosludtcev ,  Nikita Demidov ,  Roman Golobokov ,  Mariya Apanovych ,  Yuelin Cheng ,  Jeremy Baker Voss ,  Sergey Smetanin ,  David Phillip Taitz

IPC: H04N21/472 ,  H04N21/466

Abstract: In some examples, a method includes determining that a listing of other users is to be displayed on a user interface for a first user, accessing augmentation trigger criteria, applying the augmentation trigger criteria to user profile data, determining, based on the application of the augmentation trigger criteria to the user profile data, that a second user meet a trigger criterion of the one or more augmentation trigger criteria. The method then includes identifying at least one recommended content augmentation associated with the trigger criterion and causing display of a first selectable user interface element associated with the at least one recommended content augmentation with the listing of other users on the user interface.

公开(公告)号：US12149489B2

公开(公告)日：2024-11-19

申请号：US18183794

申请日：2023-03-14

Applicant: Snap Inc.

Inventor： Roman Golobokov ,  Sergey Smetanin ,  Sofya Savinova ,  Aleksandr Zakharov

IPC: H04L51/04 ,  G06F3/04842 ,  G06N20/00 ,  H04L51/10 ,  H04L51/52

Abstract: Described herein is a technique for processing a received media content item (e.g., a message), received at a messaging application of a first end-user of a messaging service, to generate a selection of some predetermined number of recommended stickers. The recommended stickers are then presented in a user interface to the first end-user, allowing the first end-user to select a sticker for use in replying to the received media content item. To generate the selection of recommended stickers, in response to receiving the media content item, the messaging application processes the media content item to identify specific attributes and characteristics (e.g., text included with the message, stickers used with the message, and other contextual metadata). The identified attributes and characteristics of the received message are then processed by a scoring model to identify the predetermined number of stickers for presenting in the reply interface as recommended reply stickers.

公开(公告)号：US20240153227A1

公开(公告)日：2024-05-09

申请号：US18404575

申请日：2024-01-04

Applicant: Snap Inc.

Inventor： Roman Golobokov ,  Aleksandr Mashrabov ,  Dmitry Matov ,  Jeremy Baker Voss

IPC: G06T19/20 ,  G06N20/00 ,  G06T11/60 ,  G06T13/40 ,  G06T19/00 ,  G06V40/16 ,  H04L51/04 ,  H04L51/10

CPC classification number: G06T19/20 ,  G06N20/00 ,  G06T11/60 ,  G06T13/40 ,  G06T19/006 ,  G06V40/165 ,  H04L51/04 ,  H04L51/10 ,  G06T2219/2012 ,  G06T2219/2024

Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.

公开(公告)号：US20240089364A1

公开(公告)日：2024-03-14

申请号：US18509589

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04M1/72439 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72442

CPC classification number: H04M1/72439 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72442

Abstract: Provided are systems and methods for customizing modifiable videos. An example method includes analyzing recent messages associated with a user in a multimedia messaging application to determine a context of the recent messages, determining, based on the context, a property of a modifiable feature, selecting, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos associated with a preset modifiable feature, replacing a property of the preset modifiable feature in relevant modifiable videos of the list of relevant modifiable videos with the property of the modifiable feature, and rendering the list of relevant modifiable videos for viewing by the user, where the rendering includes displaying the modifiable feature in the relevant modifiable videos.

公开(公告)号：US11694417B2

公开(公告)日：2023-07-04

申请号：US17674876

申请日：2022-02-18

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobokov

IPC: G06T19/20 ,  G06T13/40 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06T13/40 ,  G06V40/161 ,  G06V40/171 ,  G06V40/172 ,  G06V40/174

Abstract: Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of skin masks defining positions of a skin area of a part of the at least one body in the frame images. The method may continue with receiving an image of a source face. The method may further include determining color data associated with the source face. The method may include recoloring the skin area of the part of the at least one body in the frame image and inserting the image of the source face into the frame image at a position determined by face area parameters corresponding to the frame image to generate an output frame of an output video.

公开(公告)号：US20220319230A1

公开(公告)日：2022-10-06

申请号：US17706830

申请日：2022-03-29

Applicant: Snap Inc.

Inventor： Roman Golobokov ,  Alexandr Marinenko ,  Aleksandr Mashrabov

IPC: G06V40/16 ,  G06T19/00

Abstract: The subject technology captures first image data by a computing device, the first image data comprising a target face of a target actor and facial expressions of the target actor, the facial expressions including lip movements. The subject technology generates, based at least in part on frames of a source media content, sets of source pose parameters. The subject technology receives a selection of a particular facial expression from a set of facial expressions. The subject technology generates, based at least in part on sets of source pose parameters and the selection of the particular facial expression, an output media content. The subject technology provides augmented reality content based at least in part on the output media content for display on the computing device.