-
公开(公告)号:US20240355063A1
公开(公告)日:2024-10-24
申请号:US18304078
申请日:2023-04-20
申请人: Snap Inc.
发明人: Zhenpeng Zhou , Patrick Poirson , Maksim Gusarov , Chen Wang , Oleg Tovstyi
CPC分类号: G06T19/006 , G06T1/0021 , G06V10/761 , H04N5/2621
摘要: An input video item that includes a target visual augmentation is accessed. A machine learning model uses the input video item to generate an embedding. The embedding may comprise a vector representation of a visual effect of the target visual augmentation. The machine learning model is trained, in an unsupervised training phase, to minimize loss between training video representations generated within each of a plurality of training sets. Each training set comprises a plurality of different training video items that each include a predefined visual augmentation. Based on the generation of the embedding of the input video item, the target visual augmentation is mapped to an augmentation identifier.
-
公开(公告)号:US20240160673A1
公开(公告)日:2024-05-16
申请号:US18054420
申请日:2022-11-10
申请人: Snap Inc.
IPC分类号: G06F16/907 , G06F16/903 , G06F16/9035 , G06T19/00 , G06V10/74
CPC分类号: G06F16/907 , G06F16/90335 , G06F16/9035 , G06T19/006 , G06V10/761
摘要: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving an image from a client device; applying a machine learning model to the image to generate an embedding query vector, the machine learning model being trained to encode a plurality of images and text into a common embedding space; searching, based on the embedding query vector, a database of augmented reality (AR) experiences to identify a subset of AR experiences associated with one or more embeddings that correspond to the embedding query vector; and transmitting to the client device the subset of AR experiences associated with the one or more embeddings that correspond to the embedding query vector.
-