公开(公告)号：US12106441B2

公开(公告)日：2024-10-01

申请号：US18073280

申请日：2022-12-01

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06T15/00

CPC classification number: G06T19/006 ,  G06T15/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

公开(公告)号：US12020377B2

公开(公告)日：2024-06-25

申请号：US18195012

申请日：2023-05-09

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Daniel Moreno ,  Kyle Goodrich

IPC: G06T17/20 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T7/246 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T15/04 ,  G06T19/00 ,  G06T19/20

CPC classification number: G06T17/20 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T7/251 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T15/04 ,  G06T19/006 ,  G06T19/20 ,  G06F2218/00 ,  G06T2219/2004 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Systems and methods are provided for receiving a two-dimensional (2D) image comprising a 2D object; identifying a contour of the 2D object; generating a three-dimensional (3D) mesh based on the contour of the 2D object; and applying a texture of the 2D object to the 3D mesh to output a 3D object representing the 2D object.

公开(公告)号：US11996113B2

公开(公告)日：2024-05-28

申请号：US17514439

申请日：2021-10-29

Applicant: Snap Inc.

Inventor： Alex Edelsburg ,  Kyle Goodrich ,  Pedram Javidpour ,  Andrew James McPhee ,  Daniel Moreno ,  Jeremy Baker Voss

IPC: H04L51/04 ,  G06F3/0482 ,  G06F3/04883 ,  G06F3/16 ,  G06T13/00 ,  G10L21/013 ,  H04L51/10

CPC classification number: G10L21/013 ,  G06F3/0482 ,  G06F3/04883 ,  G06F3/165 ,  G06T13/00

Abstract: Methods and systems are disclosed for generating voice notes. In one embodiment, a messaging application implemented on a first participant computing device, receives a request to send a voice message to a second participant computing device in a communication session. In response to receiving the request, the messaging application selects a voice modification effect. The messaging application receives input to begin recording the voice message. While the voice message is being recorded, the messaging application receives speech input, modifies the speech input based on the voice modification effect in real time, and continuously updates an audio file with the modified speech input. In response to receiving input to terminate recording the voice message, the messaging application provides a first option to playback the audio file and a second option to send the audio file as the voice message to the second participant computing device.

公开(公告)号：US11995780B2

公开(公告)日：2024-05-28

申请号：US17941301

申请日：2022-09-09

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Maxim Maximov Lazarov ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/70 ,  G06V40/20

CPC classification number: G06T19/006 ,  G06F3/017 ,  G06T7/70 ,  G06V40/28 ,  G06T2207/30196

Abstract: The subject technology receives a set of frames. The subject technology detect a first gesture correspond to an open trigger finger gesture. The subject technology receives a second set of frames. The subject technology detects from the second set of frames, a second gesture correspond to a closed trigger finger gesture. The subject technology detects a location and a position of a representation of a finger from the closed trigger finger gesture. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology renders a movement of the first virtual object along a vector away from the location and the position of the representation of the finger within a first scene. The subject technology provides for display the rendered movement of the first virtual object along the vector within the first scene.

公开(公告)号：US20240104959A1

公开(公告)日：2024-03-28

申请号：US18535771

申请日：2023-12-11

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06V40/20 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0482 ,  G06F3/14

CPC classification number: G06V40/23 ,  G02B27/0172 ,  G06F3/013 ,  G06F3/0482 ,  G06F3/1454 ,  G06V40/28 ,  G02B2027/0178

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting a gesture performed by the user in the video feed; and in response to detecting the gesture, displaying a set of options related to a given option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels.

公开(公告)号：US20240087242A1

公开(公告)日：2024-03-14

申请号：US17941293

申请日：2022-09-09

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Maxim Maximov Lazarov ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06T19/00 ,  G06T7/70 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06T19/20 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2210/21 ,  G06T2219/2016

Abstract: The subject technology detects a location and a position of a representation of a finger. The subject technology generates a first virtual object based on the location and the position of the representation of the finger. The subject technology detects a first collision event. The subject technology in response to the first collision event, modifies a set of dimensions of the second virtual object to a second set of dimensions. The subject technology detects a second location and a second position of the representation of the finger. The subject technology detects a second collision event. The subject technology modifies a set of dimensions of the third virtual object to a third set of dimensions. The subject technology renders the third virtual object based on the third set of dimensions within a third scene, the third scene comprising a modified scene from a second scene.

公开(公告)号：US11908243B2

公开(公告)日：2024-02-20

申请号：US17249848

申请日：2021-03-16

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/0482 ,  G06F3/01 ,  G06F3/0481 ,  G06V40/20 ,  G06F3/14 ,  G02B27/01

CPC classification number: G06V40/23 ,  G02B27/0172 ,  G06F3/013 ,  G06F3/0482 ,  G06F3/1454 ,  G06V40/28 ,  G02B2027/0178

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting a gesture performed by the user in the video feed; and in response to detecting the gesture, displaying a set of options related to a given option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels.

公开(公告)号：US11893689B2

公开(公告)日：2024-02-06

申请号：US17819198

申请日：2022-08-11

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Ebony James Charlton ,  Andrew James McPhee ,  Michael John Evans

IPC: G06T17/20 ,  G06T7/55 ,  G06V20/64 ,  G06V40/60 ,  G06V40/16

CPC classification number: G06T17/20 ,  G06T7/55 ,  G06V20/64 ,  G06V40/167 ,  G06V40/67 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2207/30201

Abstract: In various example embodiments, a system and methods are presented for generation and manipulation of three dimensional (3D) models. The system and methods cause presentation of an interface frame encompassing a field of view of an image capture device. The systems and methods detect an object of interest within the interface frame, generate a movement instruction with respect to the object of interest, and detect a first change in position and a second change in position of the object of interest. The systems and methods generate a 3D model of the object of interest based on the first change in position and the second change in position.

公开(公告)号：US20240028132A1

公开(公告)日：2024-01-25

申请号：US18375763

申请日：2023-10-02

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/01 ,  G06F3/0482 ,  G06T7/20 ,  G06F3/04815 ,  G06V40/10

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/0482 ,  G06T7/20 ,  G06F3/04815 ,  G06V40/107 ,  G06T2207/30241 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; identifying a finger of a hand of the user in the video feed; determining a direction within the video feed to which the finger is pointing; and accessing a first menu option based on the direction within the video feed to which the finger is pointing.

公开(公告)号：US20230410450A1

公开(公告)日：2023-12-21

申请号：US18240380

申请日：2023-08-31

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/171 ,  G06T2219/2012 ,  G06T2219/2024

Abstract: The subject technology applies, to image data and depth data, a 3D effect including at least one beautification operation based on an augmented reality content generator, the 3D effect including a beautification operation, the beautification operation comprising modifying image data, the image data including a region corresponding to a representation of a face, the beautification operation comprising using a machine learning model for at least one of smoothing blemishes or preserving facial skin texture. The subject technology generates a depth map using at least the depth data. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation.