公开(公告)号：US20230215117A1

公开(公告)日：2023-07-06

申请号：US18121893

申请日：2023-03-15

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06T19/20 ,  G06T15/80 ,  G06F3/01 ,  G06F3/04883

CPC classification number: G06T19/006 ,  G06F3/012 ,  G06F3/04883 ,  G06T15/80 ,  G06T19/20 ,  G06T2219/2004

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.

公开(公告)号：US11676342B2

公开(公告)日：2023-06-13

申请号：US17952051

申请日：2022-09-23

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42

CPC classification number: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42 ,  G06T2207/20084

Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

公开(公告)号：US11636657B2

公开(公告)日：2023-04-25

申请号：US17528697

申请日：2021-11-17

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06T19/20 ,  G06F3/04883 ,  G06F3/01 ,  G06T15/80

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.

公开(公告)号：US11625895B2

公开(公告)日：2023-04-11

申请号：US17386998

申请日：2021-07-28

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  David Li ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Isac Andreas Müller Sandvik ,  Wentao Shang

IPC: G06T17/20 ,  G06T19/20 ,  G06T11/20

Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

公开(公告)号：US20230055634A1

公开(公告)日：2023-02-23

申请号：US17821741

申请日：2022-08-23

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/0482 ,  G06F3/04847 ,  G06F3/0488

Abstract: Systems and methods are provided for navigating messaging application interfaces. The systems and methods include operations for: displaying, by a messaging application of a user device, a menu comprising a first set of options relating to a first level in a hierarchy of levels; detecting, by a touch sensor, one finger touch of a first option of the first set of options; in response to detecting the one finger touch of the first option, displaying, by the messaging application, a second set of options related to the first option, the second set of options relating to a second level in the hierarchy of levels; detecting, by the touch sensor, two finger touch of a second option of the second set of options; and in response to detecting the two finger touch of the second option, re-displaying, by the messaging application, the first set of options.

公开(公告)号：US20220374132A1

公开(公告)日：2022-11-24

申请号：US17479153

申请日：2021-09-20

Applicant: Snap Inc.

Inventor： Karen Stolzenberg ,  David Meisenholder ,  Mathieu Emmanuel Vignau ,  Sana Park ,  Tianyi Sun ,  Joseph Timothy Fortier ,  Kaveh Anvaripour ,  Daniel Moreno ,  Kyle Goodrich

IPC: G06F3/0481 ,  G06F3/0485 ,  G06F3/0488 ,  G02B27/01 ,  G06T19/00

Abstract: Disclosed is a method of receiving and processing content-sending inputs received by a head-worn device system including one or more display devices, one or more cameras and a vertically-arranged touchpad. The method includes displaying a content item on the one or more display devices, receiving a touch input on the touchpad corresponding to a send instruction, displaying a carousel of potential recipients, receiving a horizontal touch input on the touchpad, scrolling the carousel left or right on the one or more display devices in response to the horizontal touch input, receiving a tap touch input on the touchpad to select a particular recipient, receiving a further touch input, and in response to the further touch input, transmitting the content item to the selected recipient.

公开(公告)号：US20220300732A1

公开(公告)日：2022-09-22

申请号：US17249855

申请日：2021-03-16

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06K9/00 ,  G06F3/14 ,  G06F3/01 ,  G02B27/01 ,  G06F3/0482 ,  G06F3/0484

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user; identifying a hand of the user in the video feed; determining that a position of the hand in the video feed overlaps a position of a given menu option of the one or more menu options; and performing an operation associated with the given menu option in response to determining that the position of the hand in the video feed overlaps the position of the given menu option.

公开(公告)号：US20220300731A1

公开(公告)日：2022-09-22

申请号：US17249845

申请日：2021-03-16

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06K9/00 ,  G02B27/01 ,  H04N5/232 ,  G09G5/10

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; in response to capturing the video feed, evaluating a set of conditions for activating a hands-free mode of operating the electronic mirroring device; in response to determining that the set of conditions are satisfied, activating the hands-free mode of operating the electronic mirroring device; and performing one or more functions on the electronic mirroring device based on detection of one or more gestures performed by the user in the video feed.

公开(公告)号：US20220197446A1

公开(公告)日：2022-06-23

申请号：US17410814

申请日：2021-08-24

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/0482 ,  G06F3/0488 ,  G06F3/0484

Abstract: Systems and methods are provided for performing operations comprising: displaying, by one or more processors of an eyewear device, a plurality of media content control options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; based on detecting the first touch input, causing a cursor to track the first touch input to navigate through the plurality of media content control options; based on detecting that the single finger has not been released from touching the touch input interface, displaying a second media content control option related to the first media content control option; and performing a selection associated with the second media content control option based on movement of the single finger along the touch input interface.

公开(公告)号：US20220076500A1

公开(公告)日：2022-03-10

申请号：US17530181

申请日：2021-11-18

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06T19/20 ,  G06T7/194 ,  G06T7/73 ,  G06K9/32 ,  G06K9/46 ,  G06F3/0481 ,  G06F3/0488 ,  G06F3/0484

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated. by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.