-
公开(公告)号：US11947628B2
公开(公告)日：2024-04-02
申请号：US17217139
申请日：2021-03-30
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda
IPC: G06F18/214 , G06N3/04 , G06N3/08 , G10L21/14 , G10L25/30
CPC classification number: G06F18/2148 , G06N3/04 , G06N3/08 , G10L21/14 , G10L25/30 , G06F2218/08 , G06F2218/12
Abstract: A messaging system that extracts accompaniment portions from songs. Methods of accompaniment extraction from songs includes receiving an input song that includes a vocal portion and an accompaniment portion, transforming the input song to an input image, where the input image represents the frequencies and intensities of the input song, processing the input image using a convolutional neural network (CNN) to generate an output image, and transforming the output image to an output accompaniment, where the output accompaniment includes the accompaniment of the input song.
-
公开(公告)号：US11790585B2
公开(公告)日：2023-10-17
申请号：US17804430
申请日：2022-05-27
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda , Shree K. Nayar
CPC classification number: G06T13/205 , G06T7/246 , G06T13/40 , G06T13/80
Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.
-
公开(公告)号：US11501528B1
公开(公告)日：2022-11-15
申请号：US17138341
申请日：2020-12-30
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda , Marian Pho , Karl Bayer , Shree K. Nayar
IPC: G06V20/20 , G06V30/40 , G06V30/142 , G06V30/224 , G06V30/10
Abstract: An apparatus to perform functions on media content items comprises a camera, a communication interface, and a selector input device. The selector input device is communicatively coupled to the camera and the communication interface and has a function setting. In response to detecting activation of the selector input device, the camera captures a media content item and the communication interface transmits the media content item to the server for function processing. The selector input device can be a rotary wheel. To select the function setting from the plurality of settings, the user can rotate the rotary wheel to a function setting and press the rotary wheel. Other embodiments are described herein.
-
公开(公告)号：US20210312690A1
公开(公告)日：2021-10-07
申请号：US17350975
申请日：2021-06-17
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda , Shree K. Nayar
IPC: G06T13/80 , G10L21/055
Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.
-
公开(公告)号：US20210097742A1
公开(公告)日：2021-04-01
申请号：US16588329
申请日：2019-09-30
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda , Shree K. Nayar
Abstract: Methods, devices, media, and other embodiments are described for generating pseudorandom animations matched to audio data on a device. In one embodiment a video is generated and output on a display of the device using a computer animation model. Audio is detected from a microphone of the device, and the audio data is processed to determine a set of audio characteristics for the audio data received at the microphone of the device. A first motion state is randomly selected from the plurality of motion states, one or more motion values of the first motion state are generated using the set of audio characteristics, and the video is updated using the one or more motion values with the computer animation model to create an animated action within the video.
-
Patent Agency Ranking
公开(公告)号：US12093443B1
公开(公告)日：2024-09-17
申请号：US18385286
申请日：2023-10-30
Applicant: Snap Inc.
CPC classification number: G06F3/011 , G06T7/251 , G06T7/75 , G06T17/20 , G06T19/006 , G06V40/28 , G06F3/017 , G06T17/00 , G06T19/003 , G06T2200/24 , G06T2207/30196
Abstract: An eXtended Reality (XR) system provides grasp detection of a user grasping a virtual object. The grasp detection may be used as a user input into an XR application. The XR system provides a user interface of the XR application to a user of the XR system, the user interface including one or more virtual objects. The XR system captures video frame tracking data of a pose of a hand of a user while the user interacts with a virtual object of the one or more virtual objects and generates skeletal model data of the hand of the user based on the video frame tracking data. XR system generates grasp detection data based on the skeletal model data and virtual object data of the virtual object, and provides the grasp detection data to the XR application as user input into the XR application.
-
公开(公告)号：US20240281936A1
公开(公告)日：2024-08-22
申请号：US18113036
申请日：2023-02-22
Applicant: Snap Inc.
Inventor： Jian Wang , Zhixiang Wang , Gurunandan Krishnan Gorumkonda
CPC classification number: G06T5/77 , G06V40/166 , G06T2207/20084 , G06T2207/20132
Abstract: A method of correcting perspective distortion of a selfie image captured with a short camera-to-face distance by processing the selfie image and generating an undistorted selfie image appearing to be taken with a longer camera-to-face distance. A pre-trained 3D face GAN processes the selfie image, inverts the 3D face GAN to obtain improved face latent code and camera parameters, fine tunes a 3D face GAN generator, and manipulates camera parameters to render a photorealistic face selfie image. The processed selfie image has less distortion in the forehead, nose, cheek bones, jaw line, chin, lips, eyes, eyebrows, ears, hair, and neck of the face.
-
公开(公告)号：US20230419578A1
公开(公告)日：2023-12-28
申请号：US18242964
申请日：2023-09-06
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda , Shree K. Nayar
CPC classification number: G06T13/205 , G06T7/246 , G06T13/40 , G06T13/80
Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.
-
公开(公告)号：US20230360251A1
公开(公告)日：2023-11-09
申请号：US18144187
申请日：2023-05-06
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda , Shree K. Nayar , Yicheng Wu
CPC classification number: G06T7/70 , G06V40/161 , G06T2207/30201
Abstract: A device that measures a size of a user's face, referred to as face scaling, using a monocular camera. Depth is calculated from sparse feature points. A face mesh is used to improve the estimation accuracy. A processing pipeline detects face features by applying a face landmark detection algorithm to find the important face feature points such as the eyes, nose, and mouth. The processing pipeline estimates feature points depth using depth obtained through image defocus. The processing pipeline further scales the face using an estimated depth of the face features.
-
公开(公告)号：US20230260180A1
公开(公告)日：2023-08-17
申请号：US18306732
申请日：2023-04-25
Applicant: Snap Inc.
Inventor： Gurunandan Krishnan Gorumkonda , Shree K. Nayar
CPC classification number: G06T13/205 , G06T7/246 , G06T13/80 , G06T13/40
Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.
-
-
-
-
-
-
-
-
-
Search Results
49
records
(took 0.017 seconds)
