STATE-SPACE SYSTEM FOR PSEUDORANDOM ANIMATION

    公开(公告)号:US20230024562A1

    公开(公告)日:2023-01-26

    申请号:US17804430

    申请日:2022-05-27

    Applicant: Snap Inc.

    Abstract: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.

    Shortcut keypad for visual electronic communications

    公开(公告)号:US11477318B1

    公开(公告)日:2022-10-18

    申请号:US17137953

    申请日:2020-12-30

    Applicant: Snap Inc.

    Abstract: Shortcut keypad system for electronic communications comprises first apparatus and second apparatus. First apparatus and second apparatus each comprise an input device, a processor and a memory. The input device comprises selectable items including first selectable item. The processor of the first apparatus receives a selection of the first selectable item, and transmits a signal corresponding to the first selectable item to the second apparatus. The processor of the second apparatus receives the signal corresponding to the first selectable item, and causes the input device of the second apparatus to indicate that the signal corresponding to the first selectable item is received. Other embodiments are described herein.

    Matching audio to a state-space model for pseudorandom animation

    公开(公告)号:US11282253B2

    公开(公告)日:2022-03-22

    申请号:US16588329

    申请日:2019-09-30

    Applicant: Snap Inc.

    Abstract: Methods, devices, media, and other embodiments are described for generating pseudorandom animations matched to audio data on a device. In one embodiment a video is generated and output on a display of the device using a computer animation model. Audio is detected from a microphone of the device, and the audio data is processed to determine a set of audio characteristics for the audio data received at the microphone of the device. A first motion state is randomly selected from the plurality of motion states, one or more motion values of the first motion state are generated using the set of audio characteristics, and the video is updated using the one or more motion values with the computer animation model to create an animated action within the video.

    Audio response messages
    24.
    发明授权

    公开(公告)号:US11227626B1

    公开(公告)日:2022-01-18

    申请号:US16418638

    申请日:2019-05-21

    Applicant: Snap Inc.

    Abstract: An audio response system can generate multimodal messages that can be dynamically updated on viewer's client device based on a type of audio response detected. The audio responses can include keywords or continuum-based signal (e.g., levels of wind noise). A machine learning scheme can be trained to output classification data from the audio response data for content selection and dynamic display updates.

    AUTOMATED DANCE ANIMATION
    25.
    发明申请

    公开(公告)号:US20210097744A1

    公开(公告)日:2021-04-01

    申请号:US16588446

    申请日:2019-09-30

    Applicant: Snap Inc.

    Abstract: Methods, devices, media, and other embodiments are described for generating, modifying, and outputting pseudorandom animations that can be synchronized to audio data. In one embodiment, a computer animation model made up of comprising one or more control points is accessed by one or more processors, which associate motion patterns with a first control point of the one or more control points, and associate one or more speed harmonics with the first control point. A set of motion states is identify with a motion state for the combinations of possibilities, and a probability value is assigned to each motion state of the set of motion states. The probability value can be used to probabilistically determine a particular motion state to be part of displayed animation for the computer animation model.

    Music reactive animation of human characters

    公开(公告)号:US12293444B2

    公开(公告)日:2025-05-06

    申请号:US18482634

    申请日:2023-10-06

    Applicant: Snap Inc.

    Abstract: Example methods for generating an animated character in dance poses to music may include generating, by at least one processor, a music input signal based on an acoustic signal associated with the music, and receiving, by the at least one processor, a model output signal from an encoding neural network. A current generated pose data is generated using a decoding neural network, the current generated pose data being based on previous generated pose data of a previous generated pose, the music input signal, and the model output signal. An animated character is generated based on a current generated pose data; and the animated character caused to be displayed by a display device.

    GRASPING VIRTUAL OBJECTS WITH REAL HANDS FOR EXTENDED REALITY

    公开(公告)号:US20250138626A1

    公开(公告)日:2025-05-01

    申请号:US18815562

    申请日:2024-08-26

    Applicant: Snap Inc.

    Abstract: An extended Reality (XR) system provides grasp detection of a user grasping a virtual object. The grasp detection may be used as a user input into an XR application. The XR system provides a user interface of the XR application to a user of the XR system, the user interface including one or more virtual objects. The XR system captures video frame tracking data of a pose of a hand of a user while the user interacts with a virtual object of the one or more virtual objects and generates skeletal model data of the hand of the user based on the video frame tracking data. XR system generates grasp detection data based on the skeletal model data and virtual object data of the virtual object, and provides the grasp detection data to the XR application as user input into the XR application.

    Shortcut keypad for visual electronic communications

    公开(公告)号:US12256035B2

    公开(公告)日:2025-03-18

    申请号:US17967176

    申请日:2022-10-17

    Applicant: Snap Inc.

    Abstract: Shortcut keypad system for electronic communications comprises first apparatus and second apparatus. First apparatus and second apparatus each comprise an input device, a processor and a memory. The input device comprises selectable items including first selectable item. The processor of the first apparatus receives a selection of the first selectable item, and transmits a signal corresponding to the first selectable item to the second apparatus. The processor of the second apparatus receives the signal corresponding to the first selectable item, and causes the input device of the second apparatus to indicate that the signal corresponding to the first selectable item is received. Other embodiments are described herein.

    AUDIO RESPONSE MESSAGES
    29.
    发明申请

    公开(公告)号:US20250069620A1

    公开(公告)日:2025-02-27

    申请号:US18947355

    申请日:2024-11-14

    Applicant: Snap Inc.

    Abstract: An audio response system can generate multimodal messages that can be dynamically updated on viewer's client device based on a type of audio response detected. The audio responses can include keywords or continuum-based signal (e.g., levels of wind noise). A machine learning scheme can be trained to output classification data from the audio response data for content selection and dynamic display updates.

    NEURAL NETWORKS FOR CHANGING CHARACTERISTICS OF VOCALS

    公开(公告)号:US20240185879A1

    公开(公告)日:2024-06-06

    申请号:US18440082

    申请日:2024-02-13

    Applicant: Snap Inc.

    CPC classification number: G10L25/51 G10L15/16 G10L15/26

    Abstract: A messaging system for audio character type swapping. Methods of audio character type swapping include receiving input audio data having a first characteristic and transforming the input audio data to an input image where the input image represents the frequencies and intensities of the audio. The methods further include processing the input image using a convolutional neural network (CNN) to generate an output image and transforming the output image to output audio data, the output audio data having a second characteristic. The input audio and output audio may include vocals. The first characteristics may indicate a male voice and the second characteristics may indicate a female voice. The CNN is trained together with another CNN that changes input audio having the second characteristic to audio having the first characteristic. The CNNs are trained using discriminator CNNs that determine whether audio has a first characteristic or a second characteristic.

Patent Agency Ranking