Methods and apparatuses for generating model and generating 3D animation, devices and storage mediums

    公开(公告)号:US11836836B2

    公开(公告)日:2023-12-05

    申请号:US17527068

    申请日:2021-11-15

    发明人: Shaoxiong Yang

    摘要: Methods and apparatuses for generating a model and generating a 3D animation, devices, and storage mediums are provided. The method for generating a model may include: acquiring a preset sample set; acquiring pre-established generative adversarial nets, the generative adversarial nets including a generator and a discriminator; and performing training steps as follows: selecting a sample from the sample set; extracting a sample audio feature from the sample audio of the sample; inputting the sample audio feature into the generator to obtain a pseudo 3D mesh vertex sequence of the sample; inputting the pseudo 3D mesh vertex sequence and the real 3D mesh vertex sequence of the sample into the discriminator to discriminate authenticity of 3D mesh vertices; and in response to determining that the generative adversarial nets meet a training completion condition, obtaining a trained generator as a model for generating a 3D animation.

    VOICE GENERATION FOR VIRTUAL CHARACTERS
    44.
    发明公开

    公开(公告)号:US20230377556A1

    公开(公告)日:2023-11-23

    申请号:US17751324

    申请日:2022-05-23

    申请人: Lemon Inc.

    IPC分类号: G10L13/02 G06T13/40 G06T13/20

    摘要: The present disclosure describes techniques of generating voices for virtual characters. A plurality of source sounds may be received. The plurality of source sounds may correspond to a plurality of frames of a video. The video may comprise a virtual character. The plurality of source sounds may be converted into a plurality of representations in a latent space using a first model. Each representation among the plurality of representations may comprise a plurality of parameters. The plurality of parameters may correspond to a plurality of sound features. A plurality of sounds may be generated in real time for the virtual character in the video based at least in part on modifying at least one of the plurality of parameters of each representation.

    VIRTUAL ORGANIZATION PROCESS SIMULATOR
    46.
    发明公开

    公开(公告)号:US20230368117A1

    公开(公告)日:2023-11-16

    申请号:US17744183

    申请日:2022-05-13

    申请人: SAP SE

    IPC分类号: G06Q10/06 G06T13/20

    摘要: In an example embodiment, a virtual organization process simulator is provided that is capable of simulating organization operations for complex organization processes when actual organization systems are not available. Large operations are able to be visualized at scale and various “what-if” scenarios can be reproduced in the simulator to provide a user with insight into a value of utilizing certain solutions, such as Enterprise Resource Planning (ERP) software. Engaging virtual world visualizations can also be provided, with story-telling walkthroughs.

    METHODS AND SYSTEMS FOR EMOTION-CONTROLLABLE GENERALIZED TALKING FACE GENERATION

    公开(公告)号:US20230351662A1

    公开(公告)日:2023-11-02

    申请号:US18163704

    申请日:2023-02-02

    摘要: This disclosure relates generally to methods and systems for emotion-controllable generalized talking face generation of an arbitrary face image. Most of the conventional techniques for the realistic talking face generation may not be efficient to control the emotion over the face and have limited scope of generalization to an arbitrary unknown target face. The present disclosure proposes a graph convolutional network that uses speech content feature along with an independent emotion input to generate emotion and speech-induced motion on facial geometry-aware landmark representation. The facial geometry-aware landmark representation is further used in by an optical flow-guided texture generation network for producing the texture. A two-branch optical flow-guided texture generation network with motion and texture branches is designed to consider the motion and texture content independently. The optical flow-guided texture generation network then renders emotional talking face animation from a single image of any arbitrary target face.

    Systems and methods for encoding and rendering animation using a point cloud

    公开(公告)号:US11803994B2

    公开(公告)日:2023-10-31

    申请号:US17727327

    申请日:2022-04-22

    申请人: Illuscio, Inc.

    IPC分类号: G06T13/20 G06T3/40 G06T11/00

    摘要: Disclosed is a system for encoding and/or rendering animations without temporal or spatial restrictions. The system may encode an animation as a point cloud with first data points having a first time value and different positional and non-positional values, and second data points having a second time value and different positional and non-positional values. Rendering the animation may include generating and presenting a first image for the first time value of the animation based on the positional and non-positional values of the first data points, and generating and presenting a second image for the second time value of the animation by changing a visualization at a first position in the first image based on the positional values of a data point from the second data points corresponding to the first position and the data point non-positional values differing from the visualization.

    State-space system for pseudorandom animation

    公开(公告)号:US11790585B2

    公开(公告)日:2023-10-17

    申请号:US17804430

    申请日:2022-05-27

    申请人: Snap Inc.

    摘要: Methods, devices, media, and other embodiments are described for a state-space system for pseudorandom animation. In one embodiment animation elements within a computer model are identified, and for each animation element motion patterns and speed harmonics are identified. A set of motion data values comprising a state-space description of the motion patterns and the speed harmonics are generated, and a probability assigned to each value of the set of motion data values for the state-space description. The probability can then be used to select and update a particular motion used in an animation generated from the computer model.