Emotes for non-verbal communication in a videoconference system

    公开(公告)号:US12075193B2

    公开(公告)日:2024-08-27

    申请号:US18200394

    申请日:2023-05-22

    申请人: Katmai Tech Inc.

    IPC分类号: H04N7/15 G06F3/01 G06F3/16

    摘要: A method is disclosed for videoconferencing in a three-dimensional virtual environment. In the method, a video stream captured from a camera on a first device of a first user and a specification of an emote are received. The specification is input by the first user through the first device. Then, the video stream is mapped onto a three-dimensional model of an avatar. From a perspective of a virtual camera of a second user, the three-dimensional virtual environment is rendered for display to the second user through a second device. This rendering includes the mapped three-dimensional model of the avatar, and the emote attached to the three-dimensional model of the avatar, where the emote emits sound played by the second device.

    Volumetric avatar rendering
    3.
    发明授权

    公开(公告)号:US11741652B1

    公开(公告)日:2023-08-29

    申请号:US17931804

    申请日:2022-09-13

    申请人: Katmai Tech Inc.

    IPC分类号: G06T13/40 G06T19/20

    CPC分类号: G06T13/40 G06T19/20

    摘要: Disclosed herein are aspects for altering avatar backgrounds and rendering volumetric avatars in a three-dimensional virtual environment. An aspect begins by receiving, from a first device of a first user, configuration settings specifying how a background of a first user's avatar is to be presented to a second user in the 3D virtual environment. The aspect continues by capturing a video stream of the first user and altering portions of the video stream. The configuration settings and the video stream with the altered background are used to render the first user's avatar. Another aspect begins by receiving configuration settings and a video stream with a background. The aspect continues by rendering a front surface, back surface, and side surface of an avatar based on the configuration settings and video stream.

    Resituating avatars in a virtual environment

    公开(公告)号:US11700354B1

    公开(公告)日:2023-07-11

    申请号:US17870091

    申请日:2022-07-21

    申请人: Katmai Tech Inc.

    IPC分类号: G06F3/04815 H04N7/15

    CPC分类号: H04N7/157 G06F3/04815

    摘要: Disclosed herein are aspects for resituating avatars in a virtual environment. An aspect begins by rendering the virtual environment, including a first avatar and a second avatar. The virtual environment is rendered on a first device, belonging to a first user, and from a perspective of a first virtual camera controlled by the first user. The first avatar represents the first user at a location of the first virtual camera. The second user views the virtual environment from a perspective of a second virtual camera at a location of the second avatar. The aspect then provides several operations from the perspective of the first virtual camera. First, the aspect continues by determining a new location for a perceived avatar relative to the first avatar. The perceived avatar corresponds to the second avatar. Then, the aspect concludes by resituating the perceived avatar to the new location.

    Avatar background alteration
    7.
    发明授权

    公开(公告)号:US11776227B1

    公开(公告)日:2023-10-03

    申请号:US17931762

    申请日:2022-09-13

    申请人: Katmai Tech Inc.

    摘要: Disclosed herein are aspects for altering avatar backgrounds and rendering volumetric avatars in a three-dimensional virtual environment. An aspect begins by receiving, from a first device of a first user, configuration settings specifying how a background of a first user's avatar is to be presented to a second user in the 3D virtual environment. The aspect continues by capturing a video stream of the first user and altering portions of the video stream. The configuration settings and the video stream with the altered background are used to render the first user's avatar. Another aspect begins by receiving configuration settings and a video stream with a background. The aspect continues by rendering a front surface, back surface, and side surface of an avatar based on the configuration settings and video stream.

    Resituating virtual cameras and avatars in a virtual environment

    公开(公告)号:US11741664B1

    公开(公告)日:2023-08-29

    申请号:US17870101

    申请日:2022-07-21

    申请人: Katmai Tech Inc.

    IPC分类号: G06T15/20 G06T15/04 G06T13/40

    摘要: Disclosed herein are aspects for resituating virtual cameras and avatars in a virtual environment. An aspect begins by rendering the virtual environment, including a first avatar and a second avatar. The virtual environment is rendered on a first device, belonging to a first user, and from a perspective of a first virtual camera controlled by the first user. The first avatar represents the first user at a location of the first virtual camera. The second user views the virtual environment from a perspective of a second virtual camera at a location of the second avatar. The aspect proceeds by repositioning the first virtual camera and the first avatar to a first location and resituating the second avatar to a second location. The aspect concludes by sending a message instructing a second device, belonging to the second user, to resituate the second virtual camera to the second location.