Multi-Talker Audio Stream Separation, Transcription and Diaraization

    公开(公告)号:US20240096346A1

    公开(公告)日:2024-03-21

    申请号:US17850617

    申请日:2022-06-27

    CPC classification number: G10L21/10 G10L15/04 G10L21/0208

    Abstract: A plurality of talker embedding vectors may be derived that correspond to a plurality of talkers in an input audio stream. Each talker embedding vector may represent respective voice characteristics of a respective talker. The talker embedding vectors may be generated based on, for example, a pre-enrollment process or a cluster-based embedding vector derivation process. A plurality of instances of a personalized noise suppression model may be executed on the input audio stream. Each instance of the personalized noise suppression model may employ a respective talker embedding vector. A plurality of single-talker audio streams may be generated by the plurality of instances of the personalized noise suppression model. A plurality of single-talker transcriptions may be generated based on the plurality of single-talker audio streams. The plurality of single-talker transcriptions may be merged into a multi-talker output transcription.

    Videoconference content sharing for public switched telephone network participants

    公开(公告)号:US11909787B1

    公开(公告)日:2024-02-20

    申请号:US17710294

    申请日:2022-03-31

    CPC classification number: H04L65/403 H04L65/1089

    Abstract: A videoconference among a plurality of participants may be hosted, wherein the plurality of participants comprise Internet Protocol (IP)-connected participants and a Public Switched Telephone Network (PSTN)-connected participant. The IP-connected participants may send and receive audio content and video content of the videoconference via IP-based connections. The PSTN-connected participant may send and receive the audio content of the videoconference via a PSTN connection. Additional content from the videoconference may also be transmitted to the PSTN-connected participant, for example as text messages via the PSTN connection. The additional content may include, for example, images of a videoconference screen share, chat posts, polls, and the like. Images may be transmitted in the additional content based on video status change events, such as switching slides or pages in a screen share. In some examples, bidirectional messaging may allow contents of text messages from the PSTN-connected user to be displayed in the videoconference.

    UNIFIED AUDIO SUPPRESSION MODEL
    3.
    发明申请

    公开(公告)号:US20250111857A1

    公开(公告)日:2025-04-03

    申请号:US18478759

    申请日:2023-09-29

    Abstract: Examples herein provide an approach to enhance an audio mixture of a teleconference application by switching between noise suppression modes using a single model. Specifically, a machine learning (ML) model may be configured to, in response to receiving an audio mixture representation as input, suppress either a background noise of the audio mixture or suppress all noise of the audio mixture except a user's voice. In some examples, the ML model may be trained on speech and background noise training data during a training phase. In addition, the ML model may be trained on a user's voice during an enrollment phase. In addition, during an inference phase, the ML model may enhance the audio mixture by suppressing a portion of the audio mixture.

    Separate representations of videoconference participants that use a shared device

    公开(公告)号:US12010459B1

    公开(公告)日:2024-06-11

    申请号:US17710731

    申请日:2022-03-31

    CPC classification number: H04N7/15 G06V40/172 G10L17/06

    Abstract: A plurality of device-sharing participants may be detected that are participating in a videoconference via a shared computing device. The detecting of the plurality of device-sharing participants may be performed based, at least in part, on at least one of an audio analysis of captured audio from one or more microphones or a video analysis of captured video from one or more cameras. A plurality of participant connections corresponding to the plurality of device-sharing participants may be joined to the videoconference. Each of the plurality of participant connections may be identified within the videoconference using a respective name. A plurality of video streams and a plurality of audio streams corresponding to the plurality of participant connections may be transmitted, and the plurality of video streams and the plurality of audio streams may be presented to at least one other conference participant.

Patent Agency Ranking