-
公开(公告)号：US20240205634A1
公开(公告)日：2024-06-20
申请号：US18589768
申请日：2024-02-28
Inventor： Zheng XUE , Yangfei XU , Wenzhi FAN , Zhifei ZHANG , Yuzhou GONG , Zejun MA
IPC: H04S7/00 , G10L19/008 , H04R1/40 , H04R3/00 , H04R3/12
CPC classification number: H04S7/306 , G10L19/008 , H04R1/406 , H04R3/005 , H04R3/12 , H04S7/304 , H04R2201/40 , H04S2400/11
Abstract: An audio signal playing method and apparatus, and an electronic device are provided. The method comprises: separating, from a first audio signal, a recorded audio signal corresponding to each of at least one sound source; on the basis of the first audio signal, determining a real-time orientation of each of the at least one sound source relative to the head of a user; for each sound source, according to the real-time orientation of the sound source and the recorded audio signal corresponding to the sound source, generating a target direct audio signal corresponding to the sound source, and generating a target reverberated audio signal corresponding to the sound source; and playing a second audio signal that is generated by means of fusing the target direct audio signal and the target reverberated audio signal corresponding to each sound source.
-
2.发明公开公开(公告)号：US20240095451A1
公开(公告)日：2024-03-21
申请号：US18469461
申请日：2023-09-18
Applicant: BEIJING YOUZHUJU NETWORK TECHNOLOGY CO. LTD.
Inventor： Yuxiang ZOU , Zejun MA
IPC: G06F40/284 , G06F40/263 , G10L13/10
CPC classification number: G06F40/284 , G06F40/263 , G10L13/10
Abstract: Provided are an electronic device and a computer readable storage medium. The method includes: acquiring a text to be analyzed; performing token conversion on words in the text to be analyzed to obtain a token sequence to be analyzed, where tokens in token sequences to be analyzed corresponding to texts to be analyzed in different languages belong to a same type; and performing feature extraction on the token sequence to be analyzed, and processing a target task based on the extracted feature, to determine an analysis result for the text to be analyzed.
-
公开(公告)号：US20240331706A1
公开(公告)日：2024-10-03
申请号：US18741427
申请日：2024-06-12
Inventor： Linhao DONG , Zhiyun FAN , Zejun MA
IPC: G10L17/04
CPC classification number: G10L17/04
Abstract: A method, apparatus, device, and storage medium for speaker change point detection, the method including: acquiring target voice data to be detected; and extracting an acoustic feature characterizing acoustic information of the target voice data from the target voice data; encoding the acoustic feature to obtain speaker characterization vectors of the target voice data; integrating and firing the speaker characterization vectors of the target voice data based on a continuous integrate-and-fire CIF mechanism, to obtain a sequence of speaker characterizations in the target voice data; and determining the speaker change points, according to the sequence of the speaker characterizations bounded by the speaker change points in the target voice data. This method can effectively improve the accuracy of the detection result of a speaker change point in target voice data with a type of interaction.
-
公开(公告)号：US20240379116A1
公开(公告)日：2024-11-14
申请号：US18662675
申请日：2024-05-13
Applicant: Beijing Youzhuju Network Technology Co, Ltd.
Inventor： Xiusong SUN , Zejun MA
IPC: G10L21/14 , G10L25/57 , H04N21/439 , H04N21/488
Abstract: The disclosure relates to an audio caption alignment method and apparatus, a medium, and an electronic device. The method includes: obtaining a target audio and a target caption text of the target audio; obtaining a plurality of first target audios by slicing the target audio according to a slicing duration in a case that a duration of the target audio is greater than a first preset duration; determining first audio feature information of each of the first target audios; obtaining target audio feature information of the target audio by concatenating all of the first audio feature information in a case that the duration of the target audio is less than or equal to a second preset duration, where the second preset duration is greater than the first preset duration; and generating caption information corresponding to the target audio according to the target caption text and the target audio feature information.
-
公开(公告)号：US20240221729A1
公开(公告)日：2024-07-04
申请号：US18288531
申请日：2022-05-07
Inventor： Linhao DONG , Zejun MA
Abstract: The present disclosure provides a voice recognition method and apparatus, a medium, and an electronic device. The method includes: encoding received voice data to obtain an acoustic vector sequence corresponding to the voice data; obtaining, according to the acoustic vector sequence and a first prediction model, an information amount sequence corresponding to the voice data and a first probability sequence corresponding to the voice data; obtaining a second probability sequence according to the acoustic vector sequence and a second prediction model; determining a target probability sequence according to the first probability sequence and the second probability sequence; and determining a target text corresponding to the voice data according to the target probability sequence.
-
Patent Agency Ranking
公开(公告)号：US20230402031A1
公开(公告)日：2023-12-14
申请号：US18249031
申请日：2022-04-06
Inventor： Linhao DONG , Meng CAI , Zejun MA
CPC classification number: G10L15/02 , G10L15/063 , G10L15/22 , G10L15/16
Abstract: A speech processing method is provided. The method includes: receiving a speech block to be identified as a current speech block, where the speech block includes a past frame, a current frame and a future frame; performing a speech identification process based on the current speech block, where the speech identification process includes: performing speech identification based on the current speech block to obtain a speech identification result of the current frame and a speech identification result of the future frame; determining whether a previous speech block for the current speech block exists; in a case that the previous speech block for the current speech block exists, updating a target identification result based on the speech identification result of the current frame of the current speech block; and outputting the speech identification result of the future frame of the current speech block.
-
公开(公告)号：US20240185046A1
公开(公告)日：2024-06-06
申请号：US18444050
申请日：2024-02-16
Inventor： Xiaoyang LI , Zilin YU , Xiangyang ZHANG , Xiaogang TIAN , Zejun MA
IPC: G06N3/063
CPC classification number: G06N3/063
Abstract: The present application relates to an intention recognition method and apparatus, a readable medium, and an electronic device. The method includes: by means of a preset intention recognition quantification model, performing a quantification operation on a dot product of a query vector and a key vector which correspond to each character in a target text, so as to obtain a fixed-point type target vector of a first bit; according to the fixed-point type target vector, determining, by means of a target mapping relationship, a floating-point type attention weight of a second bit corresponding to each character; and according to the floating-point type attention weight, determining a target intention corresponding to the target text, the first bit being smaller than the second bit.
-
8.发明公开公开(公告)号：US20240169988A1
公开(公告)日：2024-05-23
申请号：US18427538
申请日：2024-01-30
Inventor： Linhao DONG , Zejun MA
CPC classification number: G10L15/22 , G10L15/063
Abstract: The present disclosure discloses a method and device of generating acoustic features, speech model training, and speech recognition. By acquiring the acoustic information vector of the current speech frame and the information weight of the current speech frame, and according to the accumulated information weight corresponding to the previous speech frame, the retention rate corresponding to the current speech frame, and the information weight of the current speech frame, the accumulated information weight corresponding to the current speech frame can be obtained. The retention rate is the difference between 1 and a leakage rate.
-
公开(公告)号：US20240135933A1
公开(公告)日：2024-04-25
申请号：US18394143
申请日：2023-12-22
Inventor： Linhao DONG , Zhiyun FAN , Zejun MA
IPC: G10L17/04
CPC classification number: G10L17/04
Abstract: A method, apparatus, device, and storage medium for speaker change point detection, the method including: acquiring target voice data to be detected; and extracting an acoustic feature characterizing acoustic information of the target voice data from the target voice data; encoding the acoustic feature to obtain speaker characterization vectors at a voice frame level of the target voice data; integrating and firing the speaker characterization vectors at the voice frame level of the target voice data based on a continuous integrate-and-fire CIF mechanism, to obtain a sequence of speaker characterizations bounded by speaker change points in the target voice data; and determining a timestamp corresponding to the speaker change points, according to the sequence of the speaker characterizations bounded by the speaker change points in the target voice data.
-
公开(公告)号：US20240127795A1
公开(公告)日：2024-04-18
申请号：US18276769
申请日：2022-05-07
Inventor： Linhao DONG , Zejun MA
IPC: G10L15/06 , G10L15/065
CPC classification number: G10L15/063 , G10L15/065 , G10L2015/0635 , G10L19/04
Abstract: A model training method, a speech recognition method and apparatus, a medium, and a device are provided. The speech recognition model including an encoder, a CIF prediction sub-model and a CTC prediction sub-model. The model training method includes: encoding training speech data based on the encoder to obtain an acoustic vector sequence corresponding to the training speech data; obtaining an information amount sequence corresponding to the training speech data based on the acoustic vector sequence and the CIF prediction sub-model; obtaining a target probability sequence based on the acoustic vector sequence and the CTC prediction sub-model; determining a target loss of the speech recognition model based on the information amount sequence and the target probability sequence; and updating, in response to an updating condition being satisfied, a model parameter of the speech recognition model based on the target loss.
-
-
-
-
-
-
-
-
-
Search Results
10
records
(took 0.016 seconds)
