GAZE-BASED AND AUGMENTED AUTOMATIC INTERPRETATION METHOD AND SYSTEM

    公开(公告)号:US20230377558A1

    公开(公告)日:2023-11-23

    申请号:US18319946

    申请日:2023-05-18

    CPC classification number: G10L13/027 G06V40/161 G06F40/58 G10L15/005

    Abstract: The present invention relates to an automatic interpretation method and system for converting only voice of a speaker into a target language. The present invention may significantly improve performance of automatic interpretation with a foreigner to be communicated with, even in a high-noise environment in which multiple speakers utter at the same time by utilizing voice and image information input to a smart device in a complex manner. In addition, the present invention may determine a situation based on text information and image information existing around a user, and reflect the situation information together with multimodal information to an interpretation engine in real time. In addition, the present invention may significantly improve user convenience of an automatic interpretation system by directly augmenting and displaying an interpreted sentence directly next to a speaker image or generating a synthesized sound by distinguishing the interpreted sentence from other speeches.

    METHOD AND APPARATUS FOR CORRECTING ERROR IN SPEECH RECOGNITION SYSTEM
    2.
    发明申请
    METHOD AND APPARATUS FOR CORRECTING ERROR IN SPEECH RECOGNITION SYSTEM 审中-公开
    用于校正语音识别系统中的错误的方法和装置

    公开(公告)号:US20140195226A1

    公开(公告)日:2014-07-10

    申请号:US13902057

    申请日:2013-05-24

    CPC classification number: G10L15/01 G10L2015/225

    Abstract: A method of correcting errors in a speech recognition system includes a process of searching a speech recognition error-answer pair DB based on a sound model for a first candidate answer group for a speech recognition error, a process of searching a word relationship information DB for a second candidate answer group for the speech recognition error, a process of searching a user error correction information DB for a third candidate answer group for the speech recognition error, a process of searching a domain articulation pattern DB and a proper noun DB for a fourth candidate answer group for the speech recognition error, and a process of aligning candidate answers within each of the retrieved candidate answer groups and displaying the aligned candidate answers.

    Abstract translation: 一种校正语音识别系统中的错误的方法包括:基于用于语音识别错误的第一候选答案组的声音模型搜索语音识别错误 - 答复对DB的过程,搜索词关系信息DB的处理 用于语音识别错误的第二候选答案组,搜索用于语音识别错误的第三候选答案组的用户错误校正信息DB的处理,搜索域关节模式DB和专用名词DB的处理,用于第四 用于语音识别错误的候选答案组,以及在每个所检索的候选答案组内对准候选答案并显示对齐的候选答案的处理。

    APPARATUS AND METHOD FOR IMPROVING CONTEXT-BASED AUTOMATIC INTERPRETATION PERFORMANCE

    公开(公告)号:US20230290360A1

    公开(公告)日:2023-09-14

    申请号:US18085889

    申请日:2022-12-21

    CPC classification number: G10L19/00 G10L25/78

    Abstract: An apparatus for improving context-based automatic interpretation performance includes: an uttered voice input unit configured to receive a voice signal from a user; a previous sentence input unit configured to determine whether there is a user’s previous utterance when the voice signal is input by the uttered voice input unit; a voice encoding processing unit configured to decode only the voice signal through the uttered voice input unit when it is determined that there is no user’s previous utterance and extract a vector of the voice signal when it is determined that there is the user’s previous utterance; a context encoding processing unit configured to extract a context vector from a previous utterance when there is the previous utterance and transmit the extracted context vector of the previous utterance; and an interpretation decoding processing unit configured to output an interpretation result text.

Patent Agency Ranking