公开(公告)号：US12190907B2

公开(公告)日：2025-01-07

申请号：US17894061

申请日：2022-08-23

Applicant: Korea Electronics Technology Institute

Inventor： Jin Yea Jang ,  Sa Im Shin ,  Min Young Jung ,  San Kim

IPC: G10L25/63 ,  G10L15/22 ,  G10L25/39

Abstract: There are provided a method and a system for automatically generating a back-channel in an interactive agent system. According to an embodiment of the disclosure, an automatic back-channel generation method includes: predicting a back-channel by analyzing an utterance of a user inputted in a back-channel prediction model; and generating the predicted back-channel, and the back-channel prediction model is an AI model that is trained to predict a back-channel to express from the utterance of the user. Accordingly, a back-channel is automatically generated by utilizing a back-channel prediction module which is based on a language model, so that a natural dialogue interaction with a user may be implemented in an interactive agent system, and quality of a dialogue service provided to a user may be enhanced.

公开(公告)号：US11455837B2

公开(公告)日：2022-09-27

申请号：US17726325

申请日：2022-04-21

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Min Young Jung ,  Sa Im Shin ,  Jin Yea Jang ,  San Kim

IPC: G06K9/00 ,  G06V40/70 ,  G06V40/16 ,  G10L15/22

Abstract: This application relates to an adaptive inference system and an operation method therefor. In one aspect, the system includes a user terminal for collecting multi-modal information including at least visual information, voice information and text information. The system may also include an inference support device for receiving the multi-modal information from the user terminal, and inferring the intention of a user on the basis of pre-stored history information related to the user terminal, individualized information and the multi-modal information.

公开(公告)号：US12248759B2

公开(公告)日：2025-03-11

申请号：US17563299

申请日：2021-12-28

Applicant: Korea Electronics Technology Institute

Inventor： Jin Yea Jang ,  Han Mu Park ,  Yoon Young Jeong ,  Sa Im Shin

IPC: G06F40/58 ,  G06F40/53 ,  G06N20/00

Abstract: There are provided a method and system for automatic augmentation of gloss-based sign language translation data. A system for automatic augmentation of sign language translation training data according to an embodiment includes: a database configured to store a sequence of sign language glosses and a sequence of spoken-language words in pairs; and an augmentation module configured to augment the pairs stored in the database. Accordingly, gloss-based training data of high quality may be acquired by performing automatic augmentation for gloss-based training data for sign language translation in an efficient method in terms of time and economic aspects, and eventually, accuracy of translation between sign language glosses and sentences may be enhanced.

公开(公告)号：US11984138B1

公开(公告)日：2024-05-14

申请号：US18384105

申请日：2023-10-26

Applicant: Korea Electronics Technology Institute

Inventor： Min Young Jung ,  Jin Yea Jang ,  San Kim ,  Sa Im Shin

IPC: G06V40/20 ,  G10L25/63

CPC classification number: G10L25/63 ,  G06V40/20

Abstract: There is a method for monitoring emotion and behavior occurring during a conversation with a user who is in need of protection. According to an embodiment, a user monitoring method receives an input of a user utterance and generates a conversation content by using a conversation model based on a user utterance content, converts the generated conversation content into a voice and outputs the voice, and recognizes emotion of the user by using an emotion analysis model based on the user utterance content and monitors the emotion. Accordingly, the method may monitor behavior/emotion of a user through a natural conversation while allowing a specialist/guardian to monitor an abnormal sign of a user who is in need of protection.

公开(公告)号：US11798255B2

公开(公告)日：2023-10-24

申请号：US17563205

申请日：2021-12-28

Applicant: Korea Electronics Technology Institute

Inventor： Han Mu Park ,  Jin Yea Jang ,  Yoon Young Jeong ,  Sa Im Shin

IPC: G06N20/00 ,  G06V10/42 ,  G06V10/774 ,  G06V10/84 ,  G06V40/20 ,  G09B21/00

CPC classification number: G06V10/421 ,  G06V10/7747 ,  G06V10/84 ,  G09B21/009

Abstract: There are provided a method for segmenting a sign language video by gloss to recognize a sign language sentence, and a method for training. According to an embodiment, a sign language video segmentation method receives an input of a sign language sentence video, and segments the inputted sign language sentence video by gloss. Accordingly, there is suggested a method for segmenting a sign language sentence video by gloss, analyzing various gloss sequences from the linguistic perspective, understanding meanings robustly in spite of various changes in sentences, and translating sign language into appropriate Korean sentences.