公开(公告)号：US20240420691A1

公开(公告)日：2024-12-19

申请号：US18704593

申请日：2023-08-23

Applicant: Korea Electronics Technology Institute

Inventor： Min Young JUNG ,  Sa Im SHIN ,  Jin Yea JANG ,  San KIM

IPC: G10L15/183 ,  G10L13/02

Abstract: There is provided a conversation method and system for operating a conversation model according to the presence or absence of related knowledge. A conversation method according to an embodiment may receive an input of a user utterance, may determine a conversation model based on an inputted user utterance content, may create a conversation content by using the determined conversation model, and may convert the created conversation content into a voice, and may output the voice. Accordingly, different conversation models may be operated according to the presence or absence of related knowledge, so that an empathic conversation may be generated instead of generating an inappropriate response in a knowledge-based conversation, and user's satisfaction on a conversation may be enhanced.

公开(公告)号：US20240096071A1

公开(公告)日：2024-03-21

申请号：US18368600

申请日：2023-09-15

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Sa Im SHIN ,  Jung Ho KIM ,  Bo Eun KIM

IPC: G06V10/774 ,  G06T7/246 ,  G06V10/20 ,  G06V10/82 ,  G06V10/94 ,  G06V20/40 ,  G06V40/20

CPC classification number: G06V10/7747 ,  G06T7/251 ,  G06V10/255 ,  G06V10/82 ,  G06V10/95 ,  G06V20/46 ,  G06V40/23 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30196

Abstract: There is provided a video processing method performed by a computing device, the method including the steps of: collecting video from an external device; generating preprocessed data by extracting two-dimensional or three-dimensional skeleton information from the video; pre-training a first artificial intelligence model including N transformer blocks from the preprocessed data by applying an attention from a body of an object to a plurality of joints, an attention from each of the plurality of joints to the body, and an attention between persons; and learning, when parameters determined as a result of the pre-training of the first artificial intelligence model are transferred, a method of recognizing an action from the video received from the external device, using a second artificial intelligence model including the N transformer blocks on the basis of the parameters, wherein N is a natural number equal to or larger than 2.

公开(公告)号：US20220415093A1

公开(公告)日：2022-12-29

申请号：US17851639

申请日：2022-06-28

Applicant: Korea Electronics Technology Institute

Inventor： Han Mu PARK ,  Jin Yea JANG ,  Sa Im SHIN

IPC: G06V40/20 ,  G06V10/774 ,  G06V20/40 ,  G06V40/10

Abstract: There are provided a method and a system for recognizing a finger language video in units of syllables based on AI. The finger language video recognition system includes: an extraction unit configured to extract posture information of a speaker from a finger language video; and a recognition unit configured to recognize a finger language of the speaker from the extracted posture information of the speaker in units of syllables, and to output a text. Accordingly, a language text in units of syllables may be generated from a finger language video, by using an AI-based syllable unit finger language recognition model.