公开(公告)号：US20210043110A1

公开(公告)日：2021-02-11

申请号：US16536151

申请日：2019-08-08

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Hye Dong JUNG ,  Sang Ki KO ,  Han Mu PARK ,  Chang Jo KIM

IPC: G09B21/00 ,  G10L25/90 ,  G10L25/63 ,  G06K9/00 ,  G10L15/22 ,  G10L15/24 ,  G06T11/00

Abstract: Disclosed is a method of providing a sign language video reflecting an appearance of a conversation partner. The method includes recognizing a speech language sentence from speech information, and recognizing an appearance image and a background image from video information. The method further comprises acquiring multiple pieces of word-joint information corresponding to the speech language sentence from joint information database, sequentially inputting the word-joint information to a deep learning neural network to generate sentence-joint information, generating a motion model on the basis of the sentence-joint information, and generating a sign language video in which the background image and the appearance image are synthesized with the motion model. The method provides a natural communication environment between a sign language user and a speech language user.

公开(公告)号：US20200005086A1

公开(公告)日：2020-01-02

申请号：US16147962

申请日：2018-10-01

Applicant: Korea Electronics Technology Institute

Inventor： Sang Ki KO ,  Choong Sang CHO ,  Hye Dong JUNG ,  Young Han LEE

IPC: G06K9/62 ,  G06K9/00 ,  G06K9/46 ,  G06K9/42

Abstract: Deep learning-based automatic gesture recognition method and system are provided. The training method according to an embodiment includes: extracting a plurality of contours from an input image; generating training data by normalizing pieces of contour information forming each of the contours; and training an AI model for gesture recognition by using the generated training data. Accordingly, robust and high-performance automatic gesture recognition can be performed, without being influenced by an environment and a condition even while using less training data.

公开(公告)号：US20210034846A1

公开(公告)日：2021-02-04

申请号：US16942985

申请日：2020-07-30

Applicant: Korea Electronics Technology Institute

Inventor： Sang Ki KO ,  Hye Dong JUNG ,  Han Mu PARK ,  Chang Jo KIM

IPC: G06K9/00 ,  G06F3/01 ,  G06N3/08 ,  G06N3/04 ,  G10L13/00

Abstract: A method and apparatus for recognizing a sign language or a gesture by using a three-dimensional (3D) Euclidean distance matrix (EDM) are disclosed. The method includes a two-dimensional (2D) EDM generation step for generating a 2D EDM including information about distances between feature points of a body recognized in image information by a 2D EDM generator, a 3D EDM generation step for receiving the 2D EDM and generating a 3D EDM by using a first deep learning neural network trained with training data in which input data is a 2D EDM and correct answer data is a 3D EDM by a 3D EDM generator, and a recognition step for recognizing a sign language or a gesture based on the 3D EDM.