公开(公告)号：US20220157022A1

公开(公告)日：2022-05-19

申请号：US17528401

申请日：2021-11-17

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Seong Min BAEK ,  Youn-Hee GIL ,  Cho-Rong YU ,  Hee Sook SHIN ,  Sungjin HONG

IPC: G06T19/00 ,  G06T7/73 ,  G06T7/50 ,  G09B9/00

Abstract: A method and an apparatus for virtual training based on tangible interaction are provided. The apparatus acquires data for virtual training, and acquires a three-dimensional position of a real object based on a depth image and color image of the real object and infrared (IR) data included in the obtained data. Then, virtualization of an overall appearance of a user is performed by extracting a depth from depth information on a user image included in the obtained data and matching the extracted depth with the color information, and depth data and color data for the user obtained according to virtualization of the user is visualized in virtual training content. In addition, the apparatus performs correction on joint information using the joint information and the depth information included in the obtained data, estimates a posture of the user using the corrected joint information, and estimates a posture of a training tool using the depth information and IR data included in the obtained data.

公开(公告)号：US20230127732A1

公开(公告)日：2023-04-27

申请号：US17727557

申请日：2022-04-22

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Sungjin HONG ,  Hee Sook SHIN ,  Youn-Hee GIL ,  Seong Min BAEK ,  Cho-rong YU

IPC: G09B5/02 ,  G06T7/70 ,  G09B19/00

Abstract: A method of supporting self-learning and a system for performing the method are disclosed. The method includes estimating an object of interest of a user in content based on user performance information inputted by the user in response to content situation information and the content being received from a learning module including the content, analyzing the content situation information, determining whether to generate support information for supporting the user to perform the content based on the estimated object of interest and the analyzed content situation information, and generating the support information that allows the user to self-learn the content according to whether to generate the support information, and outputting the support information to the learning module.