公开(公告)号：US10884112B2

公开(公告)日：2021-01-05

申请号：US16626571

申请日：2018-11-29

Applicant: CENTRAL CHINA NORMAL UNIVERSITY

Inventor： Zongkai Yang ,  Sannvya Liu ,  Zhicheng Dai ,  Zengzhao Chen ,  Xiuling He

IPC: G01S11/06 ,  G01S5/02 ,  H04B17/318 ,  H04W4/33 ,  H04W4/80 ,  H04W4/021 ,  H04W4/02 ,  H04W8/00 ,  H04W64/00

Abstract: The disclosure discloses a fingerprint positioning method in a smart classroom, which is specifically: firstly, performing Gaussian filtering and taking the average value on a wireless signal strength value RSSI in the fingerprint database; then finding the neighbor point closest to the signal strength of the to-be-measured point; finally, the Euclidean distance is used as the weight reference, and the weighted center of mass is obtained for the nearest neighbor points. The weight index is introduced as an index of the weight, and the coordinates of the to-be-tested node are obtained. The disclosure has a higher positioning accuracy, smaller positioning error fluctuations and greater environmental adaptability.

公开(公告)号：US11908344B1

公开(公告)日：2024-02-20

申请号：US18484309

申请日：2023-10-10

Applicant: Central China Normal University

Inventor： Zongkai Yang ,  Zheng Zhong ,  Di Wu ,  Xu Chen

IPC: G09B5/06 ,  G06T17/00 ,  G06T7/246 ,  G06T7/70 ,  G06V40/16 ,  G06V40/20 ,  G06V20/70 ,  G06F3/01 ,  G09B5/14 ,  G09B5/10

CPC classification number: G09B5/065 ,  G06F3/017 ,  G06T7/246 ,  G06T7/70 ,  G06T17/00 ,  G06V20/70 ,  G06V40/166 ,  G06V40/174 ,  G06V40/28 ,  G03H2226/05 ,  G06T2207/20044 ,  G06T2207/20084 ,  G09B5/10 ,  G09B5/14

Abstract: This application relates to teaching applications of virtual reality technology, and provides a three-dimensional (3D) integrated teaching field system based on a flipped platform and a method for operating the same. The system includes a device deployment module, a teaching resource matching module, an acquisition and processing module and an edge computing module. The method includes spatial division of the 3D comprehensive teaching field system in an offline classroom, device deployment, edge computing, holographic display, data acquisition, motion positioning, and construction of a teaching interactive environment.

公开(公告)号：US11164289B1

公开(公告)日：2021-11-02

申请号：US17371074

申请日：2021-07-08

Applicant: Central China Normal University

Inventor： Zongkai Yang ,  Zheng Zhong ,  Di Wu

IPC: G06T3/40 ,  G06T7/50 ,  G06N20/00 ,  G06T15/04

Abstract: A method for generating a high-precision and microscopic virtual learning resource includes acquisition of high-definition specimen images, generation of a 3D model of a surface a specimen and interactive display of a microscopic virtual learning resource.

公开(公告)号：US11151890B2

公开(公告)日：2021-10-19

申请号：US17225088

申请日：2021-04-07

Applicant: Central China Normal University

Inventor： Zongkai Yang ,  Zheng Zhong ,  Di Wu ,  Ke Wu

IPC: G09B5/00 ,  G09B5/10 ,  G03H1/00 ,  G06F3/01 ,  G06K9/00 ,  G06N5/02 ,  G09B5/06

Abstract: Provided is a 5G interactive distance dedicated teaching system based on holographic terminal and a working method thereof. The distance dedicated teaching system includes a data acquisition module, a data transmission module, a 5G cloud rendering module, a natural interaction module, a holographic display module and a teaching service module.

公开(公告)号：US10916158B2

公开(公告)日：2021-02-09

申请号：US16697205

申请日：2019-11-27

Applicant: CENTRAL CHINA NORMAL UNIVERSITY

Inventor： Zongkai Yang ,  Jingying Chen ,  Sannvya Liu ,  Ruyi Xu ,  Kun Zhang ,  Leyuan Liu ,  Shixin Peng ,  Zhicheng Dai

IPC: G09B19/00 ,  G06K9/00 ,  G06K9/62 ,  G06Q50/20 ,  G09B7/00

Abstract: The invention provides a classroom cognitive load detection system belonging to the field of education informationization, which includes the following. A task completion feature collecting module records an answer response time and a correct answer rate of a student when completing a task. A cognitive load self-assessment collecting module quantifies and analyzes a mental effort and a task subjective difficulty by a rating scale. An expression and attention feature collecting module collects a student classroom performance video to obtain a face region through a face detection and counting a smiley face duration and a watching duration of the student according to a video analysis result. A feature fusion module fuses aforesaid six indexes into a characteristic vector. A cognitive load determining module inputs the characteristic vector to a classifier to identify a classroom cognitive load level of the student.

公开(公告)号：US11967175B2

公开(公告)日：2024-04-23

申请号：US18322517

申请日：2023-05-23

Applicant: CENTRAL CHINA NORMAL UNIVERSITY

Inventor： Sannyuya Liu ,  Zongkai Yang ,  Xiaoliang Zhu ,  Zhicheng Dai ,  Liang Zhao

IPC: G06K9/00 ,  G06V10/24 ,  G06V10/62 ,  G06V10/77 ,  G06V10/80 ,  G06V10/82 ,  G06V20/40 ,  G06V40/16 ,  G06V10/774

CPC classification number: G06V40/165 ,  G06V10/247 ,  G06V10/62 ,  G06V10/7715 ,  G06V10/806 ,  G06V10/82 ,  G06V20/41 ,  G06V40/171 ,  G06V40/174 ,  G06V10/774

Abstract: Provided are a facial expression recognition method and system combined with an attention mechanism. The method comprises: detecting faces comprised in each video frame in a video sequence, and extracting corresponding facial ROIs, so as to obtain facial pictures in each video frame; aligning the facial pictures in each video frame on the basis of location information of facial feature points of the facial pictures; inputting the aligned facial pictures into a residual neural network, and extracting spatial features of facial expressions corresponding to the facial pictures; inputting the spatial features of the facial expressions into a hybrid attention module to acquire fused features of the facial expressions; inputting the fused features of the facial expressions into a gated recurrent unit, and extracting temporal features of the facial expressions; and inputting the temporal features of the facial expressions into a fully connected layer, and classifying and recognizing the facial expressions.

公开(公告)号：US11410570B1

公开(公告)日：2022-08-09

申请号：US17574767

申请日：2022-01-13

Applicant: Central China Normal University

Inventor： Zongkai Yang ,  Zheng Zhong ,  Di Wu ,  Xu Chen

IPC: G09B7/02 ,  G06T17/05 ,  G06T9/00 ,  G06T7/70 ,  G10L15/02 ,  G10L15/22 ,  H04L41/12 ,  H04N13/344 ,  H04N13/383 ,  G06V40/16 ,  G06V40/20 ,  G06V40/70 ,  G06T17/20 ,  G06T17/00 ,  G06V10/762 ,  H04N5/247 ,  G06T13/40 ,  G10L21/0232 ,  G10L15/30 ,  G10L19/16 ,  H04L67/10 ,  G01S17/89 ,  G01B21/18 ,  G06T15/00 ,  H04L67/568 ,  G10L21/0208

Abstract: A method for operating a comprehensive three-dimensional teaching field, including: collecting, by a sensor, a depth data of a real teaching space, point cloud data of a teacher and voice data of the teacher; performing calculation and caching of an architecture for data storage, transmission and rendering of a virtual teaching space based on edge cloud; building a database model of the virtual teaching space by using a R-tree spatial index structure to realize distributed data storage; generating a virtual avatar model updating in real time by positioning and tracking an action of a user; displaying an image of the virtual teaching space on terminals of the teacher and a student through encoding, uploading, 5G rendering and decoding by using a 5G link.

公开(公告)号：US11120640B1

公开(公告)日：2021-09-14

申请号：US17326272

申请日：2021-05-20

Applicant: Central China Normal University

Inventor： Zongkai Yang ,  Zheng Zhong ,  Di Wu ,  Ke Wu

IPC: G06T19/20 ,  G06T19/00 ,  G06F3/01 ,  G09B9/00

Abstract: A fusion method for movements of a teacher in a teaching scene includes normalization, motion perception and fusion of movements. According to interaction needs in an enhanced teaching scene, this application establishes a moving information collection and a conversion of moving position and range to realize the normalization of movement.

公开(公告)号：US12036021B2

公开(公告)日：2024-07-16

申请号：US18511919

申请日：2023-11-16

Applicant: CENTRAL CHINA NORMAL UNIVERSITY

Inventor： Liang Zhao ,  Sannyuya Liu ,  Zongkai Yang ,  Xiaoliang Zhu ,  Jianwen Sun ,  Qing Li ,  Zhicheng Dai

IPC: A61B8/14 ,  A61B5/00 ,  A61B5/0205 ,  A61B5/1171 ,  A61B5/16 ,  G06N3/0464 ,  G06N3/08 ,  G06V10/30 ,  G06V40/16 ,  A61B5/024 ,  A61B5/08

CPC classification number: A61B5/16 ,  A61B5/0205 ,  A61B5/1176 ,  A61B5/725 ,  A61B5/726 ,  A61B5/7264 ,  G06N3/0464 ,  G06N3/08 ,  G06V10/30 ,  G06V40/161 ,  A61B5/02427 ,  A61B5/0816 ,  G06V2201/03

Abstract: The present disclosure provides a non-contact fatigue detection system and method based on rPPG. The system and method adopt multi-thread synchronous communication for real-time acquisition and processing of rPPG signal, enabling fatigue status detection. In this setup, the first thread handles real-time rPPG data capture, storage and concatenation, while the second thread conducts real-time analysis and fatigue detection of rPPG data. Through a combination of skin detection and LUV color space conversion, rPPG raw signal extraction is achieved, effectively eliminating interference from internal and external environmental facial noise; Subsequently, an adaptive multi-stage filtering process enhances the signal-to-noise ratio, and a multi-dimensional fusion CNN model ensures accurate detection of respiration and heart rate. The final step involves multi-channel data fusion of respiration and heartbeats, succeeding in not only learning person-independent features for fatigue detection but also detecting early fatigue with very high accuracy.

公开(公告)号：US11568012B2

公开(公告)日：2023-01-31

申请号：US16605806

申请日：2018-05-08

Applicant: CENTRAL CHINA NORMAL UNIVERSITY

Inventor： Zongkai Yang ,  Sannyuya Liu ,  Dongbo Zhou ,  Jianwen Sun ,  Jiangbo Shu ,  Hao Li

IPC: G06F16/00 ,  G06F16/9537 ,  G06F16/9535 ,  G09B5/12

Abstract: The disclosure discloses a method for analyzing educational big data on the basis of maps. The method includes acquiring educational resource data and storing the educational resource data into databases according to certain data structures; constructing theme map layers for each analysis theme, classifying and indexing data according to the analysis themes, and superimposing the theme map layers onto base maps to form data maps; analyzing data of the theme map layers according to the analysis themes and acquiring theme analysis results; extracting the data of the multiple theme map layers in target regions, fusing the data and acquiring region analysis results; acquiring learning preference of users; combining the learning preference of the users according to content of user requests and searching the region analysis results in response to the user requests. The disclosure further discloses a system for analyzing the educational big data on the basis of the maps.