公开(公告)号：US20230168735A1

公开(公告)日：2023-06-01

申请号：US17536683

申请日：2021-11-29

申请人： Soumil Chugh ,  Juntao Ye

发明人： Soumil Chugh ,  Juntao Ye

IPC分类号： G06F3/01 ,  G06V40/18 ,  G06V40/16 ,  G06V10/25 ,  G06V10/82 ,  G06V10/80 ,  G06N3/04 ,  G06N3/08

CPC分类号： G06F3/013 ,  G06V40/193 ,  G06V40/171 ,  G06V10/25 ,  G06V10/82 ,  G06V10/80 ,  G06N3/0454 ,  G06N3/08

摘要： Methods and systems for estimating a gaze direction of an individual using a trained neural network. Inputs to the neural network include a face image and an image of a visually significant eye in the face image. Feature representations are extracted for the face image and significant eye image and feature fusion is performed on the feature representations to generate a fused feature representation. The fused feature representation is input into a trained gaze estimator to output a gaze vector including gaze angles, the gaze vector representing a gaze direction. The disclosed network may enable gaze estimation performance on user devices typically having limited hardware and computational resources such as mobile devices.