The invention discloses an eye movement tracking-based man-machine interactive system and a working method thereof. The system comprises a processor connected with an AR/VR head display apparatus anda video collection apparatus; an eye movement tracking sensor and an angular movement sensor are arranged on the AR/VR head display apparatus and are used for capturing eye movement information in real time, collecting a current movement state of the AR/VR head display apparatus in real time and transmitting the eye movement information and the current movement state to the processor respectively;and the video collection apparatus is used for collecting a scene image in a sight line range of eyes and transmitting the scene image to the processor. The interactive experience of AR/VR in the engineering application fields can be improved.