The invention discloses a process of human gesture estimation, which comprises projecting structural optical code information which is recorded on a grating on the human surface through lighting a light source, obtaining a human image containing the structural optical code information according to the reflected lights on the human surface, decoding the structural optical code in the human image to obtain the depth information on each pixel point of the human image, conducting the two-dimensional human gesture estimation for the human image to determine the positions of each part of the human in the image, obtaining the positions of each parts of the human in the image according to the depth information and the two-dimensional human gesture estimation to determine the three-dimensional position of each part of the human, thereby finishing the three-dimensional human gesture estimation. The invention further discloses a system of the human gesture estimation. The process and the system of the human gesture estimation in the implement of the invention have lower cost and convenient realization.