The invention provides a method and a system for implementing 3D modeling and holographic display by using Kinect. The method includes the following steps: acquiring color images and depth images of a detected object from 4 different directions through a Kinect sensor; processing the acquired color images and the depth images from the 4 directions to obtain a 3D model of the detected object; conduction depth processing on the images from the 4 directions in the 3D model so as to enable the images from the 4 directions to be displayed in 4 regions of a same screen; separately projecting the images in the 4 regions to 4 surfaces of a holographic pyramid to obtain a holographic image of the detected object. According to the invention, the method of the invention conducts data acquisition, 3D modeling and head part positioning through Kinect, and conducts automatic regulation of the angle of the 3D model based on the head part position of a user so as to enable the holographic projection of the detected object to be suitable for the position where the user is and improve use experience.