The invention provides a phase-based synthetic method for converting a binocular virtual image to a multi-ocular virtual image. The method comprises the following steps: acquiring a binocular image located in RGB (Red, green, blue) color space and consisting of a left image and a right image; converting the binocular image into YIQ color space so as to obtain a left image and a right image in YIQ color space; conducting streerable pyramid filter decomposition on the converted left image and the converted right image; calculating the phase difference of each point on the converted left image and converted right image; operating the phase difference based on the phase difference of each point to obtain a phase interpolation image sequence; conducting an aliasing wave filter process on the phase interpolation image to restructure and restore the image; converting the restructured and restored image back to RGB color space. According to the embodiments of the invention, it is possible to better synthesize new visual points and to achieve a good synthesizing effect to images of objects with fuzzy focus, movement and high reflective property.