The invention discloses a multi-view video coding method, comprising the following steps of: firstly determining that whether a motion estimation mode or a parallax estimation mode is firstly carried out according to reference frame information of coded adjacent blocks, then traversing an intra-frame mode, a Skip mode and seven modes of motion estimation or parallax estimation to a current macro block, calculating RD expenditure of all the modes and determining the best temporary mode; carrying out different calculation of the parallax estimation mode or the motion estimation mode by the obtained best temporary mode and finally obtaining the best mode as a final coding mode; and ending the coding to the current macro block. The multi-view video coding method utilizes correlation between the motion estimation and parallax estimation mode, reduces calculation complexity of the multi-view video coding by ending unnecessary mode calculation in advance, and reduces the coding time by more than 50 percent under the premise that the image quality is almost not reduced, compared with all traversed coding modes.