A three-dimensional (3D) display apparatus is provided, including an image input device which receives an image and depth information, a multi-view image generator which generates a multi-view foreground image having depth information which is less than a preset depth value, and a multi-view rear ground image having depth information which is equal to or greater than the preset depth value, using the received image and depth information, a multi-view image renderer which performs rendering by arranging the multi-view foreground image according to a first arrangement pattern and the multi-view rear ground image according to a second arrangement pattern, and a display which outputs the rendered multi-view image.