A method of stereo image display for a portable device is disclosed. The method comprises obtaining an image, tracking user's eye positions relative to a display area of the portable device, to obtain viewports of the image and view frustums for user's left and right eyes, rendering two projection images respectively for user's left and right eyes according to the view frustums and viewports of the image, and displaying the two projection images for the user.