In a method of operating a light field three-dimensional (3D) display device having an RGBG pixel structure, multi-view image data including RGB data at multiple points of view are received, RGB rearrangement data including R sub-pixel data, G sub-pixel data, and B sub-pixel data are generated from the multi-view image data by extracting two adjacent ones of the R sub-pixel data at a same pixel row at a same point of view, by extracting two adjacent ones of the G sub-pixel data at a same pixel row at different points of view, and by extracting two adjacent ones of the B sub-pixel data at a same pixel row at a same point of view, RGBG data are generated by performing RGB-to-RGBG data conversion on the RGB rearrangement data, and a 3D image is displayed using the RGBG data.