A method of extracting line segments from a subject image includes calculating a gradient image and a direction image of respective edge pixels in a canny edge image obtained from the subject image, calculating a primary line passing arbitrary two pixels selected among the edge pixels, selecting candidate line segment pixels through performing an incremental pixel extension from a midpoint of the two pixels forming the primary line, and extracting the line segments by checking whether the candidate line segment pixels are connected to each another.