A light source device capable of suppressing generation of color unevenness, and a display device using the same are provided. The light source device 1 is provided with a plurality of excitation light sources 11 which are arranged at prescribed intervals D on a substrate 10 and emit blue light, and a phosphor layer 12 which converts part of the blue light emitted from the excitation light sources into red light and green light and arranged at a distance from the excitation light sources 11 to oppose the substrate 10. Fluctuation of intensity of each color light due to nonuniform application of the phosphor layer is difficult to occur as compared with a configuration in the past where the phosphor layer is formed adjacent to each excitation light source.