There is provided a signal processing device including a feature amount extraction unit configured to extract, from a frequency-domain signal obtained by frequency conversion on a voice signal, a feature amount of the frequency-domain signal, and a determination unit configured to determine, based on the extracted feature amount, presence or absence of noise in the voice signal within a predetermined section. The feature amount is composed of a plurality of elements. The plurality of elements contain an element defined based on a correlation value between a feature amount waveform which is a waveform according to the frequency-domain signal in the voice signal within the predetermined section and a feature amount waveform within another section sequential in time to the predetermined section.