A technique executes autofocus adjustment stably even when a plurality of patterns or foreign matter capable of being imaged only by a specific detector are included independently. Such an image as a concavo-convex image having a weak contrast can be picked up. The technique can automatically focus such an image even when it is difficult to find a focus position in the image. A scanning electron microscope includes a plurality of detectors for detecting secondary signals from a specimen when irradiated with an electron beam, and a calculation unit for combining the signals obtained from the detectors. At least two of the detectors are provided to be symmetric with respect to the electron beam. The focus of the electron beam is adjusted based on the signals of the detectors or on a signal corresponding to a combination of the signals.