The disclosure is directed to a system and method for inspecting a sample by illuminating the sample at a plurality of different angles and independently processing the resulting image streams. Illumination is directed through a plurality of pupil apertures to a plurality of respective field apertures so that the sample is imaged by portions of illumination directed at different angles. The corresponding portions of light reflected, scattered, or radiated from the surface of the sample are independently processed. Information associated with the independently processed portions of illumination is utilized to determine a location of at least one defect of the sample. Independently processing multiple image streams associated with different illumination angles allows for retention of frequency content that would otherwise be lost by averaging information from multiple imaging angles.