An imaging system for a vehicle includes an imaging sensor having four photosensing pixels of a sub-array, with one of (a) a red-light transmitting spectral filter disposed at a first photosensing pixel whereby the first pixel of each sub-array primarily senses red visible light and with an IR transmitting spectral filter disposed at the fourth photosensing pixel whereby the fourth pixel of each sub-array primarily senses infrared radiation, and (b) a red-light transmitting spectral filter disposed at a first photosensing pixel whereby the first pixel of each sub-array primarily senses red visible light and with an IR transmitting spectral filter disposed at a third photosensing pixel whereby the third pixel of each sub-array primarily senses infrared radiation. An image processor processes the output of each sub-array to determine at least one of an infrared component of the imaged scene and a visible light component of the imaged scene.