An image sensor may be provided in which a pixel array includes imaging pixels and application-specific pixels. The application-specific pixels may include depth-sensing pixels, infrared imaging pixels, or other types of application-specific pixels. A color filter array may be formed over the pixel array. The color filter array may include Bayer color filter array formed over the imaging pixels. The color filter array may also include a plurality of green color filter elements formed over the application-specific pixels. Barrier structures may be interposed between imaging pixels and application-specific pixels. The barrier structures may be configured to reduce or eliminate optical crosstalk between imaging pixels and adjacent application-specific pixels. The barrier structures may include an opaque photodefinable material such as black or blue photodefinable material that may be configured to filter out wavelength bands of interest. The barrier structures may be formed during the color filter array fabrication process.