The present technique aims to provide a solid-state imaging device that reduces shading and color mixing between pixels. The present invention also provides a method of manufacturing the solid-state imaging device. The present technique further relates to a solid-state imaging device that enables provision of an electronic apparatus that uses the solid-state imaging device, a method of manufacturing the solid-state imaging device, and an electronic apparatus. The solid-state imaging device includes a substrate, pixels each including a photoelectric conversion unit formed in the substrate, and a color filter layer formed on the light incidence surface side of the substrate. The solid-state imaging device also includes a device isolating portion that is formed to divide the color filter layer and the substrate for the respective pixels, and has a lower refractive index than the refractive indexes of the color filter layer and the substrate.