Disclosed is a four-dimensional (4D: 3D+time) multi-plane broadband imaging system capable of recording 3D multi-plane multiple images in real time. The imaging system comprises: one or more non-reentry quadratically distorted (NRQD) gratings (5) capable of generating focal length and a spatial position corresponding to each order of diffraction, thus transmitting wavefront information between a plurality of object/image planes (2) and the same image/object plane (7) in real time; a grism system (4) for limiting transverse image dispersion caused by chromatic aberration by means of dispersingincident light into a beam of parallel light transversely arranged according to spectral components; a lens system (3) for adjusting an optical path; and an optical detection device (6). In an opticalsystem, the plurality of object/image planes (2), the lens system (3), the grism system (4), the NRQD gratings (5), the optical detection device (6) and the single image/object plane (7) are all located on the same optical axis (1). The simple, easy-to-use optical system with high integration can meet various different requirements and has broad application prospects.