The invention relates to a 360-degree stereo panoramic observation system for an unmanned aerial vehicle. The system comprises an observation subsystem and a processing subsystem, wherein the observation subsystem is composed of a plurality of cameras that observe the six directions of a space where the unmanned aerial vehicle is located, and the processing subsystem communicates with the observation subsystem. Compared with the prior art, the system can observe environmental information around an altitude where the unmanned aerial vehicle is located and environmental image information at thealtitude of the unmanned aerial vehicle, and have a horizontal 360-degree view and a vertical 360-degree view. According to the 360-degree stereo panoramic observation system for the unmanned aerial vehicle of the invention, an elevation sensing module is additionally adopted and is compatible with Beidou/GPS satellite information and inertial sensor information, so that the system can detect positions and elevation information in the observation environment of the unmanned aerial vehicle more accurately; and 2D and 3D modeling is used to observe image pairs, and altitude information is combined with the environmental image information, so that the environment can be described more accurately.