The invention relates to a chip for realizing video structuring description treatment and a method thereof. The chip comprises a main control processor, an input and output processor, a storage control processor, a video coding and decoding processor and a video analysis processor, wherein the main control processor is used for controlling each part of the chip to work in phase, the input and output processor is used for inputting and outputting data, the storage control processor is used for controlling data storage, the video coding and decoding processor is used for coding and decoding videos, the video analysis processor is used for describing the video data in a structuring mode, and all processors are mutually connected by multiple layers of buses. The chip for realizing video structuring description treatment can describe the video in a structuring mode and generate description data which concerns to image attribute, content and characteristics used for the retrieval, the described data has small data amount and is convenient to store and transmit via networks, so that the use ratio of video information can be improved, and video information retrieval cost can be greatly lowered.