The invention relates to a large scale streaming set data distributed processing method, and belongs to the technical field of computer data processing. The method includes: recording a complete state of steaming set data on the basis of a distributed message system, and allowing the message system to generate a corresponding message if the steaming set date is complete; allowing a distributed computing system to extract a state message of the steaming set data from the distributed message system, storing the acquired streaming set data into a distributed storage system; and performing distributed processing and computing according to a specific processing algorithm and a service logic, storing the processing result to the distributed storage system, and completing processing of the streaming set data. The method can effectively control the processing flow of the streaming set data, and utilizes batch computing of the set data to improve the resource utilization rate of the system. The method can rapidly and effectively process increasing streaming set data, is suitable for typical big data application scenes such as industrial internet of things and weather Information networks.