Multi-process data processing system based on message queue

Aimed at the problems of current mass data in database,a multi-process processing method is presented and a complex data processing system,which uses message queue as the inter process communication(IPC) tool is designed and implemented.The principle and architecture of the system is explained and the system is implemented under the unix operating system.The UI of monitoring every process status is provided and the builder design pattern is used,so the system has more extensibility.Finally,experimental results show that this method is better than traditional ones in reducing the system execution time and feasibility of the method is validated.