Based on the data mapping and protocols balance processing method, apparatus and system for
2010
The present invention discloses a data mapping and protocols based on the processing method, apparatus and system balance. Comprising: acquiring data submitted by the client, the data acquired initial partition according Mapper is set in advance, respectively; data initial partition mapping processing, obtaining an intermediate result data; call partitioner function, the intermediate result data in accordance with fine-grained partitions set in advance the number of fine-grained partitioning, fine-grained partition number is greater than the preset number of partitions statute; outputs intermediate results of fine-grained partitions data amount information to the operating server, the server receives the returned work of fine-grained intermediate result data correspondence relationship between the partition and the partition statute, combined fine-grained partitions belonging to the same partition statute and output to a corresponding partition statute; intermediate result statute partition data protocol processing, to obtain the corresponding data processing result. Application of the present invention, the data load balancing can improve the efficiency of data processing.
Keywords:
- Correction
- Source
- Cite
- Save
- Machine Reading By IdeaReader
0
References
0
Citations
NaN
KQI