Based on the data mapping and protocols balance processing method, apparatus and system for

2010 
The present invention discloses a data mapping and protocols based on the processing method, apparatus and system balance. Comprising: acquiring data submitted by the client, the data acquired initial partition according Mapper is set in advance, respectively; data initial partition mapping processing, obtaining an intermediate result data; call partitioner function, the intermediate result data in accordance with fine-grained partitions set in advance the number of fine-grained partitioning, fine-grained partition number is greater than the preset number of partitions statute; outputs intermediate results of fine-grained partitions data amount information to the operating server, the server receives the returned work of fine-grained intermediate result data correspondence relationship between the partition and the partition statute, combined fine-grained partitions belonging to the same partition statute and output to a corresponding partition statute; intermediate result statute partition data protocol processing, to obtain the corresponding data processing result. Application of the present invention, the data load balancing can improve the efficiency of data processing.
    • Correction
    • Source
    • Cite
    • Save
    • Machine Reading By IdeaReader
    0
    References
    0
    Citations
    NaN
    KQI
    []