Data processing method and system thereof

2009 
The invention discloses a data processing method and a data processing system. The method of the invention comprises the following steps: concurrently executing a plurality of Map tasks, wherein each Map task acquires data of the corresponding part in the data to be processed and processes the acquired data to obtain the local processing results of the data to be processed; and executing the Reduce task, wherein the Reduce task obtains the global processing result of the data to be processed according to all the local processing results. The invention can improve the data preprocessing efficiency in the data mining process.
    • Correction
    • Source
    • Cite
    • Save
    • Machine Reading By IdeaReader
    0
    References
    0
    Citations
    NaN
    KQI
    []