Method and system for performing crash protection on jobTracker hosts

2011 
An embodiment of the invention discloses a method and a system for performing crash protection on jobTracker hosts. The method comprises the following steps that each jobTracker host in a jobTracker host queue circularly receives tasks which are submitted by a user task submitting interface machine, wherein the tasks comprise a map task and a reduce task; a taskTracker submits task status information during task execution procedures to the corresponding jobTracker host according to the membership relationship between each jobTracker and the tasks; and every two jobTracker hosts in the jobTracker host queue backup the managed tasks and synchronize the task status information. By implementing the invention, oversized task scheduling pressure of single jobTracker host can be avoided, and single point failure of the jobTracker hosts is prevented from significantly impacting the whole system.
    • Correction
    • Source
    • Cite
    • Save
    • Machine Reading By IdeaReader
    0
    References
    0
    Citations
    NaN
    KQI
    []