The impact of web data processing on computer property: A study based on Hadoop

With the rapid development of information technology, the demand of computer system's ability in computing and processing Big Data is increasing day by day. Currently, data generated by applications in all walks of life are growing explosively. How to deal with this data efficiently has been a new development direction of analysis and application in Big Data. Previous work is usually conducted in a single PC. Hadoop is a distributed software framework in processing Big Data, and it has the advantage of cheapness, high reliability, high efficiency, high fault tolerance. In this paper, we take parsing Web page for an example, studying on the change of computer property when program running in a single PC and in a Hadoop cluster respectively, to prove that Hadoop has the superiority in handling parsing Web page compared with previous work.