Study on the country risk rating with distributed crawling system

This paper built a system containing the Distributed Crawling Module, the Database Module and the Analysis Module to collect a large number of objective data, clean the data and realize the business intelligence representation. The distributed crawling system includes the Distributed Crawling Module building from Hadoop, the Database Module by SQL Server and the Analysis Module by the SAS system. The first two modules support a distributed way to collect and convert non-structural data into structural data for the last module processing. Then, this paper extends research fields from theory to application about BR the credit rating of Latvia, Estonia, Slovakia, Turkey, Malaysia, Russia, Thailand and other countries is very high; Afghanistan, Ukraine, Laos, Iran, Arabia, Republic of Syria, Iraq, Burma, Republic of Yemen, East Timor and other countries with poor credit ratings. The conclusion is consistent with the domestic and overseas well-known rating agencies.