Design and implementation strategy of data migration system based on Hadoop platform

This paper analyzes the Hadoop technical system related content, and combines the design points of the data migration system, including interface migration design, data synchronization design, data transmission process design, data consistency verification design, data storage scheme design. Through the research of data cleaning function, data conversion function, data loading function, data return function, unstructured data migration and other implementation strategies, the purpose is to improve the application value of data migration system, improve the application value of the collected data.