Research on Key Issues of Big Data Lifecycle and Its Applications

With the big data era arriving, the research on big data lifecycle followed one by one and become research hotspots, such as in obtaining, storage, processing and mining. This paper applied electrical, financial, economical data domestic and overseas as research objects to solve storage, processing and mining problems of big data. In this paper, the categories of big data were analyzed on the basis of its features. The big data compressed storage model, which based on improved sparse matrix, index dimensions and separated index data, was established firstly to implement compressed storage and dynamical extension. Then the caching model method in accordance with index categories was proposed, which brings high-efficiency access and flexible conversion. The dynamical configuration was put into use in mining display to resolve dynamical generated problem of mass pages. The research is expected to provide reference in big data, and is apply in the development of unified resources database.