Fuzzy clustering-based skyline query preprocessing algorithm for large-scale flow data analysis

In order to improve the effectiveness of the large-scale stream data skyline query preprocessing algorithm, a large-scale stream data skyline query preprocessing algorithm based on fuzzy clustering analysis (kdStreamSky) is proposed in the paper. Firstly, relevant concept of the large-scale stream data skyline query preprocessing algorithm was described; then, in order to solve the problem—curse of data dimensionality of the large-scale stream data skyline query preprocessing algorithm, the corresponding data subset was constructed and meanwhile MapReduce calculation model was combined to realize the mean value clustering center selection for the parallel mobile social network; meanwhile, in order to improve algorithm stability and facilitate the design of information forwarding scheme, a distributed hierarchical clustering method was adopted for the clustering analysis of individuals and the design of hierarchical forwarding scheme; and finally, the corresponding simulation experiment was implemented to verify algorithm effectiveness.