Migration balancing policy based electricity-consuming information distributed file storage method and apparatus
2015
The present invention discloses a migration balancing policy based electricity-consuming information distributed file storage method and apparatus. The method comprises: a data acquisition module analyzing original data frames to obtain original data, storing the original data into a local disk module in the form of a file, and uploading the original data frames to a relational database and a MongoDB database; detecting information of the file in the local disk module, and selecting whether to upload the file to a data storage module; the MongoDB database acquiring a node load where a slice is located in mongos by means of routing and by using a migration balancing policy to implement balancing from two aspects: a data volume and a load; a big data management engine regularly monitoring file information that is not subjected to data saving calculation, extracting the file from the MongoDB database, and using time as a tag; converting file data extracted from the MongoDB database into data character string streams, and carrying out calculation to obtain service data; and finally, performing data persistence. Therefore, efficient storage of electricity-consuming information big data is implemented, and electricity-consuming big data storage capacity and storage rate demands of an electricity-consuming acquisition system are met.
Keywords:
- Correction
- Source
- Cite
- Save
- Machine Reading By IdeaReader
0
References
0
Citations
NaN
KQI