Migration balancing policy based electricity-consuming information distributed file storage method and apparatus

2015 
The present invention discloses a migration balancing policy based electricity-consuming information distributed file storage method and apparatus. The method comprises: a data acquisition module analyzing original data frames to obtain original data, storing the original data into a local disk module in the form of a file, and uploading the original data frames to a relational database and a MongoDB database; detecting information of the file in the local disk module, and selecting whether to upload the file to a data storage module; the MongoDB database acquiring a node load where a slice is located in mongos by means of routing and by using a migration balancing policy to implement balancing from two aspects: a data volume and a load; a big data management engine regularly monitoring file information that is not subjected to data saving calculation, extracting the file from the MongoDB database, and using time as a tag; converting file data extracted from the MongoDB database into data character string streams, and carrying out calculation to obtain service data; and finally, performing data persistence. Therefore, efficient storage of electricity-consuming information big data is implemented, and electricity-consuming big data storage capacity and storage rate demands of an electricity-consuming acquisition system are met.
    • Correction
    • Source
    • Cite
    • Save
    • Machine Reading By IdeaReader
    0
    References
    0
    Citations
    NaN
    KQI
    []