DGFIndex: a hive multidimensional range index for smart meter big data

2013 
In Smart Grid, High-performance analysis of massive meter data is very crucial for electric companies to make decisions. With our observation, these data analysis applications typically involve multidimensional range queries (MDRQ) on meter data. While popular data warehouses for big data, like Hive, can perform complex analysis, but lack efficient index for MDRQ. In this paper, we propose DGFIndex, a dedicated index structure that effectively support MDRQ for massive meter data. Our preliminary experiments show that DGFIndex can save significant disk space than Compact Index in Hive, and almost keeps the same data IO.
    • Correction
    • Source
    • Cite
    • Save
    • Machine Reading By IdeaReader
    4
    References
    2
    Citations
    NaN
    KQI
    []