SLSM - A Scalable Log Structured Merge Tree with Bloom Filters for Low Latency Analytics

Abstract In the era of Bigdata, millions of searches, queries etc. happens in a second. There is a need for next generation databases which can store and process bigdata more effectively. NoSQL databases are created to solve the problems of scalability issues related with traditional databases. Year by year the bigdata is getting new dimensions. HBase is a NoSQL database suitable for random, real-time read/write access to Big Data. LSM tree used in HBase helps to achieve this high performance. Commodity hardware have moderate RAM size. SLSM, an optimized Log Structured Merge Tree which dramatically reduces the read amplification and write amplification is proposed in this paper for commodity hardware. Incorporation of variant of bloom filters increases the read performance.