Tail Latency Optimization for LDPC based High-Density and Low-Cost Flash Memory Devices

Flash memory has been developed with bit density improvement, technology scaling, and 3D stacking. With this trend, its reliability has been significantly degraded. Error correction code (ECC), such as low-density parity-code (LDPC), which has strong error correction capability, has been deployed to solve this problem. However, one of the critical issues of LDPC is that it would introduce a long decoding latency on devices with low reliability. In this case, tail latency would happen, which will significantly impact the quality of service (QoS). In this work, a set of smart refresh schemes is proposed to optimize the tail latency. The basic idea of the work is to refresh data when the accessed data has a long decoding latency. Two smart refresh schemes are proposed for this work: The first refresh scheme is designed to refresh data with a long access latency when they are accessed several times; The second refresh scheme is designed to periodically check data with an extremely long access latency and refresh them. To further optimize the refresh overhead caused by the above refresh schemes, a dual-ECC based refresh scheme is proposed. Besides, a mathematical model for all proposed schemes is constructed to clarify the benefit of each scheme. Experimental results show that the proposed schemes can significantly improve the tail latency with acceptable overhead. What’s more, the access performance is well maintained compared with the state-of-the-art work.