TDRAM: Tag-enhanced DRAM for Efficient Caching

Local Download arXiv Link

As SRAM-based caches are hitting a scaling wall, manufacturers are integrating DRAM-based caches into system designs to continue increasing cache sizes. While DRAM caches can improve the performance of memory systems, existing DRAM cache designs suffer from high miss penalties, wasted data movement, and interference between misses and demand requests. In this paper, we propose TDRAM, a novel DRAM microarchitecture tailored for caching. TDRAM enhances HBM3 by adding a set of small low-latency mats to store tags and metadata on the same die as the data mats. These mats enable fast parallel tag and data access, on-DRAM-die tag comparison, and conditional data response based on comparison result (reducing wasted data transfers) akin to SRAM caches mechanism. TDRAM further optimizes the hit and miss latencies by performing opportunistic early tag probing. Moreover, TDRAM introduces a flush buffer to store conflicting dirty data on write misses, eliminating turnaround delays on data bus. We evaluate TDRAM using a full-system simulator and a set of HPC workloads with large memory footprints showing TDRAM provides at least 2.6× faster tag check, 1.2× speedup, and 21% less energy consumption, compared to the state-of-the-art commercial and research designs.

Citation

Maryam Babaie, Ayaz Akram, Wendy Elsasser, Brent Haukness, Michael Miller, Taeksang Song, Thomas Vogelsang, Steven Woo, and Jason Lowe-Power, “TDRAM: Tag-enhanced DRAM for Efficient Caching,” arXiv preprint arXiv:2404.14617, 2024. doi: 10.48550/arXiv.2404.14617.

@article{babaie2024tdram,
  author       = {Maryam Babaie and Ayaz Akram and Wendy Elsasser and Brent Haukness and Michael Miller and Taeksang Song and Thomas Vogelsang and Steven Woo and Jason Lowe-Power},
  title        = {TDRAM: Tag-enhanced DRAM for Efficient Caching},
  year         = {2024},
  url          = {https://doi.org/10.48550/arXiv.2404.14617},
  doi          = {10.48550/arXiv.2404.14617},
  eprint={2404.14617},
  archivePrefix={arXiv},
  primaryClass={cs.AR}
}