Investigate trends in memory bandwidth, latency and price of memory

Memory is a big challenge for modern deep learning, required for storing things like parameter values and intermediate gradient computations (Weng, 2021). How have memory bandwidth, latency, and the price of memory changed over time?