HBF Is For AI Model Weights, HBM Is For KV Cache

Buckle up as the ongoing memory- and HBM-related bottleneck is about to get materially decongested, thanks to SanDisk's initiative to develop High-Bandwidth Flash (HBF) in concert with SK hynix, which should eventually lead to a bifurcation in tasks that are currently performed solely by the HBM. HB