Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management

Qianli Liu, Zicong Hong, Peng Li, Fahao Chen, Song Guo
May 2025
Type
Conference paper
Publication
IEEE International Conference on Computer Communications (INFOCOM) (CCF-A)