KVSwap: Disk-aware KV Cache Offloading for Long-Context On-device Inference

Type
Conference paper
Publication
The 24th Annual International Conference on Mobile Systems, Applications and Services (MobiSys)(Artifacts Evaluated!)
Date
Links
Preprint Code Dataset