ML Anthology

Strati, Foteini

1 publications

ICML 2024 DéjàVu: KV-Cache Streaming for Fast, Fault-Tolerant Generative LLM Serving Foteini Strati, Sara Mcallister, Amar Phanishayee, Jakub Tarnawski, Ana Klimovic