ML Anthology

Yi, Tu

1 publications

ICLR 2025 HShare: Fast LLM Decoding by Hierarchical Key-Value Sharing Huaijin Wu, Lianqiang Li, Hantao Huang, Tu Yi, Jihang Zhang, Minghui Yu, Junchi Yan