Hall, David Leo Wright

5 publications

ICLR 2025 Neural ODE Transformers: Analyzing Internal Dynamics and Adaptive Fine-Tuning Anh Tong, Thanh Nguyen-Tang, Dongeun Lee, Duc Nguyen, Toan Tran, David Leo Wright Hall, Cheongwoong Kang, Jaesik Choi

ICLR 2025 Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape View Kaiyue Wen, Zhiyuan Li, Jason S. Wang, David Leo Wright Hall, Percy Liang, Tengyu Ma

TMLR 2024 Anticipatory Music Transformer John Thickstun, David Leo Wright Hall, Chris Donahue, Percy Liang

ICLR 2024 Sophia: A Scalable Stochastic Second-Order Optimizer for Language Model Pre-Training Hong Liu, Zhiyuan Li, David Leo Wright Hall, Percy Liang, Tengyu Ma

ICMLW 2023 Sophia: A Scalable Stochastic Second-Order Optimizer for Language Model Pre-Training Hong Liu, Zhiyuan Li, David Leo Wright Hall, Percy Liang, Tengyu Ma