Zitao Song 宋子韬
Ph.D. Student in Machine Learning, Optimization, and Efficient AI
Department of Computer Science, Purdue University
West Lafayette, IN

Clarke Quay, Singapore
About Me
I am a second-year Ph.D. student in Computer Science at Purdue University, where I am fortunate to be advised by Prof. David F. Gleich and supported by the Lynn Fellowship. I develop scalable and theoretically grounded optimization methods for large models and scientific discovery — I care as much about making training efficient in practice as about the mathematical structure that explains why it works.
Before Purdue, I was a Research Associate in the Agent Mediated Intelligence group at Nanyang Technological University, working with Prof. Bo An. I received my M.S. in Data Science from CUHK-Shenzhen, advised by Prof. Shuang Li, and my B.S. in Applied Mathematics from XJTLU, advised by Prof. Jia Meng and Prof. Jionglong Su.
- Optimization theory: matrix, nonsmooth & adaptive methods
- Stochastic Optimization
- Efficient LLM training & inference
- Reinforcement learning & GFlowNets
News
- 2026-06 Presented our DeVA poster at the Midwest Machine Learning Symposium (MMLS 2026)!
- 2026-05 New preprint: Can entry-wise clipping give spectral control of stochastic gradients?
- 2026-05 Our paper on decoupling variance and scale-invariant updates (DeVA) was accepted to ICML 2026!
- 2025-08 Serving as a TA for CS 515 Numerical Linear Algebra at Purdue (Fall 2025).
- 2024-08 Joined Purdue CS as a Ph.D. student, supported by the Lynn Fellowship. Grateful to be working with Prof. David F. Gleich!
Selected Publications
See the full list on Google Scholar.
Optimization Playground
My research, as a toy: optimizers race down a loss surface — including Muon and DeVA, from our ICML 2026 paper. Click anywhere on the surface to drop them there. On the low-rank factorization surface the axes are the singular values of a real matrix iterate — try rotate basis 45°: the spectral methods (Muon, DeVA) don't notice, entrywise Adam does.
Service & Teaching
- Reviewing: ICML (2026), TMLR (2026), ICLR (2024–2026), NeurIPS (2025)
- Teaching: TA for CS 515 Numerical Linear Algebra, Purdue University (Fall 2025)
- Talks: Poster presentation, Midwest Machine Learning Symposium (2026)