Zitao Song 宋子韬

Ph.D. Student in Machine Learning, Optimization, and Efficient AI

Department of Computer Science, Purdue University
West Lafayette, IN

Portrait of Zitao Song

Clarke Quay, Singapore

About Me

I am a second-year Ph.D. student in Computer Science at Purdue University, where I am fortunate to be advised by Prof. David F. Gleich and supported by the Lynn Fellowship. I develop scalable and theoretically grounded optimization methods for large models and scientific discovery — I care as much about making training efficient in practice as about the mathematical structure that explains why it works.

Before Purdue, I was a Research Associate in the Agent Mediated Intelligence group at Nanyang Technological University, working with Prof. Bo An. I received my M.S. in Data Science from CUHK-Shenzhen, advised by Prof. Shuang Li, and my B.S. in Applied Mathematics from XJTLU, advised by Prof. Jia Meng and Prof. Jionglong Su.

  • Optimization theory: matrix, nonsmooth & adaptive methods
  • Stochastic Optimization
  • Efficient LLM training & inference
  • Reinforcement learning & GFlowNets

News

  • 2026-06 Presented our DeVA poster at the Midwest Machine Learning Symposium (MMLS 2026)!
  • 2026-05 New preprint: Can entry-wise clipping give spectral control of stochastic gradients?
  • 2026-05 Our paper on decoupling variance and scale-invariant updates (DeVA) was accepted to ICML 2026!
  • 2025-08 Serving as a TA for CS 515 Numerical Linear Algebra at Purdue (Fall 2025).
  • 2024-08 Joined Purdue CS as a Ph.D. student, supported by the Lynn Fellowship. Grateful to be working with Prof. David F. Gleich!

Selected Publications

See the full list on Google Scholar.

Can Entry-Wise Clipping Give Spectral Control of Stochastic Gradients?

Zitao Song, C. S. Bai, Z. Zhang, Brian Bullins, David F. Gleich

arXiv preprint 2026 [paper]

Latent Logic Tree Extraction for Event Sequence Explanation from LLMs

Zitao Song, Chao Yang, Chaojie Wang, Bo An, Shuang Li

ICML 2024 [paper]

Attention-Based Multi-Label Neural Networks for Integrated Prediction and Interpretation of Twelve Widely Occurring RNA Modifications

Zitao Song, Daiyun Huang, Bowen Song, Kunqi Chen, Yiyou Song, Gang Liu, Jionglong Su, João Pedro de Magalhães, Daniel J. Rigden, Jia Meng

Nature Communications 2021 [paper]

Optimization Playground

My research, as a toy: optimizers race down a loss surface — including Muon and DeVA, from our ICML 2026 paper. Click anywhere on the surface to drop them there. On the low-rank factorization surface the axes are the singular values of a real matrix iterate — try rotate basis 45°: the spectral methods (Muon, DeVA) don't notice, entrywise Adam does.

Service & Teaching

  • Reviewing: ICML (2026), TMLR (2026), ICLR (2024–2026), NeurIPS (2025)
  • Teaching: TA for CS 515 Numerical Linear Algebra, Purdue University (Fall 2025)
  • Talks: Poster presentation, Midwest Machine Learning Symposium (2026)