About

I am a Ph.d student advised by Prof. Qiang Liu from UT Austin.

Meanwhile, I was a senior tech lead at SambaNova Systems working on software and hardware codesign. Recently, I started to work on 3D generative AI as a research scientist.

Before that, I obtained my B.S. in CS from UIUC advised by Prof. Bo Li.

I am also actively contributing to opensourced frameworks, such as Gradio and Transformers.

Interests

Efficient training and efficient neural architecture, for more details please refer to my research statement

Opensource Contribution: 🤗Huggingface timm adopts Cautious Optimizers

Selected Publications

Cautious Optimizers: Improving Training with One Line of Code

Kaizhao Liang, Lizhang Chen, Bo Liu, Qiang Liu

Memory-Efficient LLM Training with Online Subspace Descent [NeurIPS 2024]

Kaizhao Liang, Bo Liu, Lizhang Chen, Qiang Liu

Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models [ICLR 2022]

Beidi Chen, Tri Dao, Kaizhao Liang, Jiaming Yang, Zhao Song, Atri Rudra, Christopher Re

Uncovering the Connections Between Adversarial Transferability and Knowledge Transferability [ICML 2020]

Kaizhao Liang*, Jacky. Y. Zhang*, Boxin Wang, Zhuolin Yang, Sanmi Koyejo, Bo Li

Past Media Coverage

SambaNova and Hugging Face make AI chatbot deployment easier with one-click integration – VentureBeat

Coverage on advances in accessible AI deployment involving Hugging Face.

SambaNova challenges OpenAI’s O1 model with LLaMA 3.1-powered demo on Hugging Face – VentureBeat

Highlights collaboration and emerging competition in the generative AI space.

Review Service

CVPR[2021-2023], ICCV[2021, 2025], ICLR[2022-2024], AISTATS2022, NEURIPS[2023-2025]

Contact

kaizhaol@utexas.edu