Yongchao He

Yongchao He

Cats. Code. Chaos.

Senior Staff Engineer at Alibaba

Interests

AI SystemNetwork SystemsFishingCat TamingCooking

About

Welcome to Yongchao He's homepage!

I’m a researcher and engineer working on LLM systems and AI infrastructure. I build systems that keep large models alive — and sometimes make them faster, from distributed training to LLM inference and all the little optimizations that help big things scale.

My work sits at the intersection of distributed systems, runtime design, and large-scale LLM training and inference, with a focus on system-level abstractions, performance trade-offs, and system–model co-design.

I earned my Ph.D. from the Institute for Interdisciplinary Information Sciences (IIIS, 交叉信息研究院) at Tsinghua University, where I was advised by Wei Xu and Wenfei Wu.

Occasional cat wrangler, full-time system tinkerer. Just another small node in the AI era.

Awards

CTO List (Inaugural Member)

2024UbiQuant — Company-wide High-Potential Technical Leadership Program

Distinguished Paper Award

202328th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'23)

News

2026-07

🎉🎉 NDB is accepted in NSDI 2027!

2026-07

🎉🎉 LMTracer is accepted in SOSP 2026!

2026-05

🎉🎉 UniSparse is accepted in ICML 2026!

2026-04

🎉🎉 Two papers are accepted in ACL 2026!

2026-03

🎉🎉 Umap is accepted in OSDI 2026!