Xinyi Liu

Hi!😄 I’m Xinyi Liu, a second year PH.D. student of School of Computer Science in Peking University and a member of DAIR lab, led by professor Bin Cui. I received my B.Sc. degree from School of Computer Science and Technology, Harbin Institute of Technology, Weihai in June 2023. I am the main developer of Hetu-Galvatron, an open-source automatic distributed system for efficient transformer training. Currently, My research interest lies in deep learning systems, especially in automatic parallelism and MoE training and inference acceleration.

Education

B.S. in Cyberspace Security, Harbin Institute of Technology, Weihai. 2019-2023.
PH.D. in Institute of Date Science and Engineering, Peking University. 2023 - 2028(expected)
Adviser: Bin Cui

[arXiv] Xinyi Liu, Yujie Wang, Shenhan Zhu, Fangcheng Fu, Qingshuo Liu, Guangming Lin, Bin Cui. “Galvatron: An Automatic Distributed System for Efficient Foundation Model Training.”
[ICLR Spotlight] Xinyi Liu, Yujie Wang, Fangcheng Fu, Xupeng Miao, Shenhan Zhu, Xiaonan Nie, Bin Cui. “NetMoE: Accelerating MoE Training through Dynamic Sample Placement.”
[ASPLOS] Yujie Wang, Shiju Wang, Shenhan Zhu, Fangcheng Fu, Xinyi Liu, Xuefeng Xiao, Huixia Li, Jiashi Li, Faming Wu, Bin Cui. “FlexSP: Accelerating Large Language Model Training via Flexible Sequence Parallelism.”

Kunpeng Ascend Outstanding Young Contributor in Scientific Research and Innovation (2025)
National Scholarship (2022)
Candidate for the 13th China Youth Science and Technology Innovation Award (2022)
7th place(0.2%), The 26th CCF Certified Software Professional (2022)
Runner Up, Gold Medal, The 12th Shandong Provincial ICPC Collegiate Programming Contest (2022)
Outstanding Students of Higher Education Institutions (2021)
Gold Medal, 2021 China Collegiate Programming Contest, Harbin Site (2021)
Silver Medal, The 46th ICPC Asia Regional Contest Jinan Site (2021)

Galvatron: An Automatic Distributed System for Efficient Large-Scale Transformer Training. PyTorch Day China, Beijing, China, June, 2025

Galvatron: An Automatic Distributed System for Efficient Large-Scale Transformer Training. Kunpeng Ascend Developer Conference (KADC), Beijing, China, May, 2025