Publications

Junlin Chen, Daize Dong, Huanwei Di, Haolong Jia, Jiawei Wu, Haotian Xie, Mingkai Zheng, Yang Li, Leshang Chen, Huishu Wang, Eric P. Xing, Hongyi Wang (2026). Broken Symmetry in BF16 Attention: Why FlashAttention Gradients Blow Up Late in Training. arXiv.

Haotian Xie, Junlin Chen, Mingkai Zheng, Yifan Zhu, Minu Mathew, Max Burnette, Yadu Babuji, Volodymyr Kindratenko, Shivaram Venkataraman, Kyle Chard, Ian Foster, Zhao Zhang (2026). Diamond Agent: Agentic Control of Federated HPC Resources as a Service. arXiv.

Mingkai Zheng, Fangru Linghu, Sikan Li, Marty Charles Kandes, Niall Gaffney, Ian Foster, Zhao Zhang (2026). A Comparative Study on LLM-enabled HPC User Support. in PEARC 2026.

Mingkai Zheng, Junlin Chen, Haotian Xie, Zhao Zhang (2026). SCAPE: Accurate and Efficient LLM Training with Extreme Sparse Communication. arXiv.

Haotian Xie, Junlin Chen, Mingkai Zheng, Lishan Yang, Zhao Zhang (2026). PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint. arXiv.

Michael Mogilevsky, Hazem Zaky, Yu Sun, Mingkai Zheng, Lishan Yang, Zhao Zhang (2026). Quantifying Performance Variability in GPU Clusters. in IEEE TPDS.

Biyao Zhang, Mingkai Zheng, Debargha Ganguly, Xuecen Zhang, Vikash Singh, Vipin Chaudhary, Zhao Zhang (2025). Efficient Fine-Grained GPU Performance Modeling for Distributed Deep Learning of LLM. in HiPC 2025.

PDF Cite DOI arXiv

Mingkai Zheng, Zhao Zhang (2025). Radius: Range-based Gradient Sparsity for Large Foundation Model Pre-training. in MLSys 2025.

PDF Cite Proceedings OpenReview

Baixi Sun, Weijin Liu, J. Gregory Pauloski, Jiannan Tian, Jinda Jia, Daoce Wang, Boyuan Zhang, Mingkai Zheng, Sheng Di, Sian Jin, Zhao Zhang, Xiaodong Yu, Kamil A. Iskra, Pete Beckman, Guangming Tan, Dingwen Tao (2025). COMPSO: Optimizing Gradient Compression for Distributed Training with Second-Order Optimizers. in PPoPP 2025.

Mingkai Zheng, Huiqing Wen, Qinglei Bu, Haochen Shi (2020). Dynamic Response Improvement for DAB Converter with Constant Power Load under Extended-Phase-Shift Control Based on Trajectory Control. in IPEMC2020-ECCE Asia.

Qinglei Bu, Huiqing Wen, Haochen Shi, Mingkai Zheng (2020). Constant Power Load stabilization Based on Trajectory Control in Dual-Active-Bridge DC-DC Converter. in IPEMC2020-ECCE Asia.

Mingkai Zheng, Huiqing Wen, Haochen Shi, Yihua Hu, Yong Yang, Yiwang Wang (2019). Open-Circuit Fault Diagnosis of Dual Active Bridge DC-DC Converter With Extended-Phase-Shift Control. In IEEE ACCESS.