1

A Comparative Study on LLM-enabled HPC User Support
Providing accurate and efficient user support with the emerging large language model (LLM) techniques for high-performance computing …
Mingkai Zheng, Fangru Linghu, Sikan Li, Marty Charles Kandes, Niall Gaffney, Ian Foster, Zhao Zhang
Cite DOI
Efficient Fine-Grained GPU Performance Modeling for Distributed Deep Learning of LLM
Training Large Language Models (LLMs) is one of the most compute-intensive tasks in high-performance computing. Predicting end-to-end …
Biyao Zhang, Mingkai Zheng, Debargha Ganguly, Xuecen Zhang, Vikash Singh, Vipin Chaudhary, Zhao Zhang
PDF Cite DOI arXiv
Radius: Range-based Gradient Sparsity for Large Foundation Model Pre-training
We present Radius, a gradient sparsity algorithm and system to accelerate large foundation model (FM) training while preserving …
Mingkai Zheng, Zhao Zhang
PDF Cite Proceedings OpenReview
COMPSO: Optimizing Gradient Compression for Distributed Training with Second-Order Optimizers
Second-order optimization methods have been developed to enhance convergence and generalization in deep neural network (DNN) training …
Baixi Sun, Weijin Liu, J. Gregory Pauloski, Jiannan Tian, Jinda Jia, Daoce Wang, Boyuan Zhang, Mingkai Zheng, Sheng Di, Sian Jin, Zhao Zhang, Xiaodong Yu, Kamil A. Iskra, Pete Beckman, Guangming Tan, Dingwen Tao
Cite DOI
Dynamic Response Improvement for DAB Converter with Constant Power Load under Extended-Phase-Shift Control Based on Trajectory Control
Microgrid has been regarded by many researchers as the fundamental building block for the next generation power grid, where DC-DC …
Mingkai Zheng, Huiqing Wen, Qinglei Bu, Haochen Shi
PDF Cite DOI
Constant Power Load stabilization Based on Trajectory Control in Dual-Active-Bridge DC-DC Converter
This paper analysed the trajectory control (TC) based on natural switching surface (NSS) in dual-active-bridge (DAB) DC-DC converter. …
Qinglei Bu, Huiqing Wen, Haochen Shi, Mingkai Zheng
PDF Cite DOI