Publications | Mingkai Zheng's Homepagehttps://zhengmk.github.io/publication/PublicationsWowchemy (https://wowchemy.com)en-usMon, 28 Sep 2026 00:00:00 +0000https://zhengmk.github.io/media/icon_hu0158c3d4eaa2a6b730ca31a67c18838d_142122_512x512_fill_lanczos_center_2.pngPublicationshttps://zhengmk.github.io/publication/Broken Symmetry in BF16 Attention: Why FlashAttention Gradients Blow Up Late in Traininghttps://zhengmk.github.io/publication/broken-symmetry-in-bf16-attention-why-flashattention-gradients-blow-up-late-in-training/Mon, 28 Sep 2026 00:00:00 +0000https://zhengmk.github.io/publication/broken-symmetry-in-bf16-attention-why-flashattention-gradients-blow-up-late-in-training/Diamond Agent: Agentic Control of Federated HPC Resources as a Servicehttps://zhengmk.github.io/publication/diamond-agent-agentic-control-of-federated-hpc-resources-as-a-service/Sat, 05 Sep 2026 00:00:00 +0000https://zhengmk.github.io/publication/diamond-agent-agentic-control-of-federated-hpc-resources-as-a-service/A Comparative Study on LLM-enabled HPC User Supporthttps://zhengmk.github.io/publication/a-comparative-study-on-llm-enabled-hpc-user-support/Sun, 26 Jul 2026 00:00:00 +0000https://zhengmk.github.io/publication/a-comparative-study-on-llm-enabled-hpc-user-support/PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpointhttps://zhengmk.github.io/publication/phoenix-resilient-llm-training-with-hot-swapping-via-zero-overhead-checkpoint/Thu, 02 Jul 2026 00:00:00 +0000https://zhengmk.github.io/publication/phoenix-resilient-llm-training-with-hot-swapping-via-zero-overhead-checkpoint/SCAPE: Accurate and Efficient LLM Training with Extreme Sparse Communicationhttps://zhengmk.github.io/publication/scape-accurate-and-efficient-llm-training-with-extreme-sparse-communication/Thu, 02 Jul 2026 00:00:00 +0000https://zhengmk.github.io/publication/scape-accurate-and-efficient-llm-training-with-extreme-sparse-communication/Quantifying Performance Variability in GPU Clustershttps://zhengmk.github.io/publication/quantifying-performance-variability-in-gpu-clusters/Mon, 01 Jun 2026 00:00:00 +0000https://zhengmk.github.io/publication/quantifying-performance-variability-in-gpu-clusters/Efficient Fine-Grained GPU Performance Modeling for Distributed Deep Learning of LLMhttps://zhengmk.github.io/publication/efficient-fine-grained-gpu-performance-modeling-for-distributed-deep-learning-of-llm/Wed, 17 Dec 2025 00:00:00 +0000https://zhengmk.github.io/publication/efficient-fine-grained-gpu-performance-modeling-for-distributed-deep-learning-of-llm/Radius: Range-based Gradient Sparsity for Large Foundation Model Pre-traininghttps://zhengmk.github.io/publication/radius-range-based-gradient-sparsity-for-large-foundation-model-pre-training/Mon, 12 May 2025 00:00:00 +0000https://zhengmk.github.io/publication/radius-range-based-gradient-sparsity-for-large-foundation-model-pre-training/COMPSO: Optimizing Gradient Compression for Distributed Training with Second-Order Optimizershttps://zhengmk.github.io/publication/compso-optimizing-gradient-compression-for-distributed-training-with-second-order-optimizers/Fri, 28 Feb 2025 00:00:00 +0000https://zhengmk.github.io/publication/compso-optimizing-gradient-compression-for-distributed-training-with-second-order-optimizers/Dynamic Response Improvement for DAB Converter with Constant Power Load under Extended-Phase-Shift Control Based on Trajectory Controlhttps://zhengmk.github.io/publication/dynamic-response-improvement-for-dab-converter-with-constant-power-load-under-extended-phase-shift-control-based-on-trajectory-control/Sun, 29 Nov 2020 10:26:26 +0000https://zhengmk.github.io/publication/dynamic-response-improvement-for-dab-converter-with-constant-power-load-under-extended-phase-shift-control-based-on-trajectory-control/Constant Power Load stabilization Based on Trajectory Control in Dual-Active-Bridge DC-DC Converterhttps://zhengmk.github.io/publication/constant-power-load-stabilization-based-on-trajectory-control-in-dual-active-bridge-dc-dc-converter/Sun, 29 Nov 2020 10:06:01 +0000https://zhengmk.github.io/publication/constant-power-load-stabilization-based-on-trajectory-control-in-dual-active-bridge-dc-dc-converter/Open-Circuit Fault Diagnosis of Dual Active Bridge DC-DC Converter With Extended-Phase-Shift Controlhttps://zhengmk.github.io/publication/open-circuit-fault-diagnosis-of-dual-active-bridge-dc-dc-converter-with-extended-phase-shift-control/Wed, 13 Feb 2019 00:00:00 +0000https://zhengmk.github.io/publication/open-circuit-fault-diagnosis-of-dual-active-bridge-dc-dc-converter-with-extended-phase-shift-control/