ByteDance Seed
首页模型博客&论文Seed Edge加入我们
体验豆包AI 体验中心
首页模型博客&论文Seed Edge加入我们
体验豆包AI 体验中心

2026-05-16

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference

Download PDF
上一篇下一篇

摘要

Deploying large-scale LLM training and inference with optimal performance is exceptionally challenging due to a complex design space of parallelism strategies, system optimizations, and hardware configurations. Accurate and rapid performance simulation is critical for guiding optimization efforts and system studies by validating "what-if" Hooker Figure hypotheses. To address this, we introduce Charon, a unified, modular, and fine-grained simulator for accurately predicting LLM performance. Experiments show Charon achieves high accuracy across different models and configurations, with an overall prediction error consistently under 5.35%, and even under 3.74% for training with a large-scale GPU cluster. In a practical inference deployment case, Charon discovered a configuration that improved system throughput over an engineering-tuned baseline, demonstrating its significant real-world value.

作者

Mengtian Yang, Zhekun Zhang, Mingheng Wu, Jianwen Yan, Hanshi Sun, Li-wen Chang

期刊/会议

MLSys 2026

追求智能上限,创造社会价值
字节跳动 Seed 招聘二维码
欢迎加入字节跳动 Seed
Copyright© 2026 Bytedance Seed
网站声明联系我们 : seed.feedback@bytedance.com
追求智能上限,创造社会价值
字节跳动 Seed 招聘二维码
欢迎加入字节跳动 Seed
联系我们 : seed.feedback@bytedance.com
Copyright© 2026 Bytedance Seed网站声明联系我们 : seed.feedback@bytedance.com