HeadlinesBriefing favicon HeadlinesBriefing.com

DeepSeek 弹性计算(DSec):生产规模智能体训练平台

Hacker News •
×

DeepSeek 弹性计算(DSec)是一个生产沙箱平台,旨在支持大规模智能体训练和评估,使用大型语言模型(LLMs)。该系统通过统一的 SDK 暴露 Fn Call、容器、微 VM 和完整 VM 沙箱后端,实现跨集群的弹性执行。DSec 负责调度和生命周期管理,通过版本化层组合环境,并利用 Fire-Flyer 文件系统(3FS)实现按需镜像加载。

与强化学习(RL)框架共同设计,DSec 将有状态的 rollout 执行与抢占式 GPU 训练解耦,同时保留 rollout 状态并回收闲置资源。它通过协调沙箱生命周期管理来缓解智能体不良行为,如奖励黑客攻击。一个生产规模单元大约覆盖 160 个节点,每天服务约 300 万个沙箱。

在生产环境中,DSec 支持超过 380,000 个并发沙箱,并维持每秒 5,000 个沙箱创建。评估表明,这些机制减少了环境设置和镜像分发开销,提高了内存效率,并在高密度超额承诺下保持了延迟敏感的性能。

关键实体:人员:Jialiang Huang, Hongxuan Tang, Jingchang Chen, Yuxuan Liu, Yixiao Chen, Yuan Cheng, Yi Tao, Jingli Zhou, Yupeng Chen, Haoyu Chen, Jiarui Wang, Shengkai Lin, Chuqi Zhang, Bryan Lee Teng, Lian Guo, Zhe Fu, Wenjun Gao, Yisong Wang, Liang Zhao, Zehao Wang, Ziwei Xie, Yongqiang Guo, Peixin Cong, Ziyi Gao, Shuiping Yu, Hanwei Xu, Zuofan Wu, Zhizhou Ren, Yuyang Zhou, Bowei Zhang, Zhihuan Huang, Qihao Zhu, Lei Wang, Tianle Lin, Han Yu, Jiewen Hu, Dejian Yang, Shuo Yang, Shanghao Lu, Shaoyuan Chen, Junjie Qiu, Zhangli Sha, Yinmin Zhong, Yongtong Wu, Shiyu Wang, Wei Liu, Bingzheng Xu, Longhao Chen, Qiushi Du, Yuzhen Huang, Shirong Ma, Yaohui Wang, Mingshu Chen, Tongrui Xiong, Y.C. Yan, Haowen Luo, Haofen Liang, Xiaokang Zhang, Weihao Zeng, Runxin Xu, Peiyi Wang, Jinhua Zhu, Ruoyu Zhang, Wenkai Yang, Qi Tang, Jiping Yu, Tian Ye, Ruizhe Pan, Honghui Ding, Xiaodong Liu, Lingxiao Luo, Zhihong Shao, Yuhan Wu, Jibai Lu, Wen Liu, Haoling Zhang, Jingcheng Hu, Yaoyang Ye, Chaofan Lin, Zhaochen Zhang, Jianan Tong, Hengxu Wu, Zhihao Li, Yicheng Wang, Luyao Wang, Yuzhuo Bai, Lingyue Fu, Ruifan Xu, R.Y. Wang, Zonglin Li, Mingqi Wei, Haiyang Shen, Chengyuan Zhang, Chao Jin, Zili Zhang, R.H. Yang, Xinbo Xu, Jian Zhou, Ruidong Zhu, Yuzhe Guo, Wenfeng Liang