我的集群:五节点 EPYC 7532,从零装起
一座正在从零装起的集群
本站记录一座五节点 EPYC 集群从装机到跑起大模型的全过程:每块显卡能跑多大的模型、每秒多少 token、每一步踩过什么坑,都用自己的机器测出来再写。
硬件清单截至 2026-11-23,全部为站长自有设备。不确定的地方如实标注,不猜。
硬件清单
| 部件 | 规格 | 状态 |
|---|---|---|
| 主板 | 超微 H11DSi 双路 × 5 | 已持有 |
| CPU | AMD EPYC 7532(32 核 64 线程)× 10,全集群共 320 核 / 640 线程 | 已持有 |
| 内存 | DDR4-2666 ECC RDIMM 8GB × 24 条,共 192GB —— 其中 8 条已确认,另 16 条待站长回家核实总数 | 16 条待核实 |
| 显卡 | RTX 2060 12G × 1 | 已持有 |
| 显卡 | RTX 3080 × 1(10G 还是 12G 版本未确认) | 版本待确认 |
| 候选显卡 | V100 32G、RTX 3090 24G —— 正在比较的购买选项 | 未持有 |
当前状态:第一台正在装
内存若确为 24 条,只够装 3 台(每台 8 条 64GB、4+4 分给两颗 CPU),剩下 2 台缺内存——这是集群全员到齐前要先解决的事。
下一步:第一台点亮后,本站会陆续发实测数据,替换掉目前的估计值,并公布内存核实结果和 3080 的版本确认。
数据更新日期:2026-11-23。
My Cluster: Five EPYC 7532 Nodes, Built from Scratch
A cluster being built from scratch
This site documents a five-node EPYC cluster going from bare hardware to running large models locally: how big a model each card can run, how many tokens per second, and every pitfall along the way — all measured on my own machines.
Hardware list as of 2026-11-23. Everything listed is hardware I own. Where something is unconfirmed, it is labeled as such — no guessing.
Hardware list
| Part | Spec | Status |
|---|---|---|
| Board | Supermicro H11DSi dual-socket × 5 | Owned |
| CPU | AMD EPYC 7532 (32 cores / 64 threads) × 10 — 320 cores / 640 threads across the cluster | Owned |
| Memory | DDR4-2666 ECC RDIMM 8GB × 24 sticks, 192GB total — 8 sticks confirmed, 16 more to be verified by counting at home | 16 sticks to verify |
| GPU | RTX 2060 12G × 1 | Owned |
| GPU | RTX 3080 × 1 (10G or 12G version unconfirmed) | Version to confirm |
| GPUs under consideration | V100 32G, RTX 3090 24G — purchase options being compared | Not owned |
Current status: first node being built
If the memory really is 24 sticks, it only covers 3 nodes (8 sticks / 64GB per node, split 4+4 across the two CPUs), leaving 2 nodes short on memory — the first thing to solve before the whole cluster is up.
Next: once the first node lights up, this site will publish measured data to replace the current estimates, plus the memory-count result and the 3080 version confirmation.
Data as of: 2026-11-23.
评论
发表评论