我的集群:五节点 EPYC 7532,从零装起

一座正在从零装起的集群

本站记录一座五节点 EPYC 集群从装机到跑起大模型的全过程:每块显卡能跑多大的模型、每秒多少 token、每一步踩过什么坑,都用自己的机器测出来再写。

硬件清单截至 2026-11-23,全部为站长自有设备。不确定的地方如实标注,不猜。

硬件清单

部件规格状态
主板超微 H11DSi 双路 × 5已持有
CPUAMD EPYC 7532(32 核 64 线程)× 10,全集群共 320 核 / 640 线程已持有
内存DDR4-2666 ECC RDIMM 8GB × 24 条,共 192GB —— 其中 8 条已确认,另 16 条待站长回家核实总数16 条待核实
显卡RTX 2060 12G × 1已持有
显卡RTX 3080 × 1(10G 还是 12G 版本未确认)版本待确认
候选显卡V100 32G、RTX 3090 24G —— 正在比较的购买选项未持有

当前状态:第一台正在装

内存若确为 24 条,只够装 3 台(每台 8 条 64GB、4+4 分给两颗 CPU),剩下 2 台缺内存——这是集群全员到齐前要先解决的事。

下一步:第一台点亮后,本站会陆续发实测数据,替换掉目前的估计值,并公布内存核实结果和 3080 的版本确认。

数据更新日期:2026-11-23。

My Cluster: Five EPYC 7532 Nodes, Built from Scratch

A cluster being built from scratch

This site documents a five-node EPYC cluster going from bare hardware to running large models locally: how big a model each card can run, how many tokens per second, and every pitfall along the way — all measured on my own machines.

Hardware list as of 2026-11-23. Everything listed is hardware I own. Where something is unconfirmed, it is labeled as such — no guessing.

Hardware list

PartSpecStatus
BoardSupermicro H11DSi dual-socket × 5Owned
CPUAMD EPYC 7532 (32 cores / 64 threads) × 10 — 320 cores / 640 threads across the clusterOwned
MemoryDDR4-2666 ECC RDIMM 8GB × 24 sticks, 192GB total — 8 sticks confirmed, 16 more to be verified by counting at home16 sticks to verify
GPURTX 2060 12G × 1Owned
GPURTX 3080 × 1 (10G or 12G version unconfirmed)Version to confirm
GPUs under considerationV100 32G, RTX 3090 24G — purchase options being comparedNot owned

Current status: first node being built

If the memory really is 24 sticks, it only covers 3 nodes (8 sticks / 64GB per node, split 4+4 across the two CPUs), leaving 2 nodes short on memory — the first thing to solve before the whole cluster is up.

Next: once the first node lights up, this site will publish measured data to replace the current estimates, plus the memory-count result and the 3080 version confirmation.

Data as of: 2026-11-23.

评论

此博客中的热门博文

Ollama 入门:十分钟跑起第一个本地模型

第一台装机指南(精简版):清单、三个坑、两步验证