Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU

无GPU，在13年前Xeon上以5 token/秒运行Gemma 4 26B

HN Points: 205 / 126 comments | Author: neomindryan | HN Discussion: item?id=48922434 | Source: www.neomindlabs.com

Original Article

There’s a server in my basement that has no business running a modern language model. It’s a repurposed HP StoreVirtual storage box, roughly thirteen years old, two Ivy Bridge Xeons, no GPU. It was built to hold disks, not do math. As of this week it runs Google’s Gemma 4 , a 26-billion-parameter open-weights mixture-of-experts model, at about five tokens per second. Reading speed.

⋯ 继续阅读请登录会员 ⋯