Second-hand V100 cluster runs LLaMA-70B for $22K, but carbon cost depends on grid
Researchers built a 128-GPU cluster from retired V100s and ran it for a year, achieving competitive LLaMA-70B throughput at 3.6% the cost of new hardware—but energy consumption makes it viable only in low-cost, low-carbon regions.

