Rig Finder index / 70B / Always-on agent server / New Hampshire

Best rig to run a 70B model for always-on agent server in New Hampshire

For a 70B model at this workload, the RTX 3090 (used) pays off fastest — break-even ~2 months, keeping $20,982 over 3 years versus Claude Sonnet 4.6.

Same workload, same cloud, same electricity — we swap only the hardware and rank by real break-even. Rigs that can't run a 70B model are shown, never recommended. Compared against Claude Sonnet 4.6 ($3/M in, $15/M out); change the cloud in the lab.

Every build, ranked

RigBuild70B tok/sLocal/moBreak-evenVerdict
RTX 3090 (used)best payoff $1,200 6estimated $77.17 ~2 mo OWN
2× RTX 3090 $2,250 15estimated $136 ~4 mo OWN
RTX 4090 $2,300 8estimated $113 ~4 mo OWN
Mac M-series $3,000 9estimated $92.10 ~5 mo OWN
RTX 5090 $3,500 14estimated $159 ~6 mo OWN
Mini-PCtoo small for 70B $750 $30.26 ~1 mo OWN

Assumes always-on agent server use: ~120M tokens/month, 10h/day active, 14h/day idle, at New Hampshire electricity ($0.281/kWh). Speeds are our estimates; community-measured tok/s live on the interactive Rig Finder and the benchmarks board. Every formula is on the methodology page.

Run this with your exact numbers →

Related