Rig Finder index / 32B / Local RAG / knowledge base / New York
Best rig to run a 32B model for local rag / knowledge base in New York
For a 32B model at this workload, the RTX 3090 (used) pays off fastest — break-even ~6 months, keeping $5,835 over 3 years versus Claude Sonnet 4.6.
Same workload, same cloud, same electricity — we swap only the hardware and rank by real break-even. Rigs that can't run a 32B model are shown, never recommended. Compared against Claude Sonnet 4.6 ($3/M in, $15/M out); change the cloud in the lab.
Every build, ranked
| Rig | Build | 32B tok/s | Local/mo | Break-even | Verdict |
|---|---|---|---|---|---|
| RTX 3090 (used)best payoff | $1,200 | 24estimated | $53.91 | ~6 mo | OWN |
| RTX 4090 | $2,300 | 38estimated | $86.71 | ~12 mo | OWN |
| 2× RTX 3090 | $2,250 | 30estimated | $97.34 | ~12 mo | OWN |
| Mac M-series | $3,000 | 20estimated | $87.45 | ~14 mo | OWN |
| RTX 5090 | $3,500 | 60estimated | $126 | ~19 mo | HYBRID |
| Mini-PCtoo small for 32B | $750 | — | $25.29 | ~4 mo | OWN |
Assumes local rag / knowledge base use: ~40M tokens/month, 5h/day active, 11h/day idle, at New York electricity ($0.245/kWh). Speeds are our estimates; community-measured tok/s live on the interactive Rig Finder and the benchmarks board. Every formula is on the methodology page.
Run this with your exact numbers →