Used A100 80GB prices are falling fast — should you actually buy one?

Datacentre A100s are flooding the second-hand market as Blackwell and Rubin push them out, and 80GB is edging towards hobby budgets. Here's the honest buyers guide.

Listen to this post · 15 min

Accessibility: the whole post is read aloud — Space plays or pauses, ← → skip 10 seconds, and you can change the speed. It keeps playing with your screen locked.

Share this post

In short

  • Used A100 prices are down a further 20–30% in weeks per r/LocalLLaMA's tracker (13 November) as Blackwell and Rubin push datacentre stock out — and the drop is accelerating, not levelling off.
  • For most home users the verdict hasn't changed: two used 3090s (48GB combined) still beat a used A100 on cost, noise and hassle; the A100 wins on single-card 80GB and simplicity for big models.
  • A 5090-class card is a speed tier, not a capacity tier — 32GB of fast memory can't substitute for 80GB.
  • Buy PCIe, never SXM2, unless you enjoy regret; budget for real cooling and accept that resale value is falling.
  • The one profile where a used A100 clearly makes sense: serving models to others, where 80GB in one card plus concurrency turns the card into an earner rather than a toy.

Used A100 prices are falling — fast. A 13 November update on r/LocalLLaMA reports A100s down a further 20–30% in the weeks since the same tracker's earlier "prices are collapsing" post — and the drop is accelerating, not levelling off. 80GB in one card is now edging into the same budget conversation as a pair of used 3090s.

This is the buyers guide those threads don't quite give you: what each tier actually gets you, the power and cooling reality, and the honest answer for most homes — which, spoiler, is still two consumer cards.

What's happening to used A100 prices

The Reddit thread's explanation is straightforward: sellers would rather price competitively and shift stock now than get caught holding it through a collapse. Rubin and Blackwell parts are, per the thread, 3–4x more efficient per watt, with far more financing behind them — so datacentres are rotating A100s out in volume, and the second-hand market is absorbing the flow.

We won't quote absolute prices here, and you should be suspicious of anyone who does without a date. They move weekly, and they vary by region and by variant — SXM modules and PCIe cards are different products with different buyers. The Reddit thread and its linked listings are the live source. Treat any price you see as a snapshot, not a fact.

What we can say: the direction is down, the pace is quick, and the 20–30% figure is the tracker's, not ours. Whether it keeps falling is a judgement call — but the thread's own logic (newer silicon at 3–4x the efficiency per watt, with more financing behind it) doesn't suggest the pressure lets up soon.

The honest headline: for most homes, two 3090s still win

Let's give the verdict before the analysis, because skimmers deserve the right answer.

An A100 80GB gets you 80GB in one card — no tensor-parallel splitting, no per-card quantisation juggling, ECC memory and datacentre-grade bandwidth. But the 80GB PCIe card is a 300W part (the SXM module is 400W) that expects server airflow, server power delivery, and often a specific chassis.

Two used RTX 3090s give you 48GB total, and they're typically the cheaper route to that much memory — helped by a supply glut of their own. Yes, that's loud and hot. But they fit in a standard tower with off-the-shelf PSUs, and r/LocalLLaMA has years of playbooks for them: risers, blower mods, fan swaps, undervolting. Every problem has a documented answer.

And that used 3090 supply really is a glut. A 13 November post shows a member being handed a "shed full" of ex-Ethereum-mining 3090s by family — "a few new fans and a bit of a clean-up... grab a couple risers and a power supply" and he's in business. Ex-mining cards keep surfacing cheap, which keeps the 2×3090 route's floor low.

Where the A100 genuinely wins: single-card 80GB means a 70B-class model at a decent quant fits whole, with none of the split-across-cards friction. If you're serving other people — not just yourself — that simplicity is worth real money. We'll come back to that.

Tier-by-tier: what each option actually gets you

Here's the comparison the subreddit threads don't assemble. Prices are deliberately left out — the A100 figure is the one moving fastest, and the 20–30% drop is the only price claim we'll make, and it's the Reddit tracker's, not ours. Check the thread and current listings for live numbers.

Used A100 80GB (PCIe)2× used RTX 3090RTX 5090-class
VRAM80GB48GB (2×24GB)32GB
Board power300W (400W SXM)~700W combined575W
What fits70B at Q4–Q5, whole70B split across cards~32B at Q4, or 70B heavily quantised
CoolingServer chassis or serious custom airflowStandard tower, loudStandard tower, very hot
NoiseDepends entirely on your fansLoudLoud under load
Resale riskHigh and risingLow — already cheapModerate
VerdictBuy only if you need 80GB in one cardThe default answer for most homesA speed tier, not a capacity tier

Three notes on the table:

  • The 5090-class verdict: 32GB of very fast GDDR7 is lovely for tokens per second on models that fit. But 32GB is 32GB. It can't touch 80GB for big models — it's a speed tier, not a capacity tier, and no amount of bandwidth substitutes for memory that isn't there.
  • The wildcard: a used A100 40GB sometimes undercuts everything on £/GB in the same listings. Worth watching — but half the capacity changes the calculus entirely. A 40GB card competes with the 3090 pair, not the 80GB card.
  • The realistic model sizes: if you're mostly running 8–32B models — which, as we noted in our November "what we'd pick" post, is what people actually run — none of this matters much. A single 3090 or a 5090-class card does the job. The 80GB question only arises for the big models: Ripple-65B, which we covered needing roughly 48GB+ of RAM/VRAM as a floor, or a large MoE like Qwen3-30B-A3B, which wants room for weights and a long context window on top.

Power, cooling and the stuff listings don't mention

This is where a good buy becomes an expensive paperweight.

The A100 PCIe is passively cooled. No fans on the card. It expects chassis airflow measured in cubic feet per minute, not a desk fan pointed at it. In a tower you'll need a 3D-printed or sheet-metal shroud and high-static-pressure fans pushing air straight through the heatsink — and it will still run hot. People do it, but it's a project, not a purchase.

Never buy SXM2. SXM modules need a carrier board or an SXM-to-PCIe adapter, plus their own cooling solution — a rabbit hole most home builders regret entering. And at 400W for the module, it's even less home-friendly than the 300W PCIe card. If you're buying an A100, buy PCIe. Full stop.

Power is the easy part; the platform is the surprise. A 300W card is manageable for a good PSU. What catches people is everything around it: a chassis that can actually move air, and idle power that doesn't drop as gracefully as a consumer card's. Datacentre silicon assumes datacentre infrastructure.

Two 3090s at ~700W combined plus CPU means a 1000W+ PSU, and the community fixes are well documented: blower-style cards to exhaust heat out the back, undervolting to shave meaningful watts per card, and the fan-and-riser approach visible in the ex-mining 3090 post.

Budget for noise and heat like you'd budget for the cards. They're real costs, in pounds and in decibels.

Software: what runs on an A100 that doesn't on consumer cards

Short answer: almost nothing — and that's mostly fine.

The A100 is Ampere, compute capability 8.0. Everything mainstream supports it: vLLM (whose practical floor we put at roughly 7.0, Volta and newer, in our engine comparison), llama.cpp, Ollama, LM Studio. If it runs on a 3090, it runs on an A100, with more headroom.

What you get on datacentre cards that consumer cards lack:

  • MIG (Multi-Instance GPU) — split one card into isolated instances with their own memory and compute slices. Genuinely useful if you're serving multiple users or workloads.
  • ECC memory — matters for long-running serving reliability.
  • NVLink — available on SXM modules and, via NVLink bridges, on pairs of PCIe cards too. It's a side point for home builds either way.

What you don't get: the newest consumer-card features. No FP8 (that's Hopper/Ada and later), and Blackwell-era optimisations target newer silicon. An A100 is a big, straightforward Ampere card — nothing exotic, nothing missing for local inference.

The practical upshot: the software argument for the A100 is concurrency, not capability. For a single user at home, vLLM on an A100 behaves much like vLLM on a 3090 with more memory. For serving many simultaneous requests, MIG and the memory headroom start to matter — which is exactly the profile of someone earning from the card rather than playing with it.

Buying used datacentre silicon: the risks

The checklist before you hand over four figures to a stranger on eBay:

  1. No warranty. A100s coming out of datacentres now have years of 24/7 duty behind them. Ask for the card's history if the listing offers it; assume the worst if it doesn't.
  2. Check the exact variant. PCIe vs SXM (PCIe only, we've said). 40GB vs 80GB — and note the 40GB PCIe card is a 250W part, the 80GB is 300W. Watch for China-market or OEM variants with quirks, too: driver support and resale both suffer.
  3. Test on arrival. Check nvidia-smi for logged ECC errors, run sustained load and watch thermals, and confirm the full 80GB actually addresses. A quick gpu-burn or an hour of your biggest model is the honest test.
  4. Resale risk is the big one. The Reddit thread's whole point is that these are depreciating fast because newer silicon is 3–4x more efficient per watt. Buy to use, not to hold.

If the price still feels steep for occasional use, rent before you commit: dedicated host machines rent by the hour, which prices the "do I actually need this?" question at a fraction of a four-figure purchase.

Who should actually buy one

Three profiles, three verdicts:

  • Hobbyist running 8–32B models for yourself: don't. A single 3090 or a 5090-class card does everything you're running today, cheaper, quieter, and without a cooling project. The 80GB is capacity you'll never address.
  • Homelabber who wants 70B-class models whole, locally, and enjoys tinkering: borderline — for the first time. The falling price is what makes this a conversation rather than a joke. Buy PCIe, budget for real cooling, accept the resale risk, and go in knowing the card will likely be worth less every month you own it.
  • Anyone hoping to earn from the hardware by serving models to others: this is where the A100 pays. Single-card 80GB plus the concurrency story (MIG, ECC, vLLM's continuous batching) is exactly the profile that works for serving. A used A100 fielding requests can work for its keep while you sleep. If that's you, hosting through Inpherio's marketplace is the simplest route from card to income — hosts keep everything except the platform fee, and new hosts get 12 months fee-free.

What we'd pick

For ourselves, today: a pair of used 3090s, unless we had a specific serving plan. The A100 price drop is real, and it's made 80GB conceivable for the first time — but conceivable isn't the same as sensible for a desk in a spare room. Watch the tracker thread, check the listings it links, and if the number keeps falling, revisit in a month. On the trend the thread describes, waiting costs you little.

Questions people ask

Is a used A100 80GB good for local LLMs?

Yes — 80GB in one card fits a 70B-class model at a decent quant whole, with no tensor-parallel splitting. But the 80GB PCIe card is a 300W passively cooled part that expects server airflow, so it's only sensible if you want big models and are willing to build proper cooling.

How much does a used A100 cost in November 2026?

We deliberately don't quote absolute prices: they move weekly and vary by region and variant. r/LocalLLaMA's tracker reports prices down a further 20–30% in weeks as of 13 November — check the thread and live listings for current figures.

Used A100 vs two RTX 3090s: which is better for local LLMs?

For most home users, two 3090s: typically the cheaper route to ~48GB combined, they fit a standard tower, and the community has years of cooling playbooks. The A100 wins when you need 80GB in one card or want to serve multiple users without splitting models.

Can you cool an A100 in a normal PC case?

Not as-is. A100 PCIe cards are passively cooled with no fans — they expect chassis airflow from a server. In a tower you need a shroud and high-static-pressure fans, and it will still run hot. Avoid SXM2 modules entirely.

Will used A100 prices keep falling?

The Reddit tracker's argument points that way: Blackwell and Rubin parts are 3–4x more efficient per watt with more financing behind them, so datacentres are rotating A100s out in volume. Buy to use, not to hold.

Does vLLM support the A100?

Yes. The A100 is Ampere (compute capability 8.0), comfortably above vLLM's practical floor of roughly 7.0 (Volta and newer). llama.cpp, Ollama and LM Studio all support it too.

Models in this post — live on Inpherio

Have a GPU, a Mac or a spare PC?

Let it earn while you sleep.

Run open models for people who need them. You set the price and keep everything but the 15% fee.

Become a host

Building with AI?

Every open model, one API.

OpenAI-compatible. Priced by the people who run the hardware.

Start free See the marketplace

Read “Used A100 80GB prices are falling fast — should you actually buy one?” at https://inpherio.co.uk/blog/used-a100-80gb-prices-are-falling-fast-should-you-actually-buy-one