llama3.2:1b on A6000, A100, H100 — 2026-04-17
2026-04-17T22:24:03.000Z → 2026-04-17T22:24:18.086Z
On 2026-04-17, llama3.2:1b ran across A6000, A100, H100. H100 finished first at 589.9 tok/s, — faster than A100. The per-million-token cost: $1.17 (H100) vs — (A100) — the surprise: H100 was the clear fastest — speed alone wins here.
Podium
H100
1st
thunder-h100
- peak tok/s
- 589.9
- avg tok/s
- 589.9
- $ / 1M tok
- $1.17
A6000
2nd
thunder-a6000
- peak tok/s
- 122.1
- avg tok/s
- 122.1
- $ / 1M tok
- $0.80
A100
3rd
thunder-a100
- peak tok/s
- 0.0
- avg tok/s
- 0.0
- $ / 1M tok
- —