Compare
Pick two or more models to compare tok/s across GPUs and overall composite scores. With no picks, shows every model seen.
| Model | A100 tok/s | A6000 tok/s | H100 tok/s | Composite |
|---|---|---|---|---|
| llama3.1:8b | 8.1 | 4.3 | 126.6 | 92.44 |
| llama3.2:1b | — | — | 253.9 | — |
| qwen2.5:1.5b | 24.8 | 13.3 | — | 93.66 |
| qwen2.5:14b | 5.1 | 2.6 | 83.5 | 92.08 |
| qwen2.5:32b | — | 1.1 | — | — |