run detail
race-1776493464
cross-GPU race · llama3.2:1b
started 59d agoended 59d agoduration 13sstatus completedsession live-racer
lanes
| gpu | tok/s | latency (ms) | $/hr | $/1M tokens |
|---|---|---|---|---|
| A100 | 48.2 | 6904 | $0.78 | $4.50 |
| H100winner | 589.7 | 2730 | $2.49 | $1.17 |
run detail
cross-GPU race · llama3.2:1b
| gpu | tok/s | latency (ms) | $/hr | $/1M tokens |
|---|---|---|---|---|
| A100 | 48.2 | 6904 | $0.78 | $4.50 |
| H100winner | 589.7 | 2730 | $2.49 | $1.17 |
boothH100 just posted 193 tok/s on llama3.1:8b — 13.7× faster than the A100 lane (1427h ago).