run detail
race-1776495655
cross-GPU race · llama3.1:8b
started 59d agoended 59d agoduration 21sstatus completedsession live-racer
lanes
| gpu | tok/s | latency (ms) | $/hr | $/1M tokens |
|---|---|---|---|---|
| A100 | 14.1 | 17470 | $0.78 | $15.4 |
| H100winner | 193.2 | 3681 | $2.49 | $3.58 |
run detail
cross-GPU race · llama3.1:8b
| gpu | tok/s | latency (ms) | $/hr | $/1M tokens |
|---|---|---|---|---|
| A100 | 14.1 | 17470 | $0.78 | $15.4 |
| H100winner | 193.2 | 3681 | $2.49 | $3.58 |
boothH100 just posted 193 tok/s on llama3.1:8b — 13.7× faster than the A100 lane (1427h ago).