run detail
race-1776493737
cross-GPU race · llama3.1:8b
started 59d agoended 59d agoduration 21sstatus completedsession live-racer
lanes
| gpu | tok/s | latency (ms) | $/hr | $/1M tokens |
|---|---|---|---|---|
| A100 | 15.6 | 16864 | $0.78 | $13.9 |
| H100winner | 192.2 | 3742 | $2.49 | $3.60 |
run detail
cross-GPU race · llama3.1:8b
| gpu | tok/s | latency (ms) | $/hr | $/1M tokens |
|---|---|---|---|---|
| A100 | 15.6 | 16864 | $0.78 | $13.9 |
| H100winner | 192.2 | 3742 | $2.49 | $3.60 |
play-by-playH100 just posted 193 tok/s on llama3.1:8b — 13.7× faster than the A100 lane (1427h ago).