row-skip prefill ratio: 1.692x
decode-attention bandwidth ratio: 1.447x
weight traffic at 24.7 tok/s: 64.5 GB/s
time per token at 24.7 tok/s: 40.5 ms
