yes it is 213 tok/s single stream (so per user)

Agreed. The writer is pretty loose with their comparisons:

* What does it mean for "performance per dollar" to get faster? Higher, maybe; rise faster than it has in the past, maybe, but just "faster"? Nope.

* The article cites some equipment as being "2x cheaper". I think they mean "half the cost", but if so they should say it.

hi i work at wafer. no the margins are lower averaging at about ~40%. utilization is one of the highest order bits in determining margins here, yes.

A place where the slope/derivative/incremental-performance-per-price changes.

I used to be high-performance like you, then I took an arrow to the knee?

They seem to be serving it at 3x the price while also struggling with maintaining uptime on openrouter; while the vercel router advertizes even bigger speeds but has no clear uptime stats

I guess you really do have to try it at least for some time to actually know