Top
Best
New

Posted by sbulaev 10 hours ago

When “idle” isn't idle: how a Linux kernel optimization became a QUIC bug(blog.cloudflare.com)
98 points | 8 comments
neuralkoi 5 hours ago|
I can see why they rewrote QUIC in Rust and for use in userspace, though going the in-house approach would warrant keeping an eye on the relevant kernel commits like a hawk to avoid missing bug fixes like these. These in-house implementations tend to have less eyeballs than the kernel.

I found it interesting that Cloudflare is not yet using BBR as the default in quiche. CUBIC's recovery in this day and age, and especially in datacenters with large pipes, seems so slooow to me. Almost two seconds with no loss whatsoever till achieving BDP again and then shooting itself in the foot every time it hits the ceiling. Each one of those losses a retransmission.

masklinn 1 hour ago|
> I can see why they rewrote QUIC in Rust and for use in userspace

As far as I know, while they might have either way, they did not ("rewrite QUICK [...] for use in userspace"): the linux kernel implementation only landed late 2025. Quiche was started ca 2018 (that's when Cloudflare started beta-deploying QUIC, the first public alpha of quiche was january 2019).

I don't know that there even was an in-kernel implementation of quic before msquic.sys which I believe first shipped in Server 2022 circa mid 2021 (and is used as the implementation backend by MsQuic on Server 2022 and W11).

echoangle 1 hour ago||
Looking at the last plot, it seems like the backoff is roughly 1/5 of the total bandwith and it happens every 50 ms or so. Wouldn't it make sense to reduce the backoff and the growth speed if a backoff occurs repeatedly in rapid succession? We want to maximize the area under the curve (transmitted packages), right?
blahgeek 8 hours ago||
The more precise title should be: How we copied code from Linux kernel without fully understand it and missed its follow-up fixes, now it bites us
embedding-shape 17 minutes ago|
Also, not a single takeaway about how to prevent that very preventable issue in the first place, as you allude to.

I wonder what happened with the very hardcore engineering that used to happen at Cloudflare and was published? Almost every blog post today seems to expose some weirdness at Cloudflare, rather than highlighting excellence in engineering, what changes? Been slowly changing over the years, did they change their hiring practices or something?

extropy 4 hours ago|
[flagged]
yuye 3 hours ago||
The first half wasn't too bad, but the AI tells get strong in the second half.
philipwhiuk 55 minutes ago||
The tell I always spot is it's propensity to bold random words frankly.
bonzini 4 hours ago||
Yes, and it becomes unbearable after a while.