Top
Best
New

Posted by thisisfatih 16 hours ago

We just shipped support for the ugliest part of HTTP: Vary(blog.cloudflare.com)
135 points | 33 comments
simonw 15 hours ago|
I've been wanting this from Cloudflare for years.

The classic problem here is if you do that thing where user agents that send "accept: text/html" get HTML, while user agents that don't get JSON or some other format.

This used to be impossible to deploy behind Cloudflare caching, because they ignored the Vary header on anything other than images - so you risked caching the JSON version and then serving it up to someone who was expecting HTML.

(Independent of the Cloudflare feature I ended up deciding never to use that pattern, because I prefer having URL that predictably returns HTML or JSON - I add a .json suffix to my apps to serve JSON instead.)

Joker_vD 12 hours ago|
Frankly, the supposed variability of the Accept header never really sat all that well with me; in practice I much prefer working with explicitly versioned endpoints — one of the most infuriating things is having to hardcode "Accept: text/x-myorgname-custom-json-blob-v4" because omitting it would produce "406 Not Acceptable". Bonus points if that's the only Accept header the service would ever accept in all of three years of it working before being decommissioned. Double bonus points if v5 would be introduced behind a separate URI anyway (and it, too, would require precisely "Accept: text/x-myorgname-custom-json-blob-v5" and nothing else).
yoavm 7 hours ago||
I always thought Accept (and Accept-Language) headers are quite neat. Surely I can try article.es.md first, get a 404, try article.en.md, get a 404, try article.es.txt, article.en.html and so on, until I find the thing I'm looking for. But Accept let's me say "I'll take any one of these, preferably in this order". This is especially useful now when agents are reading the web and they don't really need all of our HTML code - just the text.

If you're versioning the whole API though, I agree it's best behind a a /v2/ prefix.

colmmacc 11 hours ago||
Wow this brings back memories. Over twenty years ago I added Vary support to various mod_cache submodules for Apache 2.0, and it was way too high a pain to reward ratio. It just uncovered so many user agent bugs and crazy backends. I remember arguments about being able to cache variable based on non-literal virtual headers (e.g. a geo location header), and a crazy request to Vary based on "Date:" ... which makes absolutely no sense. The whole thing was just too clever for its own good. It's no surprise that language selection ended up in URLs (/en-US/..) rather than "Vary: Accept-Lang" features.
Gigachad 11 hours ago|
I feel like putting as much as possible in the URL is a good thing anyway. If I send someone a link, I can know it's the same document that shows on their browser as mine.
tiffanyh 10 hours ago||
I just wish CF would enable Enterprise functionality to lower (paid) tiers as they promised a year ago yet haven’t delivered on.

https://blog.cloudflare.com/enterprise-grade-features-for-al...

Like Prefetch: https://developers.cloudflare.com/speed/optimization/content...

jiehong 6 hours ago||
Is Vary really that ugly?

I’d say that it forces you to maybe parse and understand the headers that vary header.

Accept-Language is supposed to be parsed and matched according to RFC4647 in one of 3 ways. That part is rather complex, but it’s not Vary’s fault.

kevincox 45 minutes ago|
One major issue with Vary is that it makes cache coalescing very complicated. This is because you can't know whether two requests will share a response until you get that response. So for subsequent requests you need to decide if you should block it hoping that the response will satisfy it or if you should send it through pessimistically, possibly triggering a thundering herd effect on every cache rotation.

I'm not sure if it is possible to solve this nicely in a generic way, but it does make it a bit ugly.

badlibrarian 13 hours ago||
If this surprises you, remember that Cloudflare doesn't cache HTML by default.
pipe01 1 hour ago||
As it should be
AlienRobot 12 hours ago||
They can't do that because a CMS under Cloudflare needs to be configured to bust the Cloudflare cache when content is edited or the user will see cached content after they edit a page.
tshaddox 12 hours ago|||
That might be the default configuration if your CMS doesn't return any cache-control headers. But Cloudflare definitely [0] supports must-revalidate and etag or last-modified, which is also probably supported by whatever CMS you're using. HTTP conditional requests are very old and very widely supported.

[0] Okay, my claim is only definite up to my memory of using Cloudflare for a fairly high-traffic circa 2019-2022. I haven't used Cloudflare after that point, but a quick search of their docs shows support

AlienRobot 10 hours ago||
Right. But if the cache MUST be revalidated every time, it's the same thing as being disabled.

The point of a reverse proxy is to reduce load on the server rendering the page. If you GET, the page is rendered. So in order for etag/last-modified to be effective, the CMS must implement HEAD. If the CMS doesn't implement HEAD or implements it in a way that ends up doing all the work of GET anyway, you just end up with more load than just doing a GET every time.

The funny thing is that the way HTTP is designed the simplest PHP script can do this correctly, because the server must send the headers first, so a PHP script can NOT do the work to generate the HTML until it has sent the correct headers, as they won't be able to change the headers after they start sending the body. In theory, the process could just shut down the instant the first body byte starts being sent and save work in a HEAD request. The problem is that pretty much everything works in a more "clever" way: you have some sort of template engine that generates the whole HTML, a view method that makes the DB calls, etc., and only after all the work is done the HTTP headers are sent. Because this method allows the backend to add/change/remove headers at any point during the process, not just at the start.

Essentially the problem is that CF doesn't know what your server is running, and even an s-maxage=60 is going to look like a bug from the user's perspective if they go to /post?id=123, navigate to /edit-post?id=123, edit the post, go back to /post?id=123 and see the post unchanged.

tshaddox 28 minutes ago|||
What are you referring to with the origin needing to support HEAD requests? For HTTP conditional requests your origin just needs to support GET with if-none-match or if-modified-since. Then it responds with a 304 with no body if the cached version is still valid. The origin should, of course, be able to determine cache validity much more cheaply than rendering the whole page, which is usually as simple as checking a single timestamp in the database.

And, of course, you can still use cache-control to permit some duration of staleness, so that you don’t literally revalidate on every request.

account42 1 hour ago|||
> If you GET, the page is rendered. So in order for etag/last-modified to be effective, the CMS must implement HEAD.

No, you just implement GET properly so that nothing gets "rendered" for 304 Not Modified responses.

eli 12 hours ago|||
OTOH a CMS that doesn’t send correct cache headers is already broken
jrochkind1 13 hours ago||
I had not actually realized what a mess Vary is.

Wow, sometimes I think it's amazing the web works at all!

saltcured 13 hours ago||
It pains me to think about the important ones like varying on session cookie and authorization headers, and how badly some middleware can confuse things.

We generate custom content for a given authentication context. We definitely want caching at the user agent, but we want the cache keyed by the authenticated identity. Otherwise something like logging out and logging in as a different identity can produce monstrously confused results when an SPA or similar mixes some cached and some fresh responses into one page.

rmunn 12 hours ago|||
Cache invalidation, one of the two hard problems in computer science.

I'm sure most people here already knows the joke, but for the lucky 10,000, here's the full joke:

There are only two hard problems in computer science. Naming things, cache invalidation, and off-by-one errors.

onestay42 11 hours ago|||
And, for those who don't know who the lucky 10,000 are, https://xkcd.com/1053/
sandeepkd 10 hours ago|||
Wait a second, if you decided to become intermediary in the protocol then you are supposed to add value, not take away the features that already exists.

Although its not clear from the article itself, my gut feeling is that some big enough client arm twisted them to support it before they sign the contract again

Joker_vD 8 hours ago||
Implementing the HTTP/1.1 caching mechanism at the proxy server is delightfully simple if you just ignore it entirely. But if you decide to do some caching on your own, you better implement the semantics in the way the clients and the servers expect it to be. Which is not simple at all if you're doing the caching to eke some performance improvements.
mikestorrent 12 hours ago||
Imagine if we actually built a remote application delivery platform instead of cobbling one onto a glorified document reader
rob-olmos 14 hours ago||
"If the origin response does not include a Vary header, Cloudflare caches the response normally"[1]

"If one response omits it, Cloudflare could cache that response without the variance needed to keep it isolated."[2]

Will that non-Vary cache object front-run any Vary-segmented cache objects?

If so, probably worth adding a snippet rule to ensure every response has a Vary header?

1: https://developers.cloudflare.com/cache/concepts/vary/#how-v...

2: https://blog.cloudflare.com/vary-support/#how-a-response-mov...

bhouston 15 hours ago||
Nice to see. I’ve used vary to quite a bit of success on CloudFront back in the day.

I actually assumed when I started using Cloudflare that it did have vary support and it led to a serious bug in my sass app at the time.

yellow_lead 11 hours ago||
A site I work on serves dynamic language content based on the accept-language header. We do this for some pages and others we redirect to i.e /en/page

But we can't cache those dynamic pages since they vary based on accept language. Maybe with this we can

xyzzy_plugh 15 hours ago|
I honestly thought they would never ship this. Holy hell this has been a long time coming.

Actual real content negotiation in 2026. Never thought I'd live to see the day.

More comments...