Top
Best
New

Posted by benjamintnorris 3 hours ago

UK sovereign LLM inference(relax.ai)
77 points | 62 commentspage 2
amelius 2 hours ago|
This looks very interesting.

I have no idea why you got downvoted so much.

iso1631 2 hours ago|
HN doesn't like data sovereignty. AMERICA NUMBER ONE and all that.
benjamintnorris 3 hours ago||
Hi HN, I'm Ben, founding engineer at relaxAI.

We built a UK sovereign inference provider for developers who are either paying too much for OpenAI/Claude tokens or can't use US hyperscalers due to data residency requirements.

The short version: drop-in OpenAI-compatible API, latest open source models (Kimi K2.6, DeepSeek V4 Pro, Nemotron 3 Super, GPT OSS 120b), running on NVIDIA Blackwell GPUs in the UK. Zero code changes to switch from OpenAI. Up to 80% cheaper per token cost saving!

We built it on fully UK sovereign cloud infrastructure, so data never leaves UK jurisdiction. For anyone building in regulated sectors — finance, legal, health, defence — that matters a lot. But honestly, most of our early users just came for the huge cost savings.

We're looking for developers to kick the tyres. Check out our API docs at relax.ai/docs. I'd love your feedback and happy to answer any questions.

lukewarm707 8 minutes ago||
https://relax.ai/privacy-policy

"We may share personal information to third parties outside of the UK"

"to find out how long your information is being retained, please see 'additional information'". Additional information is an email address.

https://relax.ai/terms-of-service

non-committal will not share customer data "except[...]with the consent of the Customer". 'see DPA'. there is no DPA on this page.

otherwise,

my use on novita with zero data retention [in, out, cache]: [65.9, 2.4, 424.6][1.74, 3.48, 0.13] = $178.22

i couldn't see cache price on relax, so [65.9, 2.4, 424.6][1.17, 2.33, 1.17] = 579.48gbp = $774.45

timruffles 2 hours ago|||
Firstly, congrats! As a Brit this looks cool, and I'm happy to see it. I wish you every success.

Secondly: I get that 'sovereign' is probably an important sales term for your company. But this, in common with the government's 'sov/ai' fund, does not deserve to be described as sovereign. This is other countries' models served on chips designed and manufactured abroad, powered by a grid which imports 44% of its power.

Of course this isn't your company's fault. Last week I went to an event where the sovereignai.gov.uk people presented. In a very Keir Starmer way (spiritually, he wasn't there), they said in as many words 'oh but I'm sure all reasonable people would agree _really_ sovereign AI would be too hard. So let's all agree to pretend that just popping a bit more money into the AI startup ecosystem is a sovereign AI strategy'.

I'm unsure if the UK does need to be sovereign in anything; it certainly doesn't seem to want to be. But I will continue to poke fun at anything using the pompous phrase 'sovereign' for anything that isn't.

If sovereign AI is a problem you're in earnest about, I hope you go after it seriously, and fix the rest of the stack. I'll cheer you on!

quietbritishjim 1 hour ago|||
Sovereign capability just means that no foreign government can pull the plug. Who cares where it was copied from?

If it were somehow legal for a company to provide MS Office (not a clone) fully in the UK with no control from Microsoft, that would also count as a sovereign capability, even though none of the code was written in the uk.

Maybe that's not how you like the term to be used but it's widely used that way and widely understood.

timruffles 18 minutes ago||
> Sovereign capability just means that no foreign government can pull the plug

OK, fair enough on 'pull the plug ~instantly'. But models and chips age fast. If another country can stop you getting new models and chips, this means you're sovereign in state-of-the-art AI for only a window of a year or two (maybe this will widen if model progress tails off).

If it is a short window, strategically, that doesn't seem worth much given the timelines of: a) inter-state conflict, or trade wars b) cold-start time to be able to make your own models and chips

> Maybe that's not how you like the term to be used but it's widely used that way and widely understood.

Noted. But as a data-point, the audience at the event I mentioned (various AI builders and founders) made it clear from their questions to the speaker that the 'sovereign' that sov/ai was aiming at was hollow, for exactly the reasons I've stated.

quietbritishjim 12 minutes ago||
> But models and chips age fast. If another country can stop you getting new models and chips, this means you're sovereign in state-of-the-art AI for only a window of a year or two

OK, that's a fair point.

carderne 1 hour ago||||
The UK grid does not import 44% of its energy.

Gell-Mann suggests I should treat the rest of your post with skepticism.

EDIT: maybe you meant the UK total primary energy? I feel like that's extending the boundary a bit far. Should we start digging for uranium? Or stick to renewables, but only with locally sourced silica and rare earths?

timruffles 5 minutes ago||
Import dependency. The UK government put it at 43.5% in 2025 and 43.8% in 2024: https://assets.publishing.service.gov.uk/media/69cd1451b5210...

> EDIT: maybe you meant the UK total primary energy? I feel like that's extending the boundary a bit far.

If we're talking about 'sovereign', is it too far? If you read the history of any conflict in the modern era, hot or cold, why is it not important to consider import dependency? What's the plan: tell your opponent it's not fair to disrupt your gas imports?

bcjdjsndon 2 hours ago||||
If I could give prizes for comments you'd get one. Too much fart sniffing goes on in these parts, it's always a pleasant change to see dissent
jonplackett 2 hours ago|||
Tbf the title only says sovereign _inference_
jstummbillig 2 hours ago|||
Hey Ben. I find communication like this fairly off-putting. In so far the 80% cheaper per token (or any part of it) is something of your own making/ingenuity, by all means, do tell, but it requires comparing token cost fairly with comparable models on i.e. OpenRouter and not across different models and pretending it's the same thing.
imdsm 2 hours ago|||
Marketing aside, why are you using the term "UK sovereign"?

I assume UK based DCs, so why not just say that, UK based LLM inference.

Is it a DC owned/ran by HM Gov? Is that why it's sovereign?

Not a criticism, more of a critique.

drawfloat 2 hours ago|||
Much the same way the word "patriotism" is more common in US national discourse, "sovereignty" is very common in UK national discourse.
bcjdjsndon 2 hours ago||
You're thinking of when chavs used to wear sovereign rings... it's fell out of fashion now tbh
raesene9 2 hours ago||||
Data Sovereignty as a term is now fairly well established term that doesn't have specific government connotations e.g. https://events.linuxfoundation.org/kubecon-cloudnativecon-eu...
StilesCrisis 2 hours ago|||
He does say that? "running on NVIDIA Blackwell GPUs in the UK" is in there and that's pretty unambiguous.
pu_pe 1 hour ago||
The problem is if those GPUs are running on an AWS server (or any other American provider), even if it the server is in the UK the sovereignty claim is null and void.
StilesCrisis 1 hour ago|||
Doesn't "We built it on fully UK sovereign cloud infrastructure, so data never leaves UK jurisdiction" cover that?
pu_pe 59 minutes ago||
In theory it should, but I've seen that language describing Azure "sovereign cloud" servers before. The data might indeed be stored in the UK, the problem is the CLOUD act which supersedes it.
benjamintnorris 24 minutes ago|||
[dead]
spacebanana7 2 hours ago|||
Is your business plan essentially to run mid tier models on hardware in the UK?

I do see the value in this as some enterprises need local data residency, the UK energy grid realistically can't handle new multi GW xAI-style data centres, and many applications don't need frontier models (but do need more than small local ones).

robertlagrant 1 hour ago|||
Hi Ben - how are you positioning yourself vs LocAI? I had a few chats with them and they have a fairly similar pitch.
benjamintnorris 1 hour ago||
We’re closely partnered with the LocAI model lab, we’re looking forward to running their models on the platform in the next few months!
robertlagrant 1 hour ago||
Ah great! Best of luck. They're a nice bunch.
graemep 2 hours ago|||
So the pricing is 12.50/month for unlimited chat, or 60p per million tokens output/10p per million input? For use with a coding assistant it would be the latter?
ltr_ 1 hour ago|||
good prices, but I don't see info on the token cache hits prices (in/out), are they available?.
greenchair 2 hours ago|||
Congrats on the launch. More options for consumers in this space the better!
hathym 2 hours ago||
why use this over openrouter?
raesene9 2 hours ago|||
I'd expect for workflows where there is value in knowing that the data is processed in the UK. From a contractual/data protection standpoint, that could be very useful, depending on the use case.
nicce 2 hours ago||||
Avoiding routing through US or US-based companies.
bocytron 1 hour ago||||
openrouter is an US based company, so falls under CLOUD Act
imdsm 2 hours ago|||
good question, it's going to take a lot to dislodge openrouter from my workflows
panchtatvam 2 hours ago||
[dead]
Cakez0r 2 hours ago||
UK sovereign data? Land of arrests for posts on social media? Member of five eyes, "you spy on our citizens and we'll spy on yours and call it intelligence sharing"? Land of the infamous Online Safety act? That UK? Why would anyone want their data in the UK?
pbhjpbhj 46 minutes ago||
Did you know people live in the UK?

Just to pick on one thing, do you think incitement to murder people by setting fire to hotels, acts that subsequently happened, should just be shrugged at?

Cakez0r 40 minutes ago||
What I think about the particular case you're talking about is irrelevant. I guess we'll see if allowing the government to police speech is still such a great idea when Reform and all future governments are in power.
drawfloat 42 minutes ago||
Because they reside in the UK? Why would anyone outside the US want their data in the US, the organiser and leader of the Five Eyes?
Cakez0r 33 minutes ago||
There is a long list of countries other than the US and the UK. I will go to bat for the US on this one though and say that one might want their data in the US because of the first amendment. Even for people that reside in the UK, what is the selling point of having data with them in the same country?
imdsm 2 hours ago|
While I'm British, based in the UK, seeing prices in £ really throws me

Token prices should be in $ as that's how our brains work

lxgr 53 minutes ago||
Why'd you want your expenses be billed in a foreign currency if you can help it?

Converting once, at the time you pick a provider, is trivial compared to having to continuously think about it as you're paying them.

gregjw 2 hours ago||
Likewise, strange right. I live in Japan now, but even living here, I just expect all online provider pricing to be in USD.