Top
Best
New

Posted by acossta 8 hours ago

Gemini 4 Carbon(blog.google)
774 points | 632 commentspage 5
tempestn 6 hours ago|
> Building on Gemini 4 Argon, which was launched two weeks ago, Carbon illustrates the pace at which we’re pushing the frontier forward.

This has to be an intentional echoing of the "pace the frontier" language?

hemkeshr 4 hours ago||
It’s still not ready for public—looks like they’re pushing the launch, kind of like they did with argon. Now anthropic and openai will launch a model outperforming carbon then google thinks of calling carbon to public. Also their premium plans are very bad, least usage for the money invested.
docheinestages 5 hours ago||
Artificial Analysis is ranking it as #1. Wait a couple days until they come up with a new index versions and Anthropic will lead again.
WASDx 5 hours ago|
AA updated their index version yesterday. For sure Google waited for that update so they could be #1.
peri-cl 5 hours ago|||
They're in first place by a narrow 59 to 58; so for all we know it could have gone the other way, had they done the benchmarks yesterday. (AAI would have had advance knowledge of this issue, since they would have been given Carbon access in advance. I think this is sus).

I tried to figure out if I could reproduce Carbon's aggregate score using yesterday's (v4.3.2's) benchmark weights—but apparently you can't actually do that, without paying AAI. The raw numbers going into that aggregate aren't available on their public website.

rayon22 5 hours ago|||
would bet it has more to do with their earnings call being in an hour than timing one specific benchmarks refresh cycle
dom96 7 hours ago||
Will this make it to OpenRouter? Running your own benchmarks against these models is surprisingly frustrating when you don’t want to create hundreds of accounts for each AI lab’s API.
ltph0 6 hours ago||
"The Fairwind Program gives high-priority defenders (like governments, healthcare providers, and telecommunications services) early access to advanced models that help them build better defenses, before new threats arrive."

Again, no access to open source developers. The AI companies want bugs for dramatic public relations! Also, of course there aren't enough bugs so they have to be rationed for the "defenders" and future models.

cubefox 6 hours ago|
Also it isn't clear why governments would only use these models for defense. It seems very likely they would use it for offense as well. So Google's framing is off.
Aboutplants 3 hours ago||
So Anthropic responds sometime between now and when their stock starts trading on Nov 16th. The only question is how much of an improvement will their next release have?
speedstyle 7 hours ago||
'Coming soon'. 2027 perhaps?
aix1 7 hours ago|
The previous model, Argon, was announced on 30 Sep and released on 13 Oct.

https://blog.google/innovation-and-ai/models-and-research/ge...

https://blog.google/innovation-and-ai/models-and-research/ge...

jascha_eng 7 hours ago||
What makes me most excited is that we probably get fable 5.5 soon with the IPO. Which is going to surpass this again. But cool to see progress!
More comments...