Top
Best
New

Posted by tedsanders 5 hours ago

Advancing the price-performance frontier with GPT‑5.6(openai.com)
427 points | 280 commentspage 4
peheje 5 hours ago|
Might just resub. Will experiment with Luna next sessions. 5 h window is not working very well for me. But if I can drop down to Luna at 20-30 % left and comfortably ride out the wave then.. that might just work.
arcanemachiner 4 hours ago|
They got rid of the 5hr quota, it's just weekly quotas now.
gck1 4 hours ago||
They're supposed to bring 5h today.
sosodev 5 hours ago||
Looks like I might have a reason to use something other than Deepseek V4 Flash.
andai 5 hours ago|
I was curious so I photoshopped DSV4 Flash into the graph:

https://files.catbox.moe/csxl32.png

(2 cents to run AA index, score 40)

Looks like OpenAI broke the pareto frontier on the trust-me-bro benchmarks!

(One has to wonder if they used any of the neat tricks from the DSV4 paper :)

guybedo 3 hours ago||
gpt 5.6 luna was already at the intelligence/cost frontier and it's now even cheaper ...
baalimago 4 hours ago||
We swapped an internal system from gpt-5-mini to gpt-5.6-luna and saw no benefit but 4x cost. Sufficed to say: we swapped back to gpt-5-mini.
gbnwl 4 hours ago||
Experienced similar between 5.4-mini vs 5.6-luna in our own pipelines but after spending some time on prompt optimization and testing out various reasoning effort levels 5.6-luna was well worth it. Did you just replace model selection while keeping everything else in place or spend some time on evaling with newer prompts etc?
baalimago 4 hours ago||
No we kept prompts as is, just swapped model. The prompt is already quite optimized for the task. How would updating it possibly make a more intelligent model spend less tokens than a less intelligent model? Care to elaborate?
Tankenstein 4 hours ago|||
Most of the time when upgrading models we have needed to change prompts to get the same performance (let alone better performance). Usually, your prompt is overfit to the specific model doing the specific task. For example often your previous prompt is overspecifying and creating contradictions that a dumber model would just gloss over whereas a smarter model will try even harder to follow.
steveklabnik 3 hours ago|||
Here is an example of a guide from OpenAI on how you should prompt 5.6 differently than their previous models.

https://developers.openai.com/api/docs/guides/latest-model#p...

StilesCrisis 3 hours ago||
So now presumably it'd at least be roughly equal cost, or maybe a little less?
fractorial 5 hours ago||
It would appear that rolling my own Anthropic-free harness / serving stack with a closed-weight carve out for Codex models is an absolute win.
swingboy 5 hours ago||
This is awesome. Luna is a pretty great model on xhigh.
alvis 5 hours ago||
Basically lunar at extra level can cover all use cases scenarios other than those requiring opus up. Goodbye sonnet and haiku
jnakano89 5 hours ago||
Seems like they cut the tiers(GPT-5.6 Luna) where GLM and Kimi compete and still held margin for their frontier models
goldsmith112 5 hours ago|
Not sure who would use Terra anymore. Pair Luna High/Xhigh with Sol Medium and that's your power stack
fritzo 5 hours ago||
Sounds reasonable. Is there a good benchmark on which make this decision?
espadrine 5 hours ago||
I maintain this meta-benchmark leaderboard: https://metabench.organisons.com/

With this new price change, Terra does look pretty Pareto’ed by Luna.

On agentic coding, pairing Sol Medium for architecting with Luna High for coding does kinda make sense. But beware that architecting can be very read-heavy, and Sol is a bit read-pricey compared to Terra.

Argonaut998 1 hour ago||
Thanks, I was looking for something like that
andai 5 hours ago||
Sol as main agent, Luna for coding?
More comments...