Posted by gmays 2 hours ago
At 1c it might even be a default choice, I'll definitely try it out.
I had this thought yesterday, the era of developers picking tech is probably over. Microsoft's wheelhouse is selling to upstairs.
They're going to eat everybody's lunch that is still playing the old game of selling to the devs.
Don't really know when that era ever existed
It's the modern era version of "Nobody ever got fired for buying IBM"
> Decision 1.1 provides model routing integrated right into your applications so that the bigger, pricier models are only used when you really need them. On the AA Decision Index Microsoft is ahead of Jev, Google and OpenAI, while being faster and cheaper. Used by 4,000 customers, it’s 50x faster and 79x cheaper than GPT-6.1 Sol.
"My budget gives me 100 million tokens for GTP 6.1 SOL. How many tokens for this new model would I get? Let me quickly divide by 0.0126 in my mind to figure it out."
x times more/less is the simplest form of comparison because bigger value is divisible by lesser value. I'm saying this because we first teach children division and multiplication and only then fractions.
To me, this smells like the same trick I always see in claims about model routers. As in, running against a saturated benchmark then showing huge cost savings for a tiny performance drop (because almost any model will perform well).
Looking deeper, though, it looks like they are citing four benchmarks, only one of which is basically saturated (Terminal Bench 2.1).
On the other hand, on 2/4 of these benchmarks Sol 6.1 does better than Opus 5.5, which just doesn't pass the sniff test, so my conclusion is that these are cherrypicked benchmarks.
>Take a frontier MAI model, customize it using your proprietary data if you want to. Then run it securely in your own Azure environment.
Ohh Microsoft. Is it really my environment if it’s Azure ?
Anyway I wonder if GitHub Co pilot will start auto routing to these new models. All those gamed efficiency metrics sure do look impressive.
This whole article is strange. It’s as if Microsoft is seeing the Anthropic IPO and saying “um we have models too”
I take your point but for lots of enterprises that already use azure this will be attractive
Anyone else read John Lilly's stuff on SSI and laughed while reading that? Or at least, I imagine SSI is laughing ;)
[1] https://blogs.windows.com/windows-insider/2021/12/07/redesig...