Top
Best
New

Posted by tosh 11 hours ago

DeepSeek V4 Flash 0731(arcprize.org)
522 points | 311 commentspage 2
arjie 9 hours ago|
It's not frontier, but it's far past what we had at the beginning of the year. It's very usable. I get great instruction compliance, tool calling, and with a trivial workflows flow it has very good long-running performance as well.
LeBit 3 hours ago||
I always find it confusing that a meaningful volume of the comments are saying "this reached parity with SOTA models. Best $/task."

And a meaningful chunk of the comments are saying "this piece of garbage isn’t even at the level of gpt-oss 20B".

wolttam 2 minutes ago||
Yours is the only mention of GPT-OSS in the whole thread. I count about 2-3 comments saying the model is meh and many more saying it’s a big step up.

I am among those with real life experience with the model that used the previous as well and will attest that the new model is a big improvement

freakynit 46 minutes ago|||
I was in the first group up until last week.. now, the second one.

For anything even moderately complex.. like, even low end of complexity, this model behaves maximum like gpt-5.6-luna-high .. nothing more.

Yesterday itself I gave it a coding task in some existing moderately complex small project, and i was using xhigh thinking effort, it was unable to cover all edge cases... and i had already got it to review, and then fix, 3 more times, after the first initial one.

Still it left 2 edge cases.

Then, reverted full code, gave sol-high the same task, it took well over 20 minutes, and completed it in one go with zero edge cases remaining.

I am not using it for anything serious anymore.

ddxv 1 hour ago||
I guess both are true and for everyone at some point. All models, even SOTA, fail. When they fail, it is quite frustrating. Additionally, some models are very cheap to run and use. When Deepseek fails the cost was minutes and pennies.
walrus01 9 hours ago||
Oke of the great advantages of v4 flash 0731 is that even in the largest size unsloth quantized gguf, Q8 K XL, it will fit well within the resources of a 256GB DRAM server. If you have no gpu at all and are okay with setting up a workflow that handles slow token per second rate, give it a task and check back in 4-6 hours, it works great. And remember to give it more lengthy tasks to run overnight. Whatever workflow you set up, the idea is to keep it busy 24x7 doing different things in parallel.
jacquesm 2 hours ago||
This is the best model to come out since the beginning of open weights models for those working with classified data that you can not use hosted services for. I've been using it pretty much day and night since it landed and I'm nothing short of amazed. You'll need some pretty good hardware to run it though.
zacksiri 1 hour ago||
I'm not sure about all these benchmarks, I did some very simple tests (I have my own benchmarks https://upmaru.com/llm-tests) and these models fail, not sure if it's the inference provider or the model. They seem to be optimized for benchmarks more than real use cases. Do anything outside their distribution (even if it's not complex) they fail.

I Compared Deepseek V4 Flash 0731 (low) to Gemini 3.5 Flash Lite (minimal) and GPT 5.6 Luna (no reasoning) and Deepseek V4 Flash 0731 gets it wrong alot, where as Gemini and 5.6 Luna just gets it done.

theogravity 1 hour ago|
You're using it on low, that's why. There's a huge difference in performance from low to max effort.
zacksiri 51 minutes ago||
I’m comparing same / similar settings between models. I can’t use high on one and low on others it’s not a fair test.

Not sure why I was downvoted. But seems the downvoter is quick to downvote anything that doesn’t fit the narrative they’re looking for. I’m just reporting my findings.

kromem 7 hours ago||
Flash is a delightful model and the start of intelligence at effectively insignificant cost.

From here on, it's going to become all about harnesses that best situate and organize swarm intelligence at scale.

SwellJoe 9 hours ago||
DeepSeek is my cheap and cheerful Chinese model of choice for API use. Has been for a while, but now it's Flash instead of Pro. Even cheaper, and now better then Pro. I feel like most of the major Chinese models are benchmaxxed, they have weird quirks every time I use them (Qwen 3.8 Max doesn't check its work and leaves stuff broken, doesn't write tests unless prompted, etc., Kimi ends up being quite expensive and rarely better than GPT Sol or Opus 5), while DeepSeek models seem to be generally as good as the benchmarks indicate: Not the best, but stronger across the board than any model within an order of magnitude of its price.
eli 9 hours ago|
Qwen 3.8 Max is very strong at troubleshooting and code review.
SwellJoe 9 hours ago||
I'll grant it's very thorough when assigned a troubleshooting task. I'm not as confident of its code review though it is very good at security vulnerability auditing, and isn't hobbled for that work like Fable, and even Opus refuses some work in that area now.
g023 2 hours ago||
It says 'yes' where the others say 'no'. Good enough for me.
apitman 7 hours ago||
These are very interesting results, and honestly hard to believe, even as a big 0731 fan.

If I'm reading the chart correctly, a couple observations:

* deepseek-v4-flash-0731 max is better than kimi-k3 max

* glm-5.2 is dumber than a box of rocks (this must be on low reasoning or something, right?)

This is way more extreme than other results I'm seeing, like those from Artificial Analysis.

dools 6 hours ago|
I have been using deepseek v4 pro almost exclusively. I was using Kimi a lot but it just nose dived. The decline started with the release of 2.7 and accelerated with the release of 3.

When I need vision capabilities I use GPT 5.3 codex and if deepseek can’t figure something out after a few goes I switch to GTP 5.5 or 5.6 (I’ve been giving Terra first bite recently and it does pretty well, and have used Sol a couple of times).

Using this regimen means I spend under $100 per month on inference and I work all day everyday with multiple agents running simultaneously all on API token spend not subscriptions.

More comments...