DeepSeek V4 Flash 0731: 82.7% on Terminal-Bench 2.1 with a public harness

kimjune01 16 hours ago|

an audit for the bench for the curious:

ubermon 16 hours ago|

yeah, that bench has a lot of room to improve, but it is the best we can find now

polymer8563 9 hours ago||

From README for Ante:

"The core harness itself is developed in a private repository during the alpha"

lost all interest after that sentence, sad thing

freakynit 1 day ago|

Keeps throwing forbidden after logging-in to the dashboard and goes back to login screen. Tried 4 times.

swrrt 22 hours ago|

Oh, it seems fine for me. I can login actually. Maybe network/server instability?

freakynit 18 hours ago||

No idea..