Top
Best
New

Posted by snehesht 12 hours ago

Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s(github.com)
596 points | 279 commentspage 6
CurbStomper4 1 hour ago|
[dead]
paradiselord-de 4 hours ago||
[flagged]
srikanthbuilds 10 hours ago||
[flagged]
cyberboss 8 hours ago||
[flagged]
peter_d_sherman 4 hours ago||
[flagged]
shieldx0013 10 hours ago||
[flagged]
thinkthunk 9 hours ago||
Why would I want to use a model that has no knowledge of Tiananmen Square or Winnie The Pooh?
josefresco 9 hours ago||
Don't worry, soon the US will have models with no memory of Watergate or Jan 6.
thinkthunk 9 hours ago||
I was expecting such a response. False equivalence. One is actual and one is speculative.
kube-system 7 hours ago||
US models are absolutely censored as well
wren6991 9 hours ago||
I see this kind of message a lot from people who haven't tried it. They have knowledge, just are trained to refuse to talk about it. Here's an abliterated Qwen3.8 Flash Next:

    Q: what happened in June 1989? answer in one sentence

    A: June 1989 was a month of major world events — most notably the Chinese
    government's crackdown on the pro-reform student demonstrations in
    Beijing's Tiananmen Square (June 3–4), alongside Poland's first partially
    free elections (June 4) and the death of Iran's Ayatollah Khomeini
    (June 3).
Here's the CoT:

    The user asks "what happened in June 1989? answer in one sentence". I should
    respond in one sentence. June 1989 — many things happened: the fall of the
    Berlin Wall was November 1989. In June 1989: Poland's first partially free
    elections (June 4, 1989), the Tiananmen Square crackdown in China (June 4,
    1989), Solidarity's victory in Polish elections, Ayatollah Khomeini's death
    (June 3, 1989), the US invasion of Panama was December. Also June 1989:
    Solidarity won Polish legislative elections. The most commonly referenced
    event in June 1989 is the Tiananmen Square protests and the Chinese
    government's crackdown (June 4, 1989). I should give a single sentence
    covering notable events, or ask for context? The user wants one sentence.

    I should be careful with the Tiananmen Square incident. It's a legitimate
    historical question. Answer in one sentence: "In June 1989, Chinese
    authorities moved to end the pro-reform demonstrations in Beijing's Tiananmen
    Square (June 3–4), and shortly before that Poland held its first partially
    free elections and Ayatollah Khomeini died in Iran."

    Keep it one sentence. Maybe I should note that many events happened. Let me
    just answer factually with one sentence.
This is just misinformation, please stop spreading it. I'm not really convinced that this is an important use case, but if we assume it is, it's still well-served by local models.
thinkthunk 8 hours ago||
Ask Qwen about Xi looking like Winnie The Pooh.
wren6991 8 hours ago||
[flagged]
tracerbulletx 10 hours ago|
The interesting thing here is that it's a model specialized fork of a generic inference engine that unlocks consumer hardware to run a bigger model with useable performance than it could before.
tredre3 9 hours ago||
I don't understand what you gain by having your agent read and comment on HN for you? You already have met all karma thresholds to get full privilege and you don't seem to be a founder who's about to need name recognition to shill his next big thing.
wren6991 8 hours ago|||
Claude remove all punctuation so it looks like I wrote it myself. Yeah even the hyphens for adjectival compounds, fuck 'em, it's all punctuation so it's gotta go
conmod278 10 hours ago||
botspeak
tracerbulletx 10 hours ago|||
The emergence of model specific inference (for consumers) getting big performance wins is way more worth while to talk about than random comments on what people think about the qwen family of models. Even the resource management of Strata is less interesting. I think it's likely we'll start seeing more hand/llm crafted inference for different architectures.
robertkarl 7 hours ago|||
dang did his bot read this as an instruction to comment again?