Top
Best
New

Posted by adunk 12 hours ago

How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?(dunkels.com)
93 points | 31 comments
mintflow 1 hour ago|
This is cool, let aside the token usage, perhaps it can help analyze tcp throughput by redirect wire shark/to dump result
fl7305 55 minutes ago|
Opus 4.6 is already very good at troubleshooting all kinds of network problems if it has access to the command line tshark tool and the pcap files.
fl7305 54 minutes ago||
Do some people still claim "LLMs are just dumb auto completers"?

Because this seems to disprove that claim pretty convincingly?

mystifyingpoi 21 minutes ago||
Oh, they are. It's just that the harness around it is able to pick up the commands it "autocompletes" and runs them for you. LLM can't run anything, it never could.
AlienRobot 8 minutes ago|||
It proves that code, specifically any code in the form of bytes, is, too, language.
huflungdung 47 minutes ago||
[dead]
ShinyLeftPad 3 hours ago||
How quickly claude responds when it acts like a user space LLM chatbot?
fouc 5 hours ago||
think about how much faster it would've been with a small local model!
twoodfin 4 hours ago||
Modulo Anthropic messing with the model for load mitigation, I wonder how stable this result is.

1,000 pings, how many correctly ponged?

ValdikSS 8 hours ago||
That's why LLM will eventually be used only for initial interaction between the user in their language, to prepare the data to a specialized model.

Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...".

FeepingCreature 4 hours ago||
That's actually how vision language models already work, pretty much.
wongarsu 1 hour ago|||
And there's a reason nobody uses them for face recognition

Vision language models are an incredible achievement in the generality and usability. But they pay a hefty price in fidelity and speed

stingraycharles 4 hours ago|||
Huh? The images are tokenized in the same way language is and it’s just fed into one single model. Not multiple smaller expert models.

Image gets rasterized into smaller pieces (eg 4x4 pixels) and each of those is assigned a token, similarly how text is broken up into tokens. And the whole thing is fed into a single model.

FeepingCreature 3 hours ago||
Yes I'm saying

> Imagine face recognition to work like a text chat, where the PC gets the frame from the camera and writes in the chat: "Who's that? Here's the RGB888 image in hex: ...".

that's p much how it works.

stingraycharles 2 hours ago||
But that isn’t a specialized model like the grandparent claimed, but rather a single, multi-modal model.
Dylan16807 58 minutes ago||
Yes, the "imagine" was showcasing the opposite of a specialized model to call it a bad idea.
stingraycharles 4 hours ago||
Do you know that MoE is a thing?
jampekka 4 hours ago||
The experts in MoEs aren't specialized in any meaningful task sense. From level of what we would think as tasks MoEs are selected essentially arbitrarily per token and per block.
stingraycharles 4 hours ago||
It’s unsupervised, yes, but “unspecialized in any meaningful task sense” is incorrect, that’s the whole point. It’s just not in the sense of “this is a legal expert, this is a software developer”.
bot403 3 hours ago||
Now do the equivalent of just in time compilation. Claude sees that we need to respond to a lot of pings and writes a program to compute it instead of thinking about each one.
self_awareness 26 minutes ago||
If you wonder why your Copilot subscription has new limits that you hit every few days, it's because of PhDs like Adam.

Could Adam use a local model hosted on his own box? Probably yes. But he preferred to waste the service we all use just to produce a weak blog post that introduces absolutely no knowledge and serves no other purpose than to tell everyone that the author likes to waste resources and calls it "fun".

> Ridiculous? Yes. Wasteful of tokens? Sure. Fun? Oh yeah!

Do you really think it's fun to be one of these people who are the reason why the rest of us gets more limits?

mystifyingpoi 23 minutes ago|
Don't hate the player, hate the game.
self_awareness 5 minutes ago||
No.

In our lives, the game we play, we can do whatever we like. There are consequences for some things, but generally we can do lots of things.

We can kill people and get away with it. We can also help them.

Should we hate life because it's possible to do really shitty things in life? I don't think so. We should hate the "players" who actually do shitty things.

ForHackernews 1 hour ago|
>Fun? Oh yeah!

I think this author and I have different definitions of fun.

More comments...