Top
Best
New

Posted by networked 9 hours ago

Can gzip be a language model?(nathan.rs)
289 points | 111 commentspage 3
nelox 6 hours ago|
Only if it can run DOOM.
DonHopkins 3 hours ago||
Will Wright once described the same connection from the opposite direction: compression as procedural content generation.

In the 2023 discussion of "Demoscene accepted as UNESCO cultural heritage in The Netherlands" I posted a transcript from a video of Will Wright discussing the demo scene:

https://news.ycombinator.com/item?id=36599415

Will Wright Discusses the Demoscene:

https://www.youtube.com/watch?v=m7iuFVmTJus

>You can take any piece of content in the game, and imagine an algorithmic solution to it. Or also, you know, a way that the player could customize that object of thing.

>There's this group in Europe called the Demoscene that make these very elaborate demos for a computer that fit into very tiny little memory blocks, you know like 64K of memory, and you run the thing, and in fact it algorithmically generates about 100 megabytes worth of data, you know these rich 3D environment, generated music, generated wave files, generated animation.

>And they're developing techniques to generate, you know, huge amounts of interesting data, with very very simple, elegant, compression algorithms.

>And this is a skill that game developers used to have, back in the 8-bit days. That was the only ways to do a game like Karateka(?), was to find all these little tips and tricks to compress things and generate them algorithmically.

>But since the CD-ROM came out, and very cheap hard drives, storage is cheap, so basically we've lost that skill set, and now we attack all those problems with brute force. I think we've lost something by dropping that skill set.

[...]

https://news.ycombinator.com/item?id=36613058

[...] Here's a simple low-tech pre-LLM example that shows the equivalence of compression and procedural content generation:

Take a huge text file of HN postings, and compress it with gzip or compress or some other robust compression algorithm. The better the algorithm, the more the output will look like random noise. Then slice the compressed file in half, and replace the second half with random numbers. Then uncompress it. You'll find that at the point you sliced it, it keeps on writing out almost plausible text for a while, consisting of highly probably snippets of commonly encountered words and phrases, then goes downhill towards incoherence. It's not as coherent or confident as an LLM, but the point is to show how low the bar is for using compression for procedural content generation.

LLMs are essentially a form of compression of the world's knowledge or whatever they're trained on, not just word frequencies or pixel patterns, but also concepts and ideas. [...]

mohd_rafay 2 hours ago||
[flagged]
kindkang2024 3 hours ago||
[dead]
greengemz 2 hours ago||
[dead]
fr2029 6 hours ago||
[dead]
0x20cowboy 7 hours ago||
[flagged]
relevant_stats 6 hours ago||
Yay, another mostly AI authored piece with vibe-coded aesthetics.

Some will say that I should 'judge the idea, not the form'.

But if the author didn't find enough strength to write alone a short ~700 words summary about his work, it means he himself isn't that interested or enthusiastic about it. Why should others bother then? Particularly since low-effort like that signals possibility the whole work is superficial and derivative.

marand23 6 hours ago||
I thought it was interesting.
relevant_stats 2 hours ago||
so did I, that's why I clicked.
DonHopkins 3 hours ago||
I'm judging the ideas in your post, not its form.

Your claim that suspected AI assistance proves the author isn't interested -- and therefore that the work is probably superficial -- is unsupported.

The article presents a working experiment, explains why naive decoding fails, describes the beam-search fix, and links the code.

Dismissing all that with presumptuous personal speculation and banal boilerplate drive-by anti-AI snark adds absolutely nothing to the conversation -- and that is intrinsically poor form.

You couldn't even find enough strength to criticize anything beyond the form, while your own form is lackluster.

Ironically, an LLM could have written your comment and improved its form without losing anything distinctive.

relevant_stats 2 hours ago||
> I'm judging the ideas in your post, not its form.

and simultaneously you write that 'my form is lackluster' and that 'an LLM could have written your comment and improved its form without losing anything distinctive'. We are having ourselves a small contradiction, aren't we.

Be my guest, enjoy chatbot writing and drowning in slop. But don't encroach upon my freedom to protest it.

DonHopkins 2 hours ago||
Ironic, isn't it? Yet you continue your lackluster form devoid any criticism of ideas. All you can criticise is form, yet my criticism of your ideas still stands:

Your claim that suspected AI assistance proves the author isn't interested -- and therefore that the work is probably superficial -- is unsupported.

So I'm encroaching but you're only protesting, huh? I also have the freedom to ironically protest the poor form of your inability to criticize ideas, as well as your poorly formulated unsupportable ideas.

relevant_stats 1 hour ago||
> Ironic, isn't it? Yet you continue your lackluster form devoid any criticism of ideas.

Pointing out someone's contradiction is now being 'critical of form'? And someone's contradicting themselves is 'ironic'?

Now I'm not even sure you know the meaning of words you use. EOT from me.

bob1029 8 hours ago||
Not without attention or something approximating it.

The fact that gzip is relatively fast should be your first clue that something important is missing.

Gzip is great at predicting the next token for one very specific narrative. LLMs can predict next tokens for entire universes of narratives. Searching for the correct next token across this space scales ~quadratically with the input size. Gzip scales linearly. I can gzip a one terabyte file. Imagine feeding that much into an LLM. These are wildly different animals that happen to overlap in a very small way. Equating compression to intelligence looks increasingly silly to me.

If we must compare language models to compression, they are much more like jpeg and mp3 than they are gzip and flac. I can go fuck with a jpeg file pretty severely at the bitstream level and still have something resembling performance on the other side. Gzip cannot remotely approach this.

Retr0id 7 hours ago||
> Gzip scales linearly. I can gzip a one terabyte file.

In part because gzip only has a 32KiB window size, and I think it'd be at least quadratic within that window if you were going for optimal compression.

bob1029 7 hours ago|||
I'll concede the window part, but Gzip runs within the physical confines of a single cpu core and is typically entirely resident in local caches. The point is not just the quadratic scaling but also what it scales with.

Show me an LLM that can run at 300 megabytes per second. Even dedicated ASICs with weights burned in will never move this fast.

pishpash 6 hours ago||
It won't move as fast as gzip provided the same resources, but to say that LLM's can never run at 300mbps on any hardware is ... a bold bet.
Sesse__ 7 hours ago|||
Match-finding does not need to be quadratic. However, truly optimal gzip block splitting is very slow, indeed.
fedeb95 7 hours ago|||
I agree, but also equating LLMs with intelligence is wrong.
amelius 8 hours ago||
Perhaps a better question is if LLMs are used as compressors, how well is that expected to work.
magicalhippo 7 hours ago|||
> if LLMs are used as compressors, how well is that expected to work

Quite well. This project[1], by Fabrice Bellard of ffmpeg fame, is quite old in AI years and uses an ancient LLM, but still beats xz by a solid margin.

[1]: https://bellard.org/ts_zip/

amelius 6 hours ago||
Makes me wonder if compression ratio can be used as a measure for intelligence. Any benchmarks using it?
magicalhippo 6 hours ago||
> Any benchmarks using it?

A challenge as I understand it is reproducibility.

Normal LLM runtimes aren't typically fully reproducible even with same random seeds for distribution sampling, due to floating-point numbers, batching and such.

Though averaging over many runs could alleviate that I suppose.

While it would measure some aspects of intelligence, I'd argue it fails to capture other, more creative aspects.

Retr0id 7 hours ago|||
Extremely well, aside from speed.
bob1029 7 hours ago||
> aside from speed.

And energy consumption.

K0balt 6 hours ago||
I wonder if, on an information theoretical level, compression radiates heat, and decompression absorbs it?
segmondy 3 hours ago|
I think not. it's true that a large language model compresses knowledge and allows us to decompress knowledge. but gzip compresses data and not knowledge. with a LM you can decompress various forms of knowledge from the same data. gzip is a 1 to 1 kind of decompression where as an LM is a 1 to infinity kind of decompression.