Posted by u1hcw9nx 8 hours ago
And yes, it is just a next token predictor.
LLMs are a great search tool. It searches connections in the collective human knowledge that humans have written down through all the years....
They are very good at it, and that is about it.
You’re not really understanding how the tech works if you find it hard to comprehend.
Remember when they said it didn't sound like Claude anymore
--. --- / ..-. ..- -.-. -.- / -.-- --- ..- .-. ... . .-.. ..-.
All of these breakthroughs are in verifiable brute force domains, and some of them are probably wrong because of a typo in a lean specification or just a base level axiom being incomplete.
I think the better the way to think about LLMs is like they are new substances, like when we first discovered clay or bronze, but confined to the digital realm. Previously we were chipping away at stones trying to make to things as close to useful as possible, then we found a step change. LLMs are like clay but they have their limitations. Wake me up when they are proposing new, { conjecture: interesting|useful|new } and not as a side effect of trying to get to a goal.