Posted by bkd9 3 hours ago
That's why 'stackoverflow programmers' will have a hard time competing with LLMs but engineers are still needed for their intelligence.
Well that's just my 2 cents.
Btw. an advanced search engine is probably the worst comparision i have read so far.
A LLM is a latent space which is capable of a lot of things a search engine can't do. It can apply different type of patterns and flows onto data, it can combine these etc.
My 'advanced search engine' was just able to create a working PR for exactly what i wanted it to solve (fixing a bug) by analysing the bug, finding a valid solution then commiting the solution itself.
But you forget all development today is just searching for a template, copy pasting, changing some small things. And a smart-ish search engine can do all that.
It's not different. The delusion humans have is that intelligence is special and magical. It's not. It's just nature's prediction machine. A very fancy version to be sure. But not qualitatively different .
All statements that "oh but it'll never be able to do that" will prove false.
Artificial intelligence is artificial. It can still be called intelligent, just not the same kind as biological since it's not remotely biological. It's human-like but also alien. To have something artificial be human you'd need something like replicants from Blade Runner which are synthetic biological robots.
I remember in one of the Hugging Face incident threads here, simply acknowledging that the agents were operating autonomously was super controversial. Thousands of years old concept [1], still inherently human for a lot of people.
To be clear, I'm not trying to be judgemental with this, I more consider it to be a communications breakdown, and find that to be frustrating instead. I'm not really sure how to meaningfully help it either, cause no matter how one slices it, you will in the end ask these people do desecrate these terminologies in favor of some more twisted-seeming ones. Same the other way around, the humanist understanding of these terms is basically non-workable.
[0] as opposed to personification, which is what people are actually doing almost always: https://en.wikipedia.org/wiki/Personification
Pretty much already happening
Surprisingly, some of the small models would not only give worse results, but also took longer than Mistral, because they were thinking so much.
That is an important detail which I was previously overlooking.
all the US economy is tied to video cards being used in lieu of gold. cost dropping 100x means the economy bottom falls out.
Even if its not intelligence, a LLM found a bug due to one error message, fixed it, created a PR and it solved it.
If an LLM is only able to do all of this after training on it and never achieving AGI, we already at the point were it is cheaper to teach one LLM one problem than teaching humans to do so.
Just like real life!
If we're going cynical, may as well go full throttle.