Posted by artninja1988 5 days ago
That was when they realized the deep learning was largely unnecessary, and they could just use their massive compute resources to brute force the problem space.
Proving that we would greatly benefit from using our compute resources for science rather than showing ads, and then we just kept showing ads.
I've been in NLP since the LSTM days and it's hard for me to look at LLMs and not just think they are incredible. It's truly a different level of expressiveness. So much of capabilities research is pointing to LLMs effectively learning a world model.
RLVR is also proving really effective. It is hard for me to imagine a world in the future where LLMs aren't at human level performance across a wide variety of tasks.
I fully acknowledge that current LLM labs have a financial interest in people believing AGI is very near, but from what I'm reading in the literature and seeing myself experimenting with the SOTA models it doesn't seem totally unreasonable.
What evidence are you seeing that makes you confident that AGI in the soon-ish future is a complete myth?
Nobody will buy an AI with enough context to develop critiques of their own organizational structure.
Unfortunately an LLM is not AGI, and video recording is not text.