Top
Best
New

Posted by xtreak29 12 hours ago

Discovery Loop(www.discoveryloop.com)
629 points | 394 commentspage 9
aaroninsf 3 hours ago|
You know what will be a good day?

When the "AI community" GTFO X and stays off.

Toxic site. Toxic ownership. Unbelievable bot activity. Indefensibly shitty politics constantly boosted.

Continued participation is a stain on every company and person who continues to use it.

There are alternatives. Don't like them? Make a better one.

Stop using that shithole.

calufa 11 hours ago||
As LLM coding agents plateau— at least for the average engineer without tens of thousands of dollars or swarms of agents to run —I’d say that, from here on it’s going to be about ASICs, specialized LoRA/or-equivalent models, or a Ruby on Rails for LLM context engineering and orchestration, which LangChain and others seems well position, including Google as they own the entire stack. LLM free lunch has been over for a while, perhaps since the ReAct loop, and has been official since Ilya mentioned it at NeurIPS.

I feel the most exciting development these days is self-evolving agents. Especially if you have a way to verify their outputs with a formal system, or with a system developed since the 60s by armies of PhDs.

DeepMinds Gnome is a good example, where they use DFT to verify outputs. Approximating NP-problems is always fun for those who dare.

I am also building in this space. Its a mix between HPC, AI, and hard science. Pretty fun compared to waking everyday to LLM news that seem more like marketing stunts.

aoeusnth1 11 hours ago||
Sounds like you get your news from 2024 when people thought things were plateauing after GPT4?
zuzululu 11 hours ago|||
we definitely haven't hit plateau yet. I think a lot of people latch on to anti-LLM narratives without really thinking things through.
deeviant 11 hours ago||
LLM coding isn't even close to plateauing. Right now, the major players are in a consolidation step, focusing more on economic efficiency but still not at the point where we're ready to start burning models to hardware and freezing the line.

They are straddling the line between pushing it forward, and justifying the business case. It's hard to do both at the same time.

calufa 11 hours ago||
LLMs are hungry for tokens. Every day I see more startups claiming token usage at 50-100k per month. You can always brute-force your way in - just see HuggingFace's recent attacks.

If throwing more money at inference while accumulating compounding technical debt is the new norm, then we are not solving the problem, and the solution space is already covered.

Perhaps there are marginal gains at the expense of quadrillion-params LLM models with 10x the cost and energy. We are simply making inefficiency more expensive, camouflaged by VC money and great marketing.

If that is not plateauing, then I guess I will have to reconsider what plateauing means.

bpodgursky 10 hours ago||
> You can always brute-force your way in

This is such unbelievable revisionism! Can you imagine in 2022 saying "Oh of course you can brute force your way to AGI if you spend enough money per month". Nobody thought that! Come on!

AmbroseBierce 6 hours ago|
"the benefits of science and technology to the world" just like AI has brought such benefits? Because I haven't seen them, for example it hasn't helped reduce inequality (nor poverty), or reduce climate change, or pollution, or daily stress, if anything it seems to be worsening some of these issues.

So forgive me if I'm skeptic when renowned AI scholars claim to start something for "the benefits of science and technology", because it really seems like we have very different definitions of these words.