Top
Best
New

Posted by bilsbie 1 day ago

There are no new ideas in AI, only new datasets(blog.jxmo.io)
453 points | 247 commentspage 4
nyrulez 1 day ago|
Things haven't changed much in terms of truly new ideas since electricity was invented. Everything else is just applications on top of that. Make the electrons flow in a different way and you get a different outcome.
nomel 1 day ago|
> Make the electrons flow in a different way and you get a different outcome.

This happens to be the basis of every aspect of our biology.

TimByte 14 hours ago||
What happens when we really run out of fresh, high-quality data? YouTube and robotics make sense as next frontiers, but they come with serious scaling, labeling, and privacy headaches
ChaoPrayaWave 14 hours ago|
Feels like we’ve built this massive engine that runs on high octane data, but never stopped to ask what happens when the fuel runs dry. Maybe it’s time to focus more on efficient learning, not just feeding more and more.
SamaraMichi 20 hours ago||
This brings us to the problem AI companies are facing, the lack of data, they have already hoovered as much as they can from the internet and desperately need more data.

Which make sit blatantly obvious why we're beginning to see products being marketed under the guise of assistants/tools to aid you whose actual purpose is to gather real world picture and audio data, think meta glasses and what Ives and Altman are cooking up with their partnership.

russellbeattie 1 day ago||
Paradigm shifts are often just a conglomeration of previous ideas with one little tweak that suddenly propels a technology ahead 10x which opens up a whole new era.

The iPhone is a perfect example. There were smartphones with cameras and web browsers before. But when the iPhone launched, it added a capacitive touch screen that was so responsive there was no need for a keyboard. The importance of that one technical innovation can't be overstated.

Then the "new new thing" is followed by a period of years where the innovation is refined, distributed, applied to different contexts, and incrementally improved.

The iPhone launched in 2007 is not really that much different than the one you have in your pocket today. The last 20 years has been about improvements. The web browser before that is also pretty much the same as the one you use today.

We've seen the same pattern happen with LLMs. The author of the article points out that many of AI's breakthroughs have been around since the 1990s. Sure! And the Internet was created in the 1970s and mobile phones were invented in the 1980s. That doesn't mean the web and smartphones weren't monumental technological events. And it doesn't mean LLMs and AI innovation is somehow not proceeding apace.

It's just how this stuff works.

ks2048 1 day ago||
The latest LLMs are simply multiplying and adding various numbers together... Babylonians were doing that 4000 years ago.
bobson381 1 day ago||
You are just a lot of interactions of waves. All meaning is assigned. I prefer to think of this like the Goedel generator that found new formal expressions for the Principia - because we have a way of indexing concept-space, there's no telling what we might find in the gaps.
thenaturalist 1 day ago||
But on clay tables, not in semi-conductive electron prisons separated by one-atom-thick walls.

Slight difference to those methods, wouldn't you agree?

geysersam 16 hours ago||
No it's exactly the same. Everything old is new again...
anon291 1 day ago||
I mean there's no new ideas for saas but just new applications and that worked out pretty well
Night_Thastus 1 day ago||
Man I can't wait for this '''''AI''''' stuff to blow over. The back and forth gets a bit exhausting.
saltserv 1 day ago||
[dead]
luppy47474 1 day ago||
Hmmm
code_for_monkey 1 day ago|
[flagged]
HeatrayEnjoyer 1 day ago|
Everyone knows we'll always need horseshoes /s