Top
Best
New

Posted by vednig 2 days ago

Open source AI must win(opensourceaimustwin.com)
1577 points | 471 commentspage 5
jpalomaki 2 days ago|
Isn't training material the biggest problem for truly open source LLMs (such that could compete with top tier models)? The computation part can be solved with money, but compiling a comprehensive training set that could be freely shared and free of copyright issues is pretty much impossible.
ajdegol 2 days ago||
I wonder if we could gamify and democratise it somehow, like fold-at-home and wikipedia...

I've been training a teeny specialised model to run in a browser on a phone to detect harmonium notes played in a song (harmonium turns out is a pita, another story for another day), getting good labelled data is _all_ of the hard work.

That being said, maybe for cheap inference, using a big model to train something ultra-suited for the task at hand might be how we could handle local inference; thinking language specific models.

reedciccio 2 days ago|||
You don't need to have fully copyright-unencumbered datasets to build Open Source AI, as that (as you say) would be impossible. https://opensource.org/ai
dorfsmay 1 day ago||
Didn't the courts decide that if it's just for learning everything is fair game?
jcadam 2 days ago||
Well, the crazy thing I'm working on (100% self-funded thus far): https://trivyn.io. The main idea is moving most of the reasoning to the symbolic layer so the "neuro" piece can be a small model able to be self-hosted on reasonable hardware.
zuzululu 2 days ago||
It can't.

Hear me out, economies of scale can only be met when there is a large enough liquidity for it.

The amount of people willing to purchase multiple hardware releases year after year just to run LLM is already tiny and businesses already do use their own hardware and there is no desire for manufacturer to reduce their own margins.

dinkumthinkum 2 days ago||
If any AI wins, how can that be good for humans? It's high minded but if any AI wins, why would any of "The ability to study, build, repair, deploy, audit, adapt, teach, preserve" be important? Is the real problem to be solved something else, if you want those things?
gigel82 2 days ago||
But if "they" stay on the current trajectory we'll never own hardware capable enough to run the open source AI. They want us to rent everything from the cloud and never own it. If a government-supported cartel forms around this idea (which appears to be the case) that's the end of it.
MobiusHorizons 2 days ago||
If open source AI was better than what it is currently chasing, wouldn’t that take away the incentive for these companies to give it away for free? Training is expensive and companies will need to recoup those development costs once it stops being about jockeying for position.
tim333 2 days ago||
The article doesn't say what it means by win. I presume we will have the present situation where the cutting edge stuff is closed source developed by profit oriented companies and open source is available two but a year or two behind.
shafkathullah 2 days ago||
Truly, big corps have no incentive to invest in open source local AI. I maintain a small effort towards this goal here at https://pocketweb.tools/
pipeline_peak 2 days ago||
Open source projects are only successful when they make what they replace obsolete. This worked with Linux and GCC but this isn't gonna work with LLM's.

Who's gonna pay to power an open source AI? Will it perform well enough to make Chat-GPT and Claude obsolete?

MaxPock 2 days ago|
Were it not for China, America would have restricted the most advanced models from being used outside the US. NATO members would have access to GPT-4, with some countries entirely blocked from AI.

Biden's GPU controls should give you an idea. Thank you, China. Open source AI must win.

thewebguyd 2 days ago||
Unfortunately the US is no stranger to using export controls to restrict frontier technology.

Famously, the PowerMac G4 was briefly subject to export controls. Apple turned it into a marketing campaign.

sanex 2 days ago|||
Just happened 5 hours ago.
nerfbatplz 2 days ago||
China unironically saved humanity. I'm no fan of the CCP but if they hadn't organized an effort to compete with the US no one else would have done it and we'd be begging our AI overlords for tokens and praying we don't get caught conducting wrongthink.

Go ask Claude to criticize Anthropic and see how long your account stays active.

More comments...