Top
Best
New

Posted by ricardbejarano 1 day ago

Can I run AI locally?(www.canirun.ai)
1237 points | 306 commentspage 12
Yanko_11 17 hours ago|
[dead]
aplomb1026 19 hours ago||
[dead]
A7OM 18 hours ago||
[flagged]
A7OM 18 hours ago||
[flagged]
prokajevo 18 hours ago||
[dead]
uncSoft 20 hours ago||
[dead]
unfirehose 19 hours ago||
[flagged]
remote3body 13 hours ago|
The 'spent 100 hours configuring' part hits home. That fragmentation is exactly why we started building Olares (https://github.com/beclab/Olares).

It’s basically an open-source OS layer that standardizes the local AI stack—Kubernetes (K3s) for orchestration, standardized model serving, and GPU scheduling. The goal is to stop fiddling with Python environments/drivers and just treat local agents like standardized containers. It runs on Mac Minis or dedicated hardware.