Posted by lukaspetersson 3 hours ago
It's just an experiment. But once this gets going, it's going to be interesting. There are a lot of underperforming businesses and CEOs out there. One way to make it after getting an MBA is to find a boring business with an older owner who's lost interest, and work out a deal to run it for a cut of the profits and a stake in the business.
The Andon people mentioned that they've been worried about "a misaligned AI (could) run a business to gather money in order to achieve whatever objectives it might have." That's a basic function of capitalism, so it will happen eventually.
What this adds up to is that when AIs get better at running businesses than many business owners, the "creative destruction" feature of capitalism means AIs ends up in charge of many businesses. The AIs don't even have to be super intelligent, just reasonably good. Reminds me of the remark from a Yosemite park ranger about bear-resistant trash cans: "There is considerable overlap between the smartest bears and the dumbest tourists".
It's going to be hard to stop this without a worldwide crackdown on ownership concealment. The US allows you to have a US business run by a Nevada LLC partly owned by a corporation in Nevis-St Kitts and another corporation in Granada. This isn't even unusual. Try to find out who really owns an oil tanker not owned by a major oil company. Right now, a fund partly run by an AI might have partial ownership.
This is how AI takes over. Not with an army of robots. With an army of LLCs.
[1] https://www.sfgate.com/local/article/san-francisco-market-ai...
I called back after finding the steps were impossible to complete. Would I need to go to the service center to do it?
"Akshually," the AI began, the steps were correct and quite possible.
"No, you hallucinated them," I pushed back.
"I apologize. You're right. There's no way to complete those steps in the app. You will need to go into the service center to do this."
"Okay. Is it open today?"
"Yes."
"It's Labor Day. Are you sure? Since you hallucinated your first answer."
"Let me transfer you to the service center to verify."
That's what I wanted all along, you clinking, clanking, clattering collection of caliginous --
"Tesla service center, this is so-and-so. How can I help you?"
"Hi, I was just wondering if you're open today."
"Yes, we are."
"Thanks! I'm trying to add myself to my wife's loaner vehicle. Do I have to come in to do that?"
"Well, our loaner agreement only allows one person on the loaner. So just sign in to her account on your phone."
"Oh, okay! Thanks for the help."
Good luck running a company on one of these clankers.
The bar will be raised + it'll turn out to require a lot more time & effort than is currently thought to produce something of good quality (even with Fable 6 et al). The smaller utility programs are easy for AI to turn out.
> San Francisco-based startup Andon Labs has put an artificial intelligence agent nicknamed “Mona” in charge at the eponymous Andon Café in the Swedish capital. While human baristas still brew the coffee and serve the orders, the AI agent — powered by Google’s Gemini — oversees almost every other aspect of the business, from hiring staff to managing inventory.
https://andonlabs.com/blog/ai-cafe-stockholm ( https://news.ycombinator.com/item?id=48028289 48 points, 51 comments)
But here's the thing: As we use agents to automate previously manual processes, we are elevating the humans to do work that is less amenable to automation. And the surface area of that work keeps expanding because the competitive market we exist in demands it of us.
To stretch an analogy, businesses are like organisms in a pond. A new nutrient (agentic LLMs) was recently added to the pond that makes business organisms more efficient and able to eat new kinds of food and explore new areas. As a result, those organisms that do the extra exploring and consuming grow much faster than their peers who do not. At the end of the day, the new nutrient will just be part of the pond and the old kind of organism will be a fossil.