Posted by yegg 8 hours ago
Software engineers are definitely in a bit of a bubble here. Are we just early adopters who see the value sooner, or does it uniquely benefit software engineering, or do we just like cool automation and we're deluding ourselves that this adds value beyond the cost?
The moment you have to interact with the physical world or humans (psychological, imaginative, aesthetic, etc), there are often undiscovered or changing rules—or no rules at all. Or systems are subject to perturbations beyond a defined scope.
The other thing I believe is software developers are experts at doing the things that allow them to make doing those very things easier and more automated. And they do this in public, perfectly documented online.
Both because of the things I described above and because software developers have created the largest machine-accessible training set for plying their trade of any trade, ML—that is ultimately interpolating massive datasets to do things—is unsurprisingly uniquely successful for software tasks.
The less popular a language, the more models struggle.
Writing, UI, and presentations have similar knowledge bases.
Outside of those, quality becomes much more hit and miss. If you ask for a recipe you may get something good, or you may get something completely inedible and random.
"Domain specific knowledge" really means "strong foundations and relevant abstractions" and LLMs just don't do that reliably.
> Computers should adapt to people. Asking people to make themselves more legible to software — to turn themselves into a database — is a doomed idea.
I've been in software a long time, and I do sort of see this trend, but I think it's because these are tools that build other tools. The interface has always been a 'best I can do for now' thing, with the focus on doing things that are useful. Computers were just calculators in the beginning, which led to more complex calculators, instruction sets, programming languages, operating systems, GUIs, interconnectivity, etc.
What people are doing today is experimenting, like they always have. They're putting their experiments out there so that others can use them and build on them. Some will use those tools to build other tools, and some won't. But over time, the experiments that work will get distilled and turn into real products that people who 'do not yearn for automation' will still want to use, so it seems like the value is there.
I guess the real question is whether they will create value that offsets the near-term costs, because I don't think the billions in investments are sustainable, and I'm not convinced the centralized data center paradigm is the right way.
Looking things up and asking questions was always something for a minority of the population so the language model usage being relatively low isn't a surprise.
Problem arises if the non-AI segment is leveraged to create regulations that impact the AI using segment negatively.
- I'm getting my roof replaced due to hail damage. Insurance originally covered only $5k due to depreciation. I fed the insurance policy to AI. I learned about the appraisal clause and invoked it. At the end, I got another $6,500 back.
- I was having issues with plumbing. Four different plumbers came, they all said the cast iron pipes under the house need to change. Quotes ranged from $35k to $55k. I had AI walk me through the process. It taught me about the yard line vs. under-slab distinction, and suggested getting just the yard line replaced first because it's much cheaper and can fix the issue. I did that and spent $6k. The issue was fixed. I "saved" $30k for now by deferring that massive month-long project. (For brevity, I'm omitting a ton of boring technical stuff I learned about plumbing that helped me make the optimal decision - none of the contractors bothered explaining any of it.)
- My 2010 Hyundai Santa Fe is starting to show its age. I've taken it to multiple different repair shops, then fed their diagnoses and recommendations to AI and figured out which ones are trying to fleece me and which ones are being more careful and conservative with their repair recommendations. Probably saved several thousand dollars there. Learned a lot about cars too!
- My partner and I are converting the backyard to a wildlife sanctuary. The AI helped us plan what to plant where (depending on lots of factors like sunlight location, irrigation access, etc.) and it has been going really well. Also planned out a dragonfly pond to deal with mosquitoes. AI created a project plan, including schematics, material purchase list and step-by-step instructions.
- I've been wanting to do various other home improvement projects, but only ones that make financial sense. I took photos of my house, both inside and outside, and fed them to AI, and said "give me a list of projects I can do that will have high ROI for when I decide to sell this house". It spent 15 mins doing deep research, then came back with a long, prioritized list. If I do all the projects, I'd be spending about $40k and it would improve the house valuation by about $90k.
I can go on. There's probably dozens of stuff that I've used it for over the past year that led to massive time and money savings, and I've learned a ton as well about topics I normally would not have been exposed to or bothered to research myself. And I'm not even including all the work-related usage, both for my employer and my side business. That would be its own very long list.
Everybody is using LLMs/AI. All the time. It's in every facet of your life. Just because you didn't input the prompt, doesn't mean you're not consuming the end product of LLMs all day, everyday, on websites like this one, reddit, tiktok, instagram, facebook, etc.
Addressing the article, if you're hyperfocused on whether people are using AI and only consider AI use a chatbot... well, you're not honestly covering all the AI use out there. And reading the other stats, it seems like this article is trying to paint a narrative. Why is the Datos stat only considering "Desktop use" for instance.
Not to mention their stats are actually astounding and DON'T show what the headline is trying to assert. 1/3 of people using AI regularly is a FUCK TON of people in a VERY short span of time to uptake a new technology.
I also just bought a completely mechanical film camera to learn a new old skill with no tech to fall back on.
Nor should they! It's such a shit thing to be emotionally invested in. Imagine people would have been upset about databases. It's really fantastic software and we should be happy to have it, and now go and make the most of it, for all of us.