Posted by poisonfountain 20 hours ago
It's still funny that 4 years into this mania the models can hallucinate basic ground truths, humans are increasingly not reviewing the output, and misusing LLMs where simple automation would suffice.
My wife does project management and works with a lot of tech leads. They came to her with a project plan deck, and she started questioning some weird dates.
The LLM was able to pull artifacts out of their issuer tracker, but it just.. hallucinated some of the dates in the process of creating a project plan deck out of the underlying data. These guys didn't care to review and notice, and who knows what else it hallucinated content wise. They were happy to send this project plan multiple levels up the food chain with hallucinated unreviewed dates.
5 years ago they would have just written a script and had none of this mess.
Instead of directly: do this.
Preferably I would interweave code and AI queries where some function waits on prompt result too I think?? To avoid too big context hallucinations
I mean that would work for my use cases.
At least what I learned is that the less AI itself does in the context is the better so to say as critical LLM mistakes are approaching 100% of probability over time.
There are a lot of non-tech people using these products in this manner.
Along these lines my friend is CTO at a non-tech firm and theres vibe coding happening in one department on a project that is going to churn $1M of tokens. Head of that department told him it's OK because instead of paying a SWE annual salary, they'll just pay $1M of tokens once forever.
People don't know what they don't know about software, SDLC, support, maintenance, etc. If code was something you write once and never think about again, most tech orgs could be 75% smaller.
This here is the crux of it I think… it’s often promoted that AI will give us the time to do the “real” engineering work of designing systems and really serving the user, but in practice all I’ve seen is further attempts at optimizing every last process with AI - just homogenizing every product and feature into slop.
It feels like every leader has been to some talking points boot camp where they’re incentivized to apply pressure to every part of their process - sort of a desperate attempt to justify the costs they’re incurring. I think we will look back at this and see how obviously short sighted it was.
'Maybe I should consider woodworking' - Fuck off.
That's an extremely niche specialty though. 99% of software development jobs are web frontend/backend or mobile/desktop apps and they are more at risk from LLMs.
why would i ever want to use a tool that remove the part of my job that brings me joy? Fuck productivity, we were already doing good, when we were able to actually do our job, i.e.: not wasting hours in useless meetings, or doing customer care to idiots who could not be bothered to follow instructions, which i shouldn't be doing in the first place. let the LLM do that, or let the human assisted by the LLM do that. Not my job.
The bosses are out to force people like you to use AI. And have been for months.
Maybe not your boss yet, but it swept through my office dramatically. Maybe two or three months from limited tests to now today FORCED usage of AI (people going around the office asking constantly if there's any AI that can help today).
----------
This has a few toxic effects.
1. You are not allowed to complain about code quality issues anymore. Any complaints are met with okay, we will get the AI to fix it.
No discussion, no elaboration. No one in the office is even interested anymore. AI solves everything.
2. You are basically in a position where you are forced to use AI, whether you want it or not.
3. I expect code quality at my office to drop dramatically as fewer and fewer office mates give a shit
We won't miss them