Posted by Stwerner 6 days ago
Imagine having your customers write feature requests for your saas, that immediately triggers code generation and a PR. A virtual environment with that PR is spun up and served to that customer for feedback and refinement. Loop until customer has implemented the feature they would like to see in your product.
Enterprise plan only, obviously.
If you picked a problem where LLMs are good, now you have to review 3 PRs instead of just 1. If you picked a problem where they're bad, now you have 3 failures.
I think there are not many cases where throwing more attempts at the problem is useful.
I see LLMs as a form of inductive reasoning, and so I can see how WI could extend LLMs.
Also, I have no doubt that there are problems that can't be solved with just an LLM but would need abductive extensions.
Same comments apply to deductive (logical) extensions to LLMs.
And we're back to expert systems.
Models will improve, but also I predict code style and architecture will evolve towards something easier for machine review.
Initially we can absolutely just review them like any other PR, but at some point code review will be the bottleneck.
There’s probably also some upside to running the same model multiple times. I find Sonnet will sometimes fail, I’ll roll back and try again with same prompt but clean context, and it will succeed.
There's something cooked about Windsurf/Cursors' go-to-market pricing - there's no way they are turning a profit at $50/month. $50/month gets you a happy meal experience. If you want more power, you gotta ditch snacking at McDonald’s.
In the future, companies should budget $100 USD to $500 USD per day, per dev, on tokens as the new normal for business, which is circa $25k USD (low end) to $50k USD (likely) to $127k USD (highest) per year.
Above from https://ghuntley.com/redlining/
This napkin math is based upon my current spend in bring a self-compiled compiler to life.
There's another guy in this space I know who's doing similar incredible things but he doesn't really speak about it publicly so don't want to discuss w/o his permission. I'm happy to make an introduction for those interested just hmu (check my profile for how).
Really excited to see you on the FP of HN Scott!