Top
Best
New

Posted by sbochins 7 hours ago

AI coding at home without going broke(stephen.bochinski.dev)
188 points | 173 commentspage 4
m3kw9 2 hours ago||
That’s easy, just use the plus plan and learn how to prompt efficiently
dempedempe 6 hours ago||
Did you just copy-and-paste an AI response an post it on your blog?
Flere-Imsaho 3 hours ago||
Instead of openrouter (which is admittedly a good service) I've switched to EU only servers via https://cortecs.ai/

If you hunt in the settings you can restrict your account to only use EU servers for inference... Which means you can't use a lot of the US frontier models, but you can use all the Chinese ones, albeit within EU GDPR, etc.

This to me is a good compromise between privacy and cost.

13415 6 hours ago||
I use copy & paste with a pro subscription. I guess I'm a bit behind in terms of tool use but it works great for me.
TheSkyHasEyes 6 hours ago|
Similar story. I did have a pro subscription as a trial. I'm finding the free tier is as good(for my purposes) as the paid model.
jacobgold 6 hours ago||
"Around $400 a month of plans buys roughly $2800 of API usage at list prices, which is a real bargain right up until you hit the ceiling."

I realize this text is just slop but it never stops being a "real bargain" at any point.

And it's more like $200/mo for $4000+/mo in tokens. You can also buy additional subscriptions.

There's no sense in running local models or doing anything else as long as VCs (and soon the public markets) are willing to pay your bill.

simonw 6 hours ago||
SemiAnalysis pushed this to the limit and managed to get $8,000 of tokens from a $200/month Anthropic plan and $14,000 of tokens from a $200/month OpenAI plan: https://twitter.com/SemiAnalysis_/status/2064815044085318040
jacobgold 5 hours ago||
Yeah, although that is pushing every rate limit and no one knows what happens if you do that consistently? I think $4,000/mo is probably a good estimate for an individual dev doing synchronous coding agent work.
simonw 5 hours ago||
Yeah, I agree. I've been consistently getting about $1,000/month of value out of the $100/month subscription for OpenAI, and about the same for Anthropic.
stkdump 4 hours ago||
Sorry to be that guy. I think the more precise wording would be that you get tokens which would cost $1,000/month at API pricing. Maybe (depending on the profit margin of the API pricing) you incur costs somewhere close to $1,000/month. And maybe your usage is subsidized by 900$/month. The value you get out of it is a whole other question. One that according to recent news, CFOs find hard to esitimate.
simonw 2 hours ago||
Ask a CFO to estimate the value of microservices, or agile, or free snacks in the office, and you'll get much the same answer from them.
abc42 6 hours ago||
Even if they were making a profit, their scale and expertise will obviously give you a cheaper product than what you can build.
jacobgold 6 hours ago||
Maybe today but it's not a law of nature. It seems inevitable that AI models and coding agents will be fully commoditized eventually, just like computers, game engines, compilers, web servers, and so many other technologies have been.

At the end of the day, AI models are relatively small files that we run little CUDA programs on.

OutOfHere 6 hours ago||
Fixed-price monthly plans ought to be sufficient for most people who actually review their spec and code, for building production-grade software that stand the test of time. A careful spec+review+iteration takes time, resetting the usage quota. Granted, security audits uses tokens too.

If you still need more tokens, odds that you're vibecoding unmaintainable throwaway trash.

manfre 5 hours ago||
With access to view usage for my org and conversations with developers, I think much of the high token usage is a result of people not knowing how to right size the model for the given task. The trend seems to be to pick the most powerful model and use it for everything. Based upon git metrics, I'm one of the top performing engineers at my org and I've yet to run into any overage or throttling on the $200/mo anthropic sub.
justinhj 5 hours ago||
I had no idea git metrics could show your best performers
OutOfHere 4 hours ago||
It could put managers out of a job, without AI too, so they prefer to not use it.
jrm4 6 hours ago||
Is spending (metered money) even worth it? Perhaps for most I mean "beyond like a 30 bucks a month," but for me I'm literally not spending more money beyond my very cheapo 16gb video card.

No clue what y'all are doing, perhaps because I'm hobbying, and also I'm old and can perhaps do more of this by hand.

But I'm basically just doing what I did before, plus ollama self hosted and sometimes gemini and I feel like I'm going lightspeed beyond what I've ever done.

And I suppose this is still very fine-grained. I have it make a draft, then just have them fix/change it step by step?

I tried one of the bigger boys that can one-shot apps, which I guess is cool, but I'm finding it's just as hard to modify as if I just grabbed someone elses repo on github.

stkdump 3 hours ago|
No, I have the same experience. Feels crazy that a GPU is too expensive and then the advice is to spend 400$+tokens on openrouter each month.
sesm 6 hours ago||
> Do that well and you can build what a team of twenty engineers would put out in a month for around a thousand dollars.

As usual, an extraordinary claim without an extraordinary evidence: https://stephen.bochinski.dev/apps/

tamimio 6 hours ago|
You can have opencode and switch between multiple providers based on the tasks you are doing on the fly, normal tasks use deepseek for example, hard one use gpt5 or opus4, and track the usage with something like codexbar or similar. Openrouter seems to charge extra on top of the api costs, same with zen ide, so keep that in mind.
More comments...