Top
Best
New

Posted by karagenit 13 hours ago

Goodbye Claude, hello Pi(caleb.software)
515 points | 334 commentspage 4
sergiotapia 27 minutes ago|
I highly recommend Paseo. I feel like I finally found what I was looking for after so long.

https://github.com/getpaseo/paseo

It works really well, has the nice code diff view which what I used to open vs code for, and it lets you drive from your phone.

All the beefy work happens on my machine at home with big hardware and .env secrets, etc. And from my phone I'm able to run multiple threads with multiple models/thinking modes.

I think a testament of how useful it is, is everybody on my team switched over to Paseo pretty much in a week.

nvarsj 4 hours ago||
I've been using pi for several months with herdr. The ability to easily customise your experience via extension, with a small core, has finally made me enjoy working in harnesses. Also check out pi-blackhole (or billion context) + pi-fabric. The former basically gives you unlimited context and pi-fabric is subagents on steroids.
AJ007 5 minutes ago|
The new Herdr desktop has a great theming system. I haven't scratched the surface yet but it's blindingly obvious the future of software is (power) users being 100% in control of their workflow, what it does, how it does it, and how it looks.

Maybe trivial, but changing the font colors, agent status placement & colors increase my productivity 5-10%. I have more ideas like thumbnail previews, but these are specific to the project being worked on.

If you take pi and its extensions, plus herdr desktop, you have an agent that can run the way you want it to, and an app that shows the info you need in the style and way you want it to. I don't think there is one single superior workflow to dominate everything.

The downfall to this is LLMs being trained for their agents. Opus on Claude Code, GPT x.x on Codex. There are certainly strong echoes to vendor lock-in in the past if you look at all of the APIs we used to have with the social web. You could combine this with AI licensing and a national identity verification system and make the whole thing fucking miserable, with locked down hardware & software like iOS. There's a fair chance this could happen, especially in the EU. That and OpenAI + Anthropic merging are two scenarios that would suck.

edstarch 2 hours ago||
isn’t the point of CC the subsidized tokens of the pro/max accounts?

the tool descriptions and system prompts are notoriously overcooked but you can work around it with careful config; my startup context in CC is 10k, and i could have pruned it way more if i had wanted to be aggressive about it.

edweis 8 hours ago||
I am a CC user on the 20x, 5x is too small for me. Doing some quick maths I found that the Anthropic subscription it is a bargain compared to other models on API usage.

Does using Pi saves you so much token overhead that my maths are wrong?

2001zhaozhao 8 hours ago||
There are some extensions you can use to use your claude subscription on Pi, it runs Claude Code under the hood but with pi's prompts. The same is possible with Opencode
vorticalbox 8 hours ago||
Yeah but then you still get Claude’s and codex massive system prompt which is around 20k tokens last I checked.
ejohansson 7 hours ago||
There is no 20x any longer, no?
stkdump 9 hours ago||
I am using pi as the minimal coding agent for pc administration, incl. coding up scripts/daemons that help my infrastructure (automatically updating dns when my ISP changes my IP, automating letsencrypt wildcard cert updates and similar stuff). Tested continue.dev, aider, pi, kilocode and opencode for large projects and stuck with opencode for now. I am not fully happy though and hope something better comes along in time. It is just that the annoyances I have with it are not too problematic, I can cope. For some time I also worked with a custom harness I built on top of pi, but that wasn't great either.
leourbina 2 hours ago||
(Deliberately tooting my own horn) I’ve been on the same path. One of the first frustrations I ran into when migrating away from Claude is that I really missed the ability to create and interact with artifacts. The idea that the products of my conversations was locked away in some frontier AI lab silo bothered me.

I built OpenArtifacts (https://open-artifacts.com) to fix this exact problem. It’s free, open source and trivially self hosted on your own Cloudflare account. I’m releasing a hosted version in the coming days. I’d love to hear what other think.

novaRom 5 hours ago||
If you still really need closed models, consider a tiered setup: open models on neoclouds (95%) and frontiers for the hardest planning (5%). We've reduced costs dramatically. There's no good argument to use only closed models for most development.
Havoc 3 hours ago||
pi is pretty great. Bit unfortunately that it is built on a node stack too, but seems to at least be executed well
sgt101 8 hours ago||
Model capability is what harnesses expose, I have experimented with pi using local mlx models - several 27/35B quantisations (Gemma, Qwen, Flint) and the reality is that they are much weaker than Sonnet, let alone Opus. Of course they are "free" (if you have a $3000 mac) but they are slow and dumb, useful for very routine things but comparatively bad at problem solving and trouble shooting.
aaronrobinson 8 hours ago||
I don’t think OP is proposing using a local model?
throwa356262 8 hours ago|||
Why do you limit yourself to mac?

You can run larger flash models on a modern PC using strata. These models perform pretty good even on low quants.

Furthermore, next generation open weight models will swap some compute for storage, making them more accessible for masses.

CarlitosHighway 7 hours ago||
Maybe he doesn't want to wear earplugs constantly and/or doesn't generate his own electricity?
drTobiasFunke 8 hours ago||
I am genuinely curious to know what kind of genuine problems people are solving with opus that cant be done with sonnet or the free models. If there are problems that people are working on that only opus 5.5 can solve then were we not touching such problems last year at all (because last years best model was inferior to sonnet 5.5). And if people are solving such problems now, why cant I see any meaningful improvement in even a single software I use everyday?

Not trying to diss on anything or anybody. I want to know.

magicalhippo 5 hours ago|||
Sonnet 5.5 feels like a cocky rookie. It's capable, but it often makes mistakes and especially poor assumptions, and when I point it out it just goes "yeah I did that wrong". Opus is much better at judging assumptions, makes less poor assumptions and mistakes. And when I point them out it takes it to heart and makes sure it guards against such a mistake in the future.

Sonnet is great for simple work, such as subagents running a program and summarizing the output. Opus is just that much better at the more challenging work I find.

You can probably get Sonnet to reach the same goal, but Opus needs much less hand-holding and overwatch.

aaronrobinson 8 hours ago||||
I took a few months out and it’s noticeable quite how much better opus is at least in respect of the quality of understanding. It’s a step change for me.
MINECRAFT_BIOLO 8 hours ago|||
[dead]
fwlr 5 hours ago|
From the article’s footnotes:

  If you assume 1 million DAU and 100M requests per day, trimming 1,000 tokens off of [the over-long system prompt] could literally save millions of dollars in inference costs per year
That should be corrected to “could literally lose millions of dollars in inference revenue per year”, which also goes some way toward explaining why it doesn’t happen.
More comments...