Posted by jasondavies 6 hours ago
1. Humans are already not in the loop for lots of LLM agent actions. Isn't that just a function of how much you trust it and not some completely new paradigm? Am I missing something?
2. How can it gather context if it just outputs a single decision?
One guess: Maybe it's decision can be "gather more context and re-run me"? But an LLM can be much more expressive about what context it needs.
At0M: A 60M local Jev at 16 ms latency and 79% accuracy on Typed Decision
https://at0m.pienomial.com/ https://news.ycombinator.com/item?id=49920350
I'd love an privacy first on-device model i could use in iOS.
At0M: A 60M local Jev at 16 ms latency and 79% accuracy on Typed Decision
https://at0m.pienomial.com/ https://news.ycombinator.com/item?id=49920350
At0M: A 60M local Jev at 16 ms latency and 79% accuracy on Typed Decision
https://at0m.pienomial.com/ https://news.ycombinator.com/item?id=49920350
Apologies if it is too much of a bother.
Businesses are built on outliers. It doesn't make sense throwing your hard earned insights while paying them money to steal it.
Also, cloudflare https://robindev.substack.com/p/cloudflare-took-down-our-web...
curl -s -X POST https://at0m.pienomial.com/decide/v0 \ -H 'Content-Type: application/json' \ -d '{ "state": "Charged twice for the same card payment this morning.", "questions": { "queue": {"type":"choice", "instructions":"Which team should handle this?", "criteria": {"billing":"invoices, charges, refunds", "technical":"outages, bugs, deploys", "fraud":"unauthorised or suspicious activity"}}, "urgent": {"type":"noul", "instructions":"Needs action today."}}, "email_id": "you@example.com"}'
If it fits your use case, you are welcome to use it.
When it is a rust standalone rust executable, as it is powering the API, it becomes just plug and play. No dependencies needed.
We wanted to stress test the system before the V1 release.
I built this for my own needs, and thought others might find it useful too.
Perhaps that may be too costly atm