Top
Best
New

Posted by kcorbitt 10/23/2024

Show HN: Agent.exe, a cross-platform app to let 3.5 Sonnet control your machine(github.com)
406 points | 232 commentspage 3
waffletower 10/23/2024|
Apple is best positioned to run with the implications of these developments (though Microsoft will probably respond too) with both their historic operating system control hooks and their architecturally grounded respect for privacy (arguably of course). Apple seems to be paying very close attention to LLM developments, I doubt they will rush out an 80/20 response to these LLM agent control use cases, but I would be surprised if they didn't enter this product space.
troupo 10/23/2024||
> I doubt they will rush out an 80/20 response to these LLM agent control use cases

That's exactly what they are already doing with their late and delayed "AI": shipping either half-baked features (their new "memojis"), or features others have had for years (object removal in photos, see Photomator), or delaying features indefinitely (see Siri)

pazimzadeh 10/23/2024||
Yeah, I was really hoping for some kind of computer control in their AI announcement. Hopefully version 2..
posting_mess 10/23/2024||
> "Find flights Tuesday to Thursday next week"

> AI Picks Thursday to Saturday this week (as time of writing)

Still cheaper to higher real people then

Sincere6066 10/23/2024||
But I don't want that.
pants2 10/23/2024||
Any anecdotes about how many $ of API credits this thing costs to run for a simple task like booking a flight?
MacsHeadroom 10/23/2024|
~50¢
manamorphic 10/23/2024||
ran it in a Windows Sandbox ... doesn't work. messes up the coordinates, can't click on anything
fullstackchris 10/23/2024||
I'm experiencing the same on mac. It's claiming that it's clicking and doing stuff, but it's not. (yes I gave it the necessary permissions)
ashepp 10/24/2024||
I wonder if it's expecting a default resolution (like for a Mac Book pro?). I'm seeing the same issue of the coordinates not working on Win11 for a 3840x2160 display.
nixosbestos 10/24/2024||
Maybe it scales the image before recognition and forgets to scale back up the projected coordinates for actions?
scrps 10/24/2024||
Set a job to have it reboot the system, set it to run on boot, achieve AI-hyped useless machine!

https://en.m.wikipedia.org/wiki/Useless_machine

KaoruAoiShiho 10/23/2024||
How hard would it be to finetune a local VLM for computer use? Sonnet 3.5 is reaaaallly expensive.
huqedato 10/23/2024||
Why would I let an AI (controlled by a company) to control my computer? Thanks, but no thanks.
rsanek 10/24/2024||
Anyone else getting 400s with "This action is restricted for safety reasons at this time" when trying to use the app? I don't see any docs that mention you have to manually enable the API or anything.
xnx 10/23/2024|
Alas, setup is not as simple as downloading and running "agent.exe".
More comments...