from Hacker News

Show HN: Action, a Claude Computer Use Launcher for macOS

by lawrencechen on 12/31/24, 7:32 PM with 3 comments

Action is a macOS launcher that can take actions (click, type, and more) on your Mac using Claude’s Computer Use API.

The interface is a floating window triggered by a keyboard shortcut, similar to Spotlight. This lets you see what the model outputs as it performs actions. It’s written in Swift, and the DMG size is relatively small at roughly 3 MB. You can download the macOS client today at https://action.new (requires Anthropic API key).

To be frank, LLMs’ computer use capabilities (including Claude) are still a little slow and error prone. I find Action most valuable as an LLM that has immediate context of my screen.

I’ll be adding support for other providers—and hopefully local computer use models—as they become available.

  • by edomaschio on 1/8/25, 10:28 PM

    Love the idea! I played with it and wanted to send a few emails but it was refusing to do so and mentioned sending messages and emails being something it's not authorized to do.

    Anthropic Computer Use however does it for me - have you guys chosen to restrict these types of tasks? if so, why?

  • by zachrsweedler on 12/31/24, 11:44 PM

    Interesting! Exciting technology that Anthropic created, but very difficult to setup and test without it becoming a mini hackathon project. So, this solves that! I think the real magic happens when we'll be able to automate tasks passively (as per a schedule), without manual initiation. A set and forget mentality. Personally, it's hard for me to find practical utility in something that requires me to stare a computer screen, and watch it interact with interfaces in the same way I would (but faster)... At that point, I'm already at my computer, I'd say screw it, I can do this in 5 seconds. Don't 100% need it.

  • by jonathanalevi on 1/3/25, 2:07 PM

    Let me get this straight. I'm supposed to grant this app permissions to access my system and files and perform actions on my behalf, however, the website doesn't so much as mention the words privacy or security..?

    Where can I view the code? How do I know there's no malware here?