Skip to content

feat(agent): add bounded local computer use#3565

Open
richardsolomou wants to merge 4 commits into
posthog-code/feat/codex-computer-usefrom
posthog-code/feat/computer-use
Open

feat(agent): add bounded local computer use#3565
richardsolomou wants to merge 4 commits into
posthog-code/feat/codex-computer-usefrom
posthog-code/feat/computer-use

Conversation

@richardsolomou

@richardsolomou richardsolomou commented Jul 19, 2026

Copy link
Copy Markdown
Member

Problem

Local sessions cannot operate desktop apps through one portable adapter-neutral contract. Full-resolution captures can also make long conversations exceed the gateway request limit.

Changes

I added opt-in macOS screenshot, application, mouse, and keyboard tools shared by Claude and Codex. Captures are resized and capped at 1 MB, and the packaged app verifies the standalone local-tools MCP before release.

How did you test this?

  • Ran the focused computer-use tests and package typecheck.
  • Built @posthog/agent and packaged the Electron app.
  • Captured and inspected a real 1600×1039 desktop image at 312 KB.
  • Verified the live desktop controls and Advanced setting.

Automatic notifications

  • Publish to changelog?
  • Alert Sales and Marketing teams?

Created with PostHog Code

@github-actions

github-actions Bot commented Jul 19, 2026

Copy link
Copy Markdown

React Doctor found no issues in the changed files. 🎉

Reviewed by React Doctor for commit 42c0c0c.

Generated-By: PostHog Code
Task-Id: 18a0ed17-2c63-4288-98b3-65563803ac72
Generated-By: PostHog Code
Task-Id: 18a0ed17-2c63-4288-98b3-65563803ac72
Build and verify the standalone Codex local-tools MCP entrypoint before packaging the desktop app.

Generated-By: PostHog Code
Task-Id: 64d16b4c-2c25-4e05-ba9d-824311186124
Resize desktop captures and enforce a 1 MB result cap so repeated computer use cannot exhaust gateway request bytes.

Generated-By: PostHog Code
Task-Id: 64d16b4c-2c25-4e05-ba9d-824311186124
@richardsolomou
richardsolomou force-pushed the posthog-code/feat/computer-use branch from e49386a to 42c0c0c Compare July 19, 2026 11:06
@richardsolomou richardsolomou changed the title feat(agent): add local computer use feat(agent): add bounded local computer use Jul 19, 2026
@richardsolomou
richardsolomou marked this pull request as ready for review July 19, 2026 12:11
@richardsolomou
richardsolomou requested a review from a team July 19, 2026 12:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant