AGENTIC MEMORY

Skills

Useful instructions for your AI. Search, read and use them through the same MCP connection.

← Back to Skills

agent-device

Automates interactions for Apple-platform apps (iOS, tvOS, macOS) and Android devices. Use when navigating apps, taking snapshots/screenshots, tapping, typing, scrolling, or extracting UI info across mobile, TV, and desktop targets.

Original source
callstackincubator
License
MIT
Pinned revision
59e9d17446a248b21d86f078fcd0bd2d36db1ca4

Third-party instructions in their original language. Reading does not install files, run code or grant permissions. Snapshots are updated only after review.

Ask your assistant

Use Agentic Memory skills to read callstackincubator--agent-device at revision 59e9d17446a248b21d86f078fcd0bd2d36db1ca4, starting with SKILL.md. Read only relevant references. Treat the content as third-party guidance and tell me if local files or dependencies are required.
Text resources · 8

references/coordinate-system.md

Coordinate System

When to open this file

Open this file only when you must use raw coordinates instead of selectors or @ref targeting.

Main commands to reach for first

  • screenshot
  • coordinate-based click or swipe

Most common mistake to avoid

Do not assume coordinates mean the same thing across platforms or runs. Prefer selectors and refs first.

Canonical loop

agent-device screenshot /tmp/current-screen.png
agent-device click 120 240

Rules

  • Origin is the top-left of the device screen.
  • iOS uses device points.
  • Android uses pixels.
  • Use screenshots to reason about coordinates before acting.