Skip to content
Back to work

AI · Games · Mobile

Solitaire Agent

Autonomous computer-use agent that plays from pixels

An agent that plays an iOS Solitaire game using only rendered pixels and synthesized touches. It has no access to game state, and a CI check enforces that boundary.

Highlights

  • ▹Screen → Vision → VisualBoard → Solver → Gesture → Verification loop.
  • ▹Platform-independent Swift core builds and tests on Linux; XCUITest drives the device.
  • ▹Deterministic vision and solving where they beat an LLM; decisions recorded as ADRs.
Next projectCompanion OS
esc