gui-anything

🖥️ GUI-Anything: Making ALL Software GUI-Controllable

Transform any software into a cross-platform GUI controllable by AI agents and humans alike.

GUI-Anything is a plugin for AI coding agents (Claude Code, Codex, Gemini CLI) that automatically generates rich graphical user interfaces for any software application. Point it at source code, and the AI agent builds a complete React-based GUI with MCP (Model Context Protocol) tools for agent control.

Inspired by CLI-Anything — where CLI-Anything wraps software into command-line interfaces, GUI-Anything wraps software into visual graphical interfaces.

🤔 Why GUI?

Most software is designed for humans — but even humans prefer GUIs over CLIs for discovery, exploration, and visualization. GUI-Anything bridges both:

• For Humans: Rich visual interface with forms, previews, and interactive controls
• For AI Agents: Every GUI action is exposed as an MCP tool with JSON I/O
• Cross-Platform: Web → Desktop → Mobile from one codebase (React + Tauri v2)

🚀 Quick Start

Prerequisites

• Node.js 20+
• Python 3.10+
• A supported AI coding agent: Claude Code | Codex | Gemini CLI

Claude Code

# Clone the repository
git clone https://github.com/ImL1s/gui-anything.git

# Point Claude Code to the HARNESS.md
# Claude reads the SOP and follows the 7-phase pipeline
> Read gui-anything-plugin/HARNESS.md, then build a GUI for ./my-software

Codex / Gemini CLI / Other Agents

# Clone the repository
git clone https://github.com/ImL1s/gui-anything.git

# Any AI coding agent can follow the SOP
> Read gui-anything-plugin/HARNESS.md and build a GUI for ./my-software

Note: Plugin marketplace support is planned for a future release. Currently, agents read HARNESS.md directly from the local clone.

✨ How GUI-Anything Works

🏗️ Fully Automated 7-Phase Pipeline

From codebase analysis to npm packaging — the plugin guides the AI agent through architecture design, React implementation, MCP tool generation, test planning, and documentation completely automatically.

🎨 A2UI Schema-Driven

All GUIs are driven by a declarative gui-schema.json — the AI agent generates it, React renders it, and agents control it via MCP tools. Adding a new action means adding it to the schema — everything else follows.

🤖 MCP for Agent Control

Every GUI action is exposed as an MCP tool with structured JSON input/output. Agents interact via mcp-tools.json, not pixel automation.

🖥️ Cross-Platform via Tauri v2

Generated GUIs run everywhere: web browser (dev mode), Windows, macOS, Linux, Android, and iOS — all from the same React codebase.

📂 Project Structure

gui-anything/
├── gui-anything-plugin/         # The AI agent plugin
│   ├── HARNESS.md               # SOP — the AI reads this
│   ├── a2ui_skin.py             # Shared utility module
│   └── commands/
│       ├── gui-anything.md      # /gui-anything <path>
│       ├── refine.md            # /gui-anything:refine <path> [focus]
│       ├── test.md              # /gui-anything:test <path>
│       └── validate.md          # /gui-anything:validate <path>
├── calculator/agent-harness/    # Example: generated calculator GUI
├── examples/calculator/         # Example: source calculator app
├── LICENSE
└── README.md

🎯 Plugin Commands

Command	Description
/gui-anything <path>	Build a complete GUI for any software
/gui-anything:refine <path> [focus]	Expand coverage of existing GUI
/gui-anything:test <path>	Run validation tests
/gui-anything:validate <path>	Validate against HARNESS.md standards

🎮 Demo: Calculator GUI

The calculator/ directory shows a complete generated GUI for a Python calculator:

• 12 actions across 5 groups (Arithmetic, Scientific, Memory, History, Export)
• 15 MCP tools (12 actions + screenshot, state, navigate)
• Dark theme with indigo/purple palette
• A2UI schema driving all components

cd calculator/agent-harness
npm install
npm run dev
# → http://localhost:5173

🎯 What Can You Do with GUI-Anything?

Software	What the GUI Does
Calculator	Forms for math operations, history viewer, export panel
Image Editor	Canvas preview, filter panels, batch processing
Video Tool	Timeline view, transcoding forms, preview player
API Client	Request builder, response viewer, collection manager
Database Tool	Query editor, result tables, schema browser

📖 The Standard Playbook: HARNESS.md

HARNESS.md is the definitive SOP for making any software GUI-controllable via automated React + MCP generation. It encodes proven patterns and methodologies refined through building production-ready GUI harnesses.