DevPik Logo
open sourceai agentscliautomationclaude codedeveloper tools

CLI-Anything: Turn Any Software Into a Tool Your AI Agent Can Use (55K Stars)

AI agents are great at reasoning but terrible at using real software. CLI-Anything is the open-source fix with 55,000 GitHub stars: it generates CLI harnesses that turn any app into commands an agent can run. Blender, GIMP, LibreOffice, Zoom, FreeCAD, Obsidian, dozens more. It works with Claude Code, Cursor, Codex and other agents, and a hub command installs ready-made ones in seconds. Here is how it works, what the 18 real-world demos prove, and why it might replace GUI-based agents entirely.

ByMuhammad Tayyab8 min read
All open source picks
HKUDS/CLI-Anything
The official repository — this write-up is not affiliated with the project.
54.9kPythonApache 2.0

Today's Software Serves Humans. Tomorrow's Users Will Be Agents.

That line is the whole thesis of CLI-Anything, and it is why the repo at HKUDS/CLI-Anything picked up 55,000 GitHub stars in about seven months. AI agents can reason, plan, and write code, but ask one to actually use professional software, a 3D modeler, a video editor, a CAD tool, and it falls apart. The current workarounds are fragile screen-scraping automation, limited APIs, or watered-down reimplementations that miss most of what the software can do.\n\nCLI-Anything attacks the problem from a different angle. Instead of teaching the agent to click buttons like a human, it generates a command-line harness for the software, a real CLI with structured commands and JSON output that the agent drives directly. No screenshots, no mouse coordinates, no brittle UI automation. The agent talks to the actual software backend through a clean terminal interface.\n\nThe project comes from the Data Intelligence Lab at the University of Hong Kong (HKUDS), the same group behind RAG-Anything, and it ships with a full tech report on arXiv plus 2,400+ passing tests. This is a research-backed tool, not a weekend hack.

One Command Generates an Agent-Ready CLI

The core workflow is almost suspiciously simple. You point the CLI-Anything generator at a codebase, say a 3D application or a workflow tool, and run its seven-phase harness pipeline. It analyzes the architecture, designs the CLI, implements it, writes tests, generates docs, and can even publish the result, largely automatically. The README's own shorthand is: throw the codebase at /cli-anything and you get a full CLI your agents can use.\n\nThe generated CLIs are not toys. They call the real application backends: LibreOffice generates actual PDFs, Blender renders real 3D scenes, Audacity processes audio. The README stresses this twice: zero compromises, zero toy implementations. Output comes in both JSON for agent consumption and human-readable formats for debugging, which solves the structured-data problem agents constantly hit.\n\nIt works with the agents people actually use: Claude Code, Cursor, Codex, Pi, OpenClaw, and nanobot are all named as supported. If your agent can run shell commands, it can use a CLI-Anything harness.

CLI-Hub: An App Store for Agent CLIs

You do not have to generate anything yourself to get started. CLI-Hub is the project's registry of community-built CLIs, and installing one takes one command:\n\n`bash\npip install cli-anything-hub\ncli-hub install <name>\n`\n\nThe hub lets you browse, search, install, update, and uninstall harnesses from one place, and there is a web frontend at clianything.cc to explore what exists. The registry keeps growing through community contributions: recent merges include harnesses for Obsidian, QGIS, Safari, n8n, Godot, Kdenlive, Calibre, and dozens of others.\n\nIf you want to build your own harness and share it, there is a contributor signup flow, and merged contributors get recognized in the community. There is also a wishlist where you can request a CLI for specific software. The whole thing runs like an open-source app store for agent tooling, which is exactly what it is.

The Demos Are the Proof

CLI-Anything ships with 18 real-world demonstrations, and they are the reason the repo keeps getting shared. Agents use the generated CLIs to build a Mars rover in FreeCAD, design a drone in Blender, play a video game, generate subtitles, build CAD models, create 3D scenes and diagrams. These are end-to-end artifacts produced by agents driving real software, not scripted walkthroughs.\n\nThe demos matter because they answer the only question that counts: does the agent actually get work done? A harness that technically exists but cannot complete a real task is worthless. The 18 demos, backed by 2,400+ tests with real software validation, are the project's evidence that the approach survives contact with reality.\n\nThere is also a preview and trajectory-loop system that lets you watch what the agent is doing as it works, which is useful both for debugging and for the sheer fun of watching an agent model a drone.

Why This Could Replace GUI Agents

The README makes a bold claim: CLI-Anything can flat-out replace GUI-based agent approaches. The argument is hard to dismiss. GUI agents take screenshots, guess where to click, and break every time an interface updates. It is the most fragile possible way to automate software. A generated CLI gives the agent a deterministic, structured interface to the same capabilities, and once the software is agent-native, you can even synthesize agent tasks, evaluators, and benchmarks entirely through code and terminal, automated and iteratively refinable.\n\nThe other angle is unification. Instead of juggling fragmented web service APIs, you can feed API docs or SDKs to the generator and get one stateful CLI wrapping them into coherent command groups. One tool instead of dozens of raw API calls, stronger capabilities, fewer tokens.\n\nThe honest limitation: someone still has to generate or install a good harness for the software you care about, and niche or closed-source apps without accessible backends will be harder. But for open-source software, which the project targets first, the coverage is growing fast.

Getting Started in Five Minutes

The README advertises a five-minute quick start, and it is roughly true. If you just want to use existing harnesses, install the hub with pip install cli-anything-hub, browse the registry, and install what you need. You need Python 3.10 or newer.\n\nIf you want to make your own software agent-ready, install the CLI-Anything plugin or skill for your agent, then run the seven-phase generator against the codebase. The docs live in the repo, the tech report is on arXiv for the full design, and the README is maintained in Chinese, Japanese, and German alongside English, which says something about how global the contributor base already is.\n\nAt 55,000 stars, Apache 2.0 licensed, and actively merged multiple times a week, this is one of the most credible bets in the agent-tooling space right now. If you run AI agents and you have software they cannot touch, this is the repo to star.

Frequently Asked Questions

What is CLI-Anything?

CLI-Anything (HKUDS/CLI-Anything) is an open-source project with 55,000+ GitHub stars that makes software agent-native. It generates command-line harnesses for real applications so AI agents like Claude Code, Cursor, and Codex can drive them directly, without screenshots or UI automation. Apache 2.0 licensed.

Is CLI-Anything free?

Yes. CLI-Anything is Apache 2.0 licensed and completely free and open source. You can use the generated CLIs, the CLI-Hub registry, and the harness generator without paying anything.

How does CLI-Anything make software agent-native?

It runs a seven-phase pipeline that analyzes a codebase and generates a CLI harness: real commands with structured JSON output that call the actual software backend. Instead of the agent clicking buttons in a GUI, it runs terminal commands against Blender, LibreOffice, GIMP, or whatever app was harnessed.

What is CLI-Hub?

CLI-Hub is the registry of community-built CLI-Anything harnesses. Install it with pip install cli-anything-hub, then browse, install, update, and uninstall ready-made CLIs with commands like cli-hub install <name>. There is also a web frontend at clianything.cc.

Which AI agents work with CLI-Anything?

The project names Pi, OpenClaw, nanobot, Cursor, Claude Code, and Codex as supported. Any agent that can run shell commands can use a generated CLI harness.

What software has CLI-Anything demos?

The README lists 18 real-world demos including Blender, FreeCAD, GIMP, LibreOffice, Shotcut, OBS Studio, Godot, Kdenlive, Obsidian, QGIS, n8n, Calibre, Zoom, Safari, and Audacity. Agents build CAD models, 3D scenes, diagrams, play games, and generate subtitles in the demos.

Who built CLI-Anything?

CLI-Anything is built by HKUDS, the Data Intelligence Lab at the University of Hong Kong, the same group behind RAG-Anything. It is backed by a tech report on arXiv and has an active global contributor community.

How is CLI-Anything different from GUI agents or RPA?

GUI agents and RPA take screenshots and simulate clicks, which breaks whenever an interface changes. CLI-Anything generates a deterministic command-line interface to the real software backend, so agents get structured commands and JSON output with no pixel-clicking. It is far more reliable and cheaper in tokens.

Related DevPik tools

Muhammad Tayyab

Written by

Muhammad Tayyab

CEO & Founder at Mergemain

Muhammad Tayyab builds free, privacy-first developer tools at DevPik. He writes about AI trends, developer tools, and web technologies.

More open source picks