ByteDance 🔥: China's giant AI player made a fully multimodal AI agent stack that controls your computer, browser, and terminal using natural language instructions.
It's called UI-TARS Desktop + Agent TARS.
It sees your screen, clicks buttons, fills forms, and completes multi-step tasks the same way a human operator would.
Here's what's actually inside:
→ Agent TARS: A CLI + Web UI agent combining GUI vision, browser control, and MCP tool integration
→ UI-TARS Desktop: A native desktop app running a local or remote computer operator powered by the UI-TARS vision-language model
Real tasks it can complete right now:
> Book flights on Priceline ("earliest flight from San Jose to New York on September 1st")
> Find and reserve hotels on Booking(dot)com within a specified budget
> Pull live data and generate charts via MCP servers
> Check GitHub issues and summarize them
> Open VS Code settings and make precise configuration changes
The browser agent runs in three modes:
- Pure GUI vision,
- DOM-based, or
- A hybrid of both.
Remote operators ship free with no configuration required.
Click to remotely control any computer or browser and the agent handles the rest.
Cross-platform: Windows, macOS, Browser.
The whole stack runs locally. No data leaves your machine unless you configure a remote operator.
github.com/bytedance/UI-TARS…
Video