跪拜 Guibai
← All articles
Artificial Intelligence · Programmer · Data Visualization

Trae's Agent Mode Builds a 3D Game, but Browser OCR Calls Burn Through Free Tokens

By 2分钟速写快排 ·
Read original on juejin.cn ↗ Google Translate ↗ Alt translation

OCR-driven browser automation in AI IDEs can consume an entire free token quota on one long task, which changes how developers budget autonomous coding sessions.

Summary

Trae's Agent mode takes a prompt and a couple of images and generates a playable 3D stealth game inside Cocos Creator. The tool also produces a clear change list, pointing at specific files and steps, which a developer who doesn't know Cocos can still follow. When the preview doesn't show up, Trae's built-in browser automation takes over: given two screenshots, it clicks through the localhost preview itself to get the scene rendering.

That browser automation relies on OCR to interpret the screen, and each OCR call eats tokens. A single long task, like asking Trae to script a route where the player gets caught by a patroller, burned through the entire free quota. The developer had to retreat to IDE mode and look for a paid upgrade to keep going.

The trade-off is clear: Agent mode offers full-cycle autonomy and e2e-like testing, but its token consumption grows with the number of visual interactions. For small tasks it's delightfully smooth; for anything that requires many screen reads, the cost stacks up quickly.

Takeaways
— Trae's Agent mode generates a 3D stealth game in Cocos Creator from a prompt and images.
— Trae provides an Agent/IDE dual-mode design, letting developers switch between full autonomy and a complete dev environment.
— Trae's plan output includes concrete change references and steps, unlike other tools that just report completion.
— Built-in browser automation uses OCR to read screenshots and perform clicks, enabling Trae to fix runtime issues itself.
— OCR tool calls are token-expensive; one long task (scripting a patroller route) drained the entire free quota.
— The game is published at pandoralink.github.io/just-ggg-game/.
Conclusions

The token cost of browser automation makes it a real factor in whether to let an agent run unattended on long tasks; it's not a free capability.

Dual-mode design provides a practical fallback: when agent autonomy gets expensive, dropping to IDE mode lets you finish manually without burning more tokens.

Clear delta output (changed files and steps) is a small but meaningful differentiator; it turns opaque agent work into something a non-expert can review and trust.

Concepts & terms
Agent mode
In Trae, an autonomous development mode that drives a whole task from idea to delivery, supporting multiple parallel agents.
IDE mode
The full development environment in Trae that can be switched to at any time, preserving all IDE capabilities.
Browser Use
Trae's built-in automation that controls a browser through screenshots and clicks, using OCR to interpret the UI.
OCR tool call
A model operation that reads pixels from a screen to understand the UI state; these calls are token-heavy.
Source: juejin.cn ↗ Google Translate ↗ Backup ↗