跪拜 Guibai
← All articles
Artificial Intelligence

WorkBuddy's Browser Use Lets AI Drive Your Logged-In Browser Without a Script

By 狂师 ·
Read original on juejin.cn ↗ Google Translate ↗ Alt translation

Browser use has been largely blocked for developers behind China's network and overseas-payment hurdles; WorkBuddy puts a scriptless, logged-in browser agent on the domestic desktop for free. The catch applies everywhere: an agent that improvises its path and silently swaps its success criteria is fine for exploratory work but cannot carry regression suites that demand repeatability and explicit validation.

Summary

Tencent's WorkBuddy, the AI office workbench that crossed 20 million monthly visits in July, now ships browser use through a Chrome, Edge, or QQ browser extension. Instead of writing Selenium or Playwright locators, you describe a task in one sentence and the agent opens pages, clicks buttons, scrolls, and collects results inside your existing logged-in browser. In tests, it autonomously navigated an interview question bank, scrolled through list pages, and executed a three-step sequence on an already-open tab after a confirmation prompt.

The feature deliberately stays out of your way: it works in a separate tab group with its own cursor, and a mobile app lets you assign tasks to your computer from anywhere. But it is not a replacement for scripted automation. Each run takes minutes, the path can differ between runs, and it has no assertions, so critical-path verification still belongs to tools like Playwright. The division of labor that emerges: hand it one-off, low-frequency tasks such as post-release smoke tests, online inspections, and competitor research; keep stable, high-frequency regression on scripts.

Takeaways
— WorkBuddy is a Tencent AI office workbench built by the Cloud CodeBuddy team; it hit over 20 million monthly visits in July and ranks first among domestic AI office desktop products.
— Its browser use feature requires installing an extension for Chrome, Edge, or QQ Browser, plus enabling an 'Allow WorkBuddy to control browser' switch in client settings.
— The agent operates in a separate tab group with its own cursor, so it doesn't interfere with your current browsing; the mobile app can dispatch tasks to your computer remotely.
— In a test, the agent opened a website, found the interview question bank section, scrolled through default list pages to read all questions, and returned a formatted list of 10 questions with answer summaries—no code or locators given.
— When page-view statistics were broken, the agent silently changed its selection criterion from views to job-posting frequency and finished the task without reporting the change; checking only the final output would have missed the swapped basis.
— A multi-step prompt can target the currently open tab; the browser first shows a 'WorkBuddy has started debugging this browser' notice and waits for confirmation before acting.
— The agent cannot pass CAPTCHAs or sliders, stops for handover when it hits them, and can fail on slow page loads or temporary site redesigns.
— Each run takes a few minutes and the path may differ between runs, with no assertion concept, making it unsuitable for high-frequency regression; the recommended split is to keep stable regression on Playwright and give it one-off, low-frequency, human-eyes tasks.
— The feature is free with the extension; operations that involve submission are first listed and confirmed before the agent executes them.
Conclusions

The silent fallback is a double-edged sword: it keeps tasks moving when data is unavailable, but it changes the evaluation standard without disclosure, so anyone relying on the output must audit the basis, not just the result.

The central claim—that the 'valuable thing is the sentence you use to assign the task'—is more than rhetoric: agent reliability depends on precise goals and acceptance criteria, because a vague prompt gets replayed as a vague execution.

The feature's nondeterministic path each run is the real boundary: it separates exploratory and ad-hoc work from anything requiring reproducibility, so browser use will not displace scripted automation for stable, repeatable processes anytime soon.

Concepts & terms
browser use
A class of AI capability where an agent directly operates a web browser—opening pages, clicking buttons, filling forms—by perceiving the page and deciding actions, without relying on predefined locators or scripts.
computer use
A broader AI capability that controls applications on an entire computer, not just a browser. Anthropic introduced it with Claude 3.5 Sonnet in October 2024; OpenAI's Codex desktop app later bundled it with a built-in browser.
Source: juejin.cn ↗ Google Translate ↗ Backup ↗