跪拜 Guibai
← All articles
AI Programming · AIGC

WorkBuddy Turns Three Prompts into a Finished MP4 in 14 Minutes

By 小虎AI生活 ·
Read original on juejin.cn ↗ Google Translate ↗ Alt translation

An AI agent that can install missing dependencies and fix its own subtitle glyph bugs is ready for small-budget video production, but that 13.7 MB MP4 still failed to play smoothly locally. The automation is real; the last step of human acceptance remains.

Summary

WorkBuddy, Tencent's desktop agent that can read and write local files and install its own dependencies, ran a complete short-video production from three natural-language prompts. The agent generated four 3D storyboard images, cloned a voice via edge-tts, burned subtitles, and composited a vertical MP4 – then caught and fixed two subtitle rendering bugs on its own. The whole job took about 14 minutes.

The notable piece is the self-healing: WorkBuddy discovered the system lacked edge-tts and installed it, and later diagnosed that Windows \r\n line endings were causing drawtext to render '口' glyphs in subtitles, then rewrote the script and re-rendered. It also ran per-frame QC on frames 2 and 4 to verify Chinese text like '智能空气炸锅 / 180℃ / 25分钟' was correct.

The final output, a 13.7 MB MP4, wouldn't play smoothly in the local player – stuck at decoding. WorkBuddy's own positioning is as a digital employee for a one-person company, and its integration with the MCP ecosystem means small merchants can hand it the whole video job instead of juggling separate AI chat, image, and editing tools.

Takeaways
— Three natural-language prompts produced four 3D storyboard images and one 13.7 MB vertical MP4 with voiceover and subtitles.
— The full pipeline ran in about 14 minutes, with the composite script execution taking 12.7 seconds.
— WorkBuddy auto-installed the missing `edge-tts` package and configured it without human help.
— The voiceover used Xiaoxiao female voice at +8% speed, totaling 15.8 seconds across four lines.
— The agent ran QC on frames 2 and 4, confirming Chinese text on the air fryer screen rendered correctly.
— It diagnosed the Windows \r\n line-ending issue that caused drawtext to render missing-glyph '口' boxes, rewrote the script, and re-rendered.
— The final MP4 was 13.7 MB, with four storyboard images between 2.0 and 2.4 MB each.
— Local playback failed: the player kept getting stuck at decoding and couldn't play the video smoothly.
Conclusions

The agent's self-diagnosis of Windows \r\n line endings in subtitle text shows automated debugging can now operate at the system level, not just on code syntax.

Running per-frame QC before delivery is effectively unit testing for visual output; it trades a few seconds of rendering for preventing visible defects.

The final playback failure suggests the pipeline optimizes for generation and file delivery, not for playback compatibility; the built-in player already warned about the codec, so the agent could have flagged it earlier.

Concepts & terms
MCP (Model Context Protocol)
A protocol that lets AI agents read and write local files and call external tools, giving them access to real environments instead of just text.
drawtext
An FFmpeg filter that burns text overlays onto video; here it rendered subtitle lines, and a Windows line-ending caused missing-glyph boxes.
edge-tts
A free text-to-speech library that generates natural-sounding Chinese voiceover; WorkBuddy auto-installed it when it wasn't present.
Source: juejin.cn ↗ Google Translate ↗ Backup ↗