跪拜 Guibai
← All articles
Agent

Harness Over Model: How AI Agents Evolved From Chat to Work in Five Stages

By 西安小哥 ·
Read original on juejin.cn ↗ Google Translate ↗ Alt translation

The same model tripled its benchmark score with zero changes to its weights, which puts agent performance squarely in the runtime layer. Open harnesses from OpenAI and DeepSeek mean any team can fork, audit, and embed that layer, so the deciding factors become runtime engineering, skill packaging, and acceptance-criteria discipline rather than which API you subscribe to.

Summary

The defining 2026 event in the agent industry came from OpenAI's August 20 open-sourcing of the Codex harness: harness-level optimization alone lifted GPT-5.6 Sol's ARC-AGI-3 from 13.3% to 38.3% and cut token consumption to one-sixth, with the model weights unchanged. DeepSeek had shipped its MIT-licensed harness a week earlier, built on the Cordis kernel where every component from the agent loop to the Web UI is a plugin. Both vendors now treat harness design, not raw model capability, as the primary lever on agent performance.

The five-stage evolution runs from prompt templates and ReAct through RAG engineering, coding assistants with compiler feedback, and conversational agents, to the current stage where agents are deployed, packaged, and traded as productivity units. The 2026-07-28 MCP spec landed a stateless core, async Tasks, and Skills over MCP; Agent Skills and Agent Plugins 1.0 standardized how capabilities get described and shipped. The comparison across five tools and eight model families puts Codex and DeepSeek Harness at the open-runtime poles, WorkBuddy at the multi-expert office pole, and Doubao at the all-modal real-time pole, while Kimi K3's 300-subagent swarm and MiniMax M3's 1M-context open weights mark the capability extremes.

Takeaways
— Harness-only optimization lifted GPT-5.6 Sol's ARC-AGI-3 score from 13.3% to 38.3% and cut token consumption to one-sixth; the model weights never changed.
— OpenAI open-sourced the Codex harness (Rust, Apache-2.0) on 2026-08-20; DeepSeek released its MIT-licensed harness on 2026-08-13 with 49 packages, 100+ first-party plugins, and four presets, passing 50,000 GitHub stars in 12 hours.
— Agent capability follows Model × Harness × Ecosystem; any zero term zeroes the result, and in 2026 the differentiators are the harness and the ecosystem.
— MCP 2026-07-28 introduced a stateless core, async Tasks, Skills over MCP, and MCP Apps; the four Tier 1 SDKs approach 500 million monthly downloads.
— Agent Skills became an open cross-platform standard on 2025-12-18, read by 46 agent products; Agent Plugins 1.0.0 packages skills/ and mcp.json behind one plugin.json.
— DeepSeek Harness's Minimal preset makes V4 Flash's Terminal-Bench 2.1 score of 82.7 reproducible by anyone, putting the harness itself under public review.
— A trivial 'reply PONG' task in DeepSeek Harness consumed about 13,467 input tokens on the first request; the default sandbox restricts writes but not reads or network, and a macOS install pulls 531 packages (306 MB).
— Kimi K3's Agent Swarm runs up to 300 parallel subagents with 4000+ tool calls at roughly 4.5x single-agent speed; training created over 51 million sandboxes using partial rollout.
— Harness and compute now separate cleanly: credentials stay in trusted infrastructure, and one Manifest workspace definition runs across seven cloud sandbox providers with a one-line switch.
Conclusions

Harness design has replaced raw model capability as the industry's primary performance lever; the same model tripling its benchmark score with unchanged weights makes the model-centric narrative of the last two years untenable.

The stateless MCP core won on a mundane operational ground: session-state glue capped integration scale at dozens of connections, and removing it lets enterprises reach thousands. The protocol's success tracks a cost curve, not a technical fashion.

DeepSeek's disclosures, a 13,467-token PONG reply and an unrestricted read/network sandbox, show open harnesses trade polish for transparency: the security burden moves to the adopter.

The human keeps moving one slot back in the loop across all five stages, but responsibility does not move with it; acceptance-criteria writing becomes the scarce skill. That reshapes hiring and job definitions as much as it reshapes tooling.

MiniMax's missing SOC 2, ISO 27001, and HIPAA credentials, alongside DeepSeek's procurement scrutiny, put a compliance ceiling on open-weight Chinese models in regulated Western markets that no benchmark score can remove.

Voice is the last modality standing between assembled and native all-modal systems: MiniMax's API-layer stitching of speech against Doubao's end-to-end SeedRealtime defines the near-term dividing line.

Concepts & terms
Harness
Everything except the model itself that turns a language model into a working agent: system prompt assembly, tool registration and dispatch, context management, sandboxing, permissions, memory, task planning, trajectory recording, and cost control. OpenAI and DeepSeek both open-sourced their harnesses in August 2026, making the harness an independent, forkable artifact.
Loop
The agent's minimal autonomous unit: perceive → reason → act → observe → reflect, repeated until a completion condition is met. A loop turns a model's one-shot output into a verifiable hypothesis corrected by environmental feedback.
MCP (Model Context Protocol)
An open standard protocol based on JSON-RPC 2.0 for communication between agents and external systems, described by Anthropic as the 'USB-C port of AI applications.' The 2026-07-28 spec added a stateless core, async Tasks, Skills over MCP, and MCP Apps.
Skill
An on-demand folder of instructions, scripts, and resources with SKILL.md at its core that tells an agent how to do a class of tasks. Skills are knowledge rather than code; progressive disclosure keeps them cheap at roughly 100 tokens per entry until actually needed.
Trajectory
An append-only, zstd-compressed JSONL record of a full agent run: system prompts, reasoning, tool calls and results, and subagent scheduling. Trajectories can be inspected, replayed, resumed, forked, and searched, making agent runs auditable.
Agent Plugins
A packaging standard (plugin.json + skills/ + mcp.json) jointly driven by OpenAI, Amazon, Cursor, Microsoft, and Vercel; one install carries both the skill instructions and the MCP connector configuration.
Harness/compute separation
The 2026 architectural split where the trusted harness handles reasoning, tool dispatch, and memory while untrusted compute handles execution. Credentials stay in trusted infrastructure, and Manifest workspace definitions run across seven sandbox providers with a one-line switch.
Partial rollout
Kimi K3's training and evaluation mechanism for long-horizon agent tasks: compute is freed while long tasks wait on reasoning, partially releasable trajectory segments update, and unfinished segments pause then resume, bringing long agent runs into scaled training.
Source: juejin.cn ↗ Google Translate ↗ Backup ↗