Can't believe no one talks about this...

Quick Overview

The shift from 'Context Engineering' (prompting, context window management) to 'Harnesses Engineering' (across-session context management, workflows, tooling, and verification loops) is crucial for enabling long-running, autonomous AI agents that can handle complex tasks reliably by December 2025.

Key Points: The progression in AI agent development moves from Context Engineering (focusing on single-session prompts and context windows) to Harnesses Engineering, which manages state across sessions. Key components of effective harnesses include explicit cross-cutting boundaries in domain architecture, such as enforcing invariants via custom linters and structural tests, not just documentation. Two primary failure modes for long-running agents were identified: agents attempting one-shot solutions and running out of context, and agents prematurely declaring jobs done without proper end-to-end verification. Anthropic's solution involves a two-part structure: an Initializer agent to set up the environment (using init.sh, progress files, and git commits) and a Coding agent for incremental progress. Vercel's experience with their d0 text-to-SQL agent showed that stripping specialized tools down to generic ones (like bash commands: grep, cat, ls) improved performance by 3.5x faster execution, 37% fewer tokens, and a 100% success rate. Effective agent workflows require rigorous verification (build -> verify -> fix until evidence matches spec) and an initial environment setup that provides all necessary context, including a feature list and clean state. The goal is Agent Legibility, where agents can reason directly from the repository itself, using structured documentation (like AGENTS.md) as a system of record, rather than relying on unseen knowledge.

Context: This presentation discusses the evolution of building reliable, long-running autonomous AI agents, contrasting the older method of 'Context Engineering' with the newer paradigm of 'Harnesses Engineering.' The speaker references recent industry experiments and publications from Anthropic (Claude Agent SDK) and Vercel (d0 SQL agent, Cursor browser building) to illustrate the challenges of context management and the solutions developed to achieve greater agent autonomy and reliability.