The Bitter Lesson: How Software Changes in 2026

Quick Overview

The future of software development by 2026 shifts from humans designing then agents building to agents building tools that other agents use recursively, driven by the principle that general methods leveraging massive computation always beat encoded knowledge at scale, as evidenced by AI advancements in Chess, Go, and now code generation.

Key Points: The core lesson from 70 years of AI research is that general methods leveraging computation outperform encoded knowledge by a large margin. Software development is predicted to shift by 2026 from a linear, human-driven process ("Humans design. Then agents build.") to a recursive, agent-driven one ("Agents build. Other agents use."). Current AI tools like Claude Code demonstrate early autonomy with file operations and web search, but the next generation (2026+) will see agents writing tools and infrastructure for other agents. The progression of AI in problem-solving has moved from brute-force search (Deep Blue, 1997) to neural nets and self-play (AlphaGo, 2016) and is now accelerating into agents writing code better than frameworks (projected 2025). The key insight is that progress is limited by the floor, not the ceiling, meaning each era enables capabilities of the next, and the surface of abstraction has barely been scratched. The author strongly encourages adopting the computation-leveraging approach, warning that the human-knowledge approach will lose in the long run.

Context: This presentation analyzes Rich Sutton's "The Bitter Lesson," which posits that general AI methods that leverage massive computation ultimately succeed over methods that rely on encoding human knowledge. The speaker applies this lesson to the domain of software development, predicting a significant paradigm shift by 2026 where AI agents build tools for other AI agents, moving away from the current top-down, human-driven development process.

Detailed Analysis

The video dissects the implications of Rich Sutton's "The Bitter Lesson" for software development, splitting the future into two streams: "How We Build" (tools/methods) and "What We Build" (products/systems). The fundamental takeaway is that general methods that harness massive computation consistently beat methods that attempt to encode human expertise, as seen historically in Chess (Deep Blue's brute force) and Go (AlphaGo's self-play). The speaker projects that by 2026, software development will transition from humans designing and agents executing (a linear, top-down model) to agents building tools for other agents recursively (a bottom-up, agent-driven model). Current tools like Claude Code show agents gaining autonomy in file operations and web search, but the next leap involves agents creating tools, APIs, and infrastructure autonomously. This shift accelerates because every layer of abstraction opens new possibilities. The speaker emphasizes that this is not a preference but a mathematical inevitability: where data exists, general methods at scale will always beat encoded knowledge over time. The video concludes that current agentic systems, like GitHub Copilot, are just the beginning, and the tools that matter in 2026 will make today's systems look like simple autocomplete.