How to code with AI agents - Advice from OpenClaw creator | Peter Steinberger and Lex Fridman

Quick Overview

The discussion between Lex Fridman and Peter Steinberger centers on the development and application of AI agents, specifically highlighting the difficulty in maintaining human empathy and context when relying on AI for complex engineering tasks, which often leads to agents struggling or producing frustrating results that require manual cleanup, as illustrated by the 'Curve of Agentic Programming' graph.

Key Points: Peter Steinberger uses the "Curve of Agentic Programming" to illustrate that early, simple agent tasks are easy ("ple fix this"), but complexity peaks when coordinating multiple agents (e.g., 8 agents at once, complex orchestration) before declining as systems mature enough to handle large, full-stack features. The speaker notes that he now prefers 'agentic engineering' over 'vibe coding' because it forces more structured thinking about architecture and agent interaction. A key challenge discussed is the difficulty in ensuring AI agents maintain context and empathy, especially when agents start performing actions that require implicit human understanding. Steinberger mentions that he doesn't write long prompts for his agents; instead, he relies on short prompts and then iterates based on the agent's output, a process he finds more effective than overly verbose initial instructions. The discussion touches upon the Anthropic 'Soul Document' (07:37), which defines an AI's core values (like honesty over sycophancy), noting that this is crucial for building reliable agents that don't just follow instructions blindly. The speaker suggests that when agents struggle, it's often because the human programmer failed to provide sufficient context or empathy, leading the agent down a wrong path, which is why human feedback remains essential. The speaker states he now primarily uses local CI (Continuous Integration) systems for testing agent prompts rather than relying on cloud-based systems like Codex or Clawd for initial development.

Context: This segment is an interview on the Lex Fridman Podcast, featuring Peter Steinberger, the creator of OpenClaw, a framework for building AI agents. The conversation revolves around the practical challenges and philosophical implications of programming and orchestrating multiple AI agents to perform complex software engineering tasks. They specifically analyze a slide detailing the 'Curve of Agentic Programming,' which maps increasing complexity as agents become more sophisticated, and discuss the role of human empathy and context in effectively guiding these agents.