How People Actually Use AI Agents

Quick Overview

The Anthropic study "Measuring AI agent autonomy in practice" reveals that real-world AI agents exhibit significantly less autonomy than previously assumed, with users frequently interrupting or asking for clarification, especially on more complex tasks, indicating that capability improvements alone do not fully explain observed autonomy.

Key Points: Real-world AI agents currently have much less autonomy than often assumed, as users frequently interrupt or ask for clarification, particularly on complex tasks. The 99.9th percentile turn duration for Claude Code nearly doubled from under 25 minutes (late September 2025) to over 45 minutes (early January 2026), indicating increasing autonomy usage despite model releases. Users interrupt Claude code for clarification (asking for options) more often than they interrupt for intervention (stopping work), especially as task complexity rises. For high-complexity tasks, humans interrupt Claude 8.8% of the time, while Claude asks for clarification 16.4% of the time. The primary reason Claude stops itself is to present the user with a choice (35%), contrasting with the top human interruption reason: providing missing context/corrections (32%). Software engineering accounts for nearly 50% of all agentic tool calls observed, showing its current dominance in deployment. The study suggests that increased autonomy is due to a combination of factors, including user trust building and applying Claude to increasingly ambitious tasks, not purely model capability increases.

Context: This video summarizes findings from Anthropic's February 18, 2026, study titled "Measuring AI agent autonomy in practice," which investigates how users actually interact with and supervise AI agents like Claude Code. The study contrasts theoretical capability assessments with real-world data derived from user interactions, focusing on turn durations, interruption rates, and clarification requests to quantify the actual autonomy exhibited by these agents.