Here's What They Didn't Tell You About Gemini 3

Quick Overview

Gemini 3 outperforms Claude Sonnet 4.5 and GPT-5.1 on coding benchmarks like LiveCodeBench Pro and SWE-Bench, demonstrating superior reasoning and agentic capabilities, although the CLI implementation for Gemini 3 caused initial frustration due to missing features like sound effects and required multiple reprompts to fix.

Key Points: Gemini 3 significantly beats Claude Sonnet 4.5 by nearly 1,000 Elo points and GPT-5.1 by 200 points on the LiveCodeBench Pro competitive programming benchmark (Elo 2,439). On the SWE-Bench Verified benchmark (real-world GitHub issues), Gemini 3 Pro, Claude 4.5, and GPT-5.1 are in a close performance tie, all scoring between 76-77% (a massive jump from the 60% tier). Gemini 3 showed a large gap on Terminal-Bench 2.0 (Agentic Terminal Coding), scoring 54.2% against Claude's 42.8% and GPT-5.1's 47.6%. The initial implementation of Gemini 3 via the CLI was frustrating, requiring about 20 reprompts to fix errors that Claude only needed about 4 to resolve. The new Agentic development platform, Google Antigravity, was released alongside Gemini 3, enabling agents to autonomously plan and execute complex, end-to-end software tasks. The MonkeyType clone app, built using the Gemini 3 agent, featured a highly polished UI with smooth scrolling and custom themes, though the initial sound effects were not implemented correctly.

Context: This video reviews and benchmarks the newly announced Google Gemini 3 model against competitors like Anthropic's Claude Sonnet 4.5 and OpenAI's GPT-5.1, focusing heavily on coding and agentic performance metrics. The creator also tests the new Google Antigravity agentic development platform by having it build a complex web-based macOS clone application, comparing the results and implementation experience between Gemini 3 and Claude.

Detailed Analysis

The video analyzes the official announcement of Google's Gemini 3 model, comparing its performance across several coding and agentic benchmarks against Claude Sonnet 4.5 and GPT-5.1. In competitive programming (LiveCodeBench Pro), Gemini 3 achieved a massive 2,439 Elo score, beating Claude by nearly 1,000 points and GPT-5.1 by 200 points. On SWE-Bench (real-world GitHub issues), all three leading models are neck-and-neck at 76-77%. Gemini 3 demonstrated a significant lead in agentic terminal coding (Terminal-Bench 2.0) with 54.2%. The creator tested Gemini 3's agent capabilities by having it build a complex 'WebOS-macOS Clone' application using the new Antigravity platform. While the resulting UI was deemed excellent and smooth, the initial experience using the Gemini CLI was frustrating, requiring about 20 reprompts to fix issues, compared to Claude which fixed similar issues in about 4 prompts. The model card confirms Gemini 3 features a massive 1M token context window and native multimodality, but the smaller context window variant was not referenced in the documentation.