🎂 ThursdAI 3rd Birthday: Karpathy's Auto Researcher, Fly Brain Upload, OpenClaw in China & more

Quick Overview

The third anniversary episode of ThursdAI celebrated three years of tracking AI developments since the launch of GPT-4, highlighting massive cost efficiency improvements in LLMs, the emergence of autonomous AI researchers like Karpathy's Auto Researcher, the simulation of a complete fruit fly brain with 91% behavioral accuracy by Eon Systems, and the overwhelming adoption of OpenCLAW in China, signaling significant acceleration toward advanced AI capabilities.

Key Points: The podcast celebrated its third anniversary, marking the start date near GPT-4's launch on March 14th, 2023, noting context window costs have drastically decreased, with one host spending a billion tokens in 24 hours without hitting a $200 limit. Andrej Karpathy released an autonomous AI agent researcher that achieved an 11% speedup in GPT-2 training time by autonomously modifying training code, which hosts view as a 'mini singularity moment' showing scaling improvements. Eon Systems uploaded the first complete fruit fly brain connectome into a physics simulation, achieving 91% behavioral accuracy with 140,000 neurons and 50 million synapses, prompting comparisons to uploaded intelligence concepts like the Netflix show Pantheon. OpenCLAW is seeing massive adoption in China, with 50% of tracked instances running there, leading to people lining up for installation subsidies, though the central government later warned against security risks. Nvidia announced a $26 billion commitment over five years to build the world's best open-source models, coinciding with the launch of their 120-billion-parameter Nemotron 3 Super model featuring a 1 million context window. XAI quietly released Grok 4.20 via API, which features a 2 million token context window but is notably 10 times more expensive per million tokens than its predecessor, 4.1. Google launched Gemini Embeddings 2, natively supporting multimodal data including text, images, and video within the same vector space, enabling advanced semantic sorting and querying.