What is Autoresearch?

Quick Overview

Andrej Karpathy's concept of "Autoresearch" involves using an AI agent in a continuous loop to plan, execute, and analyze short training experiments on AI models to achieve a specified goal, automating the tedious process of hyperparameter tuning and model improvement, which can be productized into niche 'agent in a box' products, marketing optimization services, internal productivity labs, or financial auto-quant tools.

Key Points: Autoresearch is defined as a super-nerd robot intern that runs science experiments on AI models overnight, iterating on plans, code edits, training, result reading, and deciding the next step. The core loop involves: plan what to try, edit code, run a short training experiment (e.g., 5 minutes on a GPU), read results, and decide what to change next, repeating until better results are found. Five potential business models utilizing autoresearch include: Niche 'agent in a box' products (like an Amazon listing experimenter), Print-money A/B testing for marketing, Research-as-a-Service, Power-tool inside your own product, and Agency selling '100x more testing' than competitors. The Research-as-a-Service model involves a loop of search -> read -> summarize -> compare -> repeat, charging per report or via monthly subscription for dashboards. The internal 'productivity lab' involves defining KPIs (like response time, close rate) and letting agents iterate on workflows, templates, and routing rules to reduce manual work and focus leadership on high-impact decisions. The setup process shown requires Python 3.10+, an NVIDIA GPU (or equivalent like Apple M1 Pro with Metal/MPS support), installing UV, cloning Karpathy's GitHub repository, installing dependencies, running prepare.py, and then train.py. Karpathy's work has inspired AgentHub, an agent-swarm collaboration platform described as the 'GitHub for agents.'

Context: The video discusses Andrej Karpathy's concept of "Autoresearch," which he recently launched as an open-source project, and explores ten potential business models derived from this technology. The presentation explains what autoresearch is—an automated AI agent loop for scientific experimentation—and shows installation steps via a Google Colab environment, emphasizing its potential to revolutionize AI development and various business operations.