5 Papers That Show Where AI Research Is Heading Right Now

Quick Overview

AI research is shifting toward intelligence per sample and intelligence per watt, prioritizing data scaling and self-play over human-labeled data to achieve greater efficiency and performance. Researchers are moving away from relying on human domain knowledge, instead finding that large-scale, unsupervised training on raw data—such as protein sequences or synthetic self-play tasks—yields models that outperform hand-engineered systems.

Key Points: Protein language models like ESMC reach performance parity with hand-engineered systems by utilizing 2.8 billion sequences, proving that "more data ends up being really important." Self-play for LLMs using asymmetric strategies, where a conjecturer generates tasks and a solver attempts them, allows models to exceed human-level performance beyond initial training data. Intelligence per sample is the new critical metric, as current In-Context Learning (ICL) fails to improve monotonically, hitting performance cliffs at context length limits. Standard RL-based self-play often plateaus due to models generating "messy, artificially complex and elegant problems" that lack real-world utility, requiring a 'guide' to ground tasks in relevant distributions. Streaming RAG (Retrieval-Augmented Generation) addresses latency in voice AI by analyzing audio input in real-time chunks rather than waiting for the user to finish speaking. The 'bitter lesson' holds in biology; models trained only on sequences learn complex structural motifs like the 'nucleophilic elbow' without any explicit supervision.

Context: The video features a research club meeting where AI practitioners discuss cutting-edge papers and methodologies. The discussion centers on moving beyond human-generated data and hand-coded heuristics, which the speakers argue limit model potential. Topics range from protein folding and biological sequences to large-scale reinforcement learning (RL) and real-time voice agent architecture, all unified by the goal of creating more autonomous, efficient, and capable AI systems.