How to read books (in the age of AI) | Lex Fridman Podcast

Quick Overview

Lex Fridman discusses the best way to read books in the age of AI, advocating for building things from scratch (like LLMs or reasoning models) as a superior learning method compared to just reading about concepts or relying on pre-packaged solutions, stressing that building provides concrete understanding and minimizes distraction from the internet.

Key Points: Building models like Large Language Models (LLMs) from scratch is considered one of the most powerful ways to learn, offering a deeper understanding than just reading about the concepts. Sebastian Raschka is introduced as an ML/AI research engineer and author of influential books such as 'Build a Large Language Model From Scratch' and 'Build a Reasoning Model'. Nathan Lambert is introduced as a researcher at Allen AI, focusing on reasoning, open models, and RL(VR/HF), and author of 'The RLHF Book'. The discussion contrasts learning by building code (which is precise and verifiable) versus learning purely through reading, where errors might be missed. The hosts agree that building things like LLMs from scratch forces a deeper understanding, contrasting this with reading others' opinions or relying on pre-packaged solutions. The advantage of building from scratch is avoiding the 'rabbit hole' of internet opinions and distractions, allowing focus on the core mechanics. The speaker suggests that while reading books is valuable, using LLMs as an interface layer for data analysis or as a substitute for low-level work can be helpful, but building remains paramount for true learning.

Context: This segment features Lex Fridman in conversation with AI researchers Sebastian Raschka and Nathan Lambert, focusing on the optimal methodology for learning complex technical subjects, specifically in the context of building Large Language Models (LLMs) and related AI systems. The discussion centers on the trade-offs between consuming written knowledge (like books) and actively implementing concepts through coding and building projects from the ground up.