Richard Sutton – Father of RL thinks LLMs are a dead end

Dwarkesh Patel interviews Richard Sutton, reinforcement learning pioneer, Turing Award winner and author of The Bitter Lesson. Sutton argues LLMs are a dead end because they cannot learn on the job, and that continual learning from experience will require a new architecture.