The Bitter Lesson
ยท 3 min read
In 2019, Richard Sutton, one of the pioneers of reinforcement learning, wrote a short but impactful essay titled "The Bitter Lesson". The core argument is simple: history has repeatedly shown that leveraging more computation trumps human-designed domain knowledge in AI. Despite decades of attempts to encode expert rules and handcrafted heuristics into AI systems, raw computational power combined with scalable methods has consistently outperformed these approaches over time.