Interactive edition
Deep Learning
An interactive study companion to the book by Ian Goodfellow, Yoshua Bengio and Aaron Courville (MIT Press, 2016, deeplearningbook.org). Every chapter is rebuilt as annotated equations, labeled diagrams, step-through derivations, live plots, and quizzes — the same math, made visual.
Progress overview
All 116 sections built- Introduction 5/5
- Part I — Applied Math and Machine Learning Basics 22/22
- Part II — Deep Networks: Modern Practices 52/52
- Part III — Deep Learning Research 37/37
New here? Start at the top and read straight through, or jump to any chapter below. Use ← / → to move between sections; the sidebar tracks what you've read.
Introduction
What deep learning is and where it came from — representations, the depth idea, and the three historical waves that led from cybernetics to modern deep networks.
Part I — Applied Math and Machine Learning Basics
The mathematical bedrock — linear algebra, probability and information theory, numerical computation, and the core machine learning concepts (capacity, estimators, MLE, SGD) that every later chapter builds on.
Part II — Deep Networks: Modern Practices
The proven technology of modern deep networks — feedforward nets and back-propagation, regularization, optimization, CNNs, RNNs and sequence models, practical methodology, and large-scale applications.
- 6 Deep Feedforward Networks pp. 168–227
- 7 Regularization for Deep Learning pp. 228–273
- 8 Optimization for Training Deep Models pp. 274–329
- 9 Convolutional Networks pp. 330–372
- 10 Sequence Modeling: Recurrent and Recursive Nets pp. 373–420
- 11 Practical Methodology pp. 421–442
- 12 Applications pp. 443–485
Part III — Deep Learning Research
The research frontier — linear factor models, autoencoders, representation learning, structured probabilistic models, Monte Carlo methods, the partition function, approximate inference, and deep generative models.
- 13 Linear Factor Models pp. 489–501
- 14 Autoencoders pp. 502–525
- 15 Representation Learning pp. 526–557
- 16 Structured Probabilistic Models for Deep Learning pp. 558–589
- 17 Monte Carlo Methods pp. 590–604
- 18 Confronting the Partition Function pp. 605–630
- 19 Approximate Inference pp. 631–653
- 20 Deep Generative Models pp. 654–720