Prime Atlas
Begin →
Chapter III

Deep Learning

Networks of simple units, trained end to end. How they compute, how gradients flow back through them, and how to keep them from memorising.

In this chapter

■□□ Foundations ■■□ Practitioner ■■■ Research
  1. § 1 Neural Networks In preparation Level: Foundations
  2. § 2 Backpropagation In preparation Level: Practitioner
  3. § 3 Optimizers: SGD to Adam In preparation Level: Practitioner
  4. § 4 Regularization In preparation Level: Practitioner

Topics: Neural networks · Backpropagation · Optimizers · Regularization · Formats: Plates · Derivations · PyTorch