Multivariate Calculus and Optimization · free preview

Backpropagation and Automatic Differentiation

Backpropagation and Automatic Differentiation

1. Backpropagation and Automatic Differentiation

Backpropagation and Automatic Differentiation

2. Backpropagation and Automatic Differentiation (2)

Backpropagation and Automatic Differentiation (2)

3. Reverse-mode differentiation

Backpropagation computes gradients by

4. Cost of forward and reverse mode

For a scalar objective depending on nn parameters, reverse mode costs roughly

Practice this interactively

Free account · instant grading · spaced review that schedules itself.

Start this course for free