Multivariate Calculus and Optimization · 免费预览
反向传播与自动微分
反向传播与自动微分
1. Backpropagation and Automatic Differentiation
Backpropagation and Automatic Differentiation
2. Quick check: Reverse-mode differentiation
Backpropagation computes gradients by
3. Backpropagation and Automatic Differentiation (2)
Backpropagation and Automatic Differentiation (2)
4. Cost of forward and reverse mode
For a scalar objective depending on parameters, reverse mode costs roughly