Machine Learning Fundamentals · 免费预览

权重衰减与正则化

权重衰减在训练目标中加入对参数幅度的惩罚，以此用训练数据上更差的拟合来换取更小的泛化差距。

1. The penalized objective

The penalized objective

2. Why a worse train fit is the point

Why a worse train fit is the point

3. Early stopping

Early stopping

4. What the penalty term does to the gradient

The weight-decayed objective adds λ2∥w∥2\frac{\lambda}{2}\|\mathbf{w}\|^2 to the usual loss. Which statement describes the effect on the parameter update?

5. The ridge objective

The ridge objective adds the term ____ to the unregularized training loss, where λ\lambda controls the strength of the penalty.

进入交互式练习

免费注册 · 即时批改 · 自动安排间隔复习。

免费开始这门课