Machine Learning Fundamentals · 免费预览
为何采用平方损失
当噪声服从高斯分布时,最小化均方误差与最大化数据的似然是等价的,因此同一个损失函数可以同时支撑两种论证依据。
1. The noise assumption, stated precisely
The noise assumption, stated precisely
2. From likelihood to a sum
From likelihood to a sum
3. What survives
What survives
4. Why the first term drops out
The negative log-likelihood under Gaussian noise contains the term summed over examples, along with the squared-error term. The first term is dropped when minimizing over and . Which reason is correct?
5. The likelihood of a single observation
Under Gaussian noise with mean and variance , the density is proportional to . With , the exponent for an observation with residual equals ____.