Machine Learning Fundamentals · free preview
Why the Squared Loss
Minimizing mean squared error is the same as maximizing the likelihood of the data when noise is Gaussian, which is why one loss serves two justifications.
1. The noise assumption, stated precisely
The noise assumption, stated precisely
2. From likelihood to a sum
From likelihood to a sum
3. What survives
What survives
4. Why the first term drops out
The negative log-likelihood under Gaussian noise contains the term summed over examples, along with the squared-error term. The first term is dropped when minimizing over and . Which reason is correct?
5. The likelihood of a single observation
Under Gaussian noise with mean and variance , the density is proportional to . With , the exponent for an observation with residual equals ____.
Practice this interactively
Free account · instant grading · spaced review that schedules itself.
Start this course for free