Lecture 3 4 Regularization

Summary

After three heads in a row, maximum likelihood says the coin always lands heads. A prior pulls that estimate back to 0.8. Machine Learning by Andrew Ng [Coursera] 0308 The problem of overfitting 0309 Cost function 0310 Sebastian's books: sebastianraschka.com/books/ Slides: ... Exercise Notebook: ds100.org/sp20/resources/assets/ Ridge Regression is a neat little way to ensure you don't overfit your training data - essentially, you are desensitizing your model ... Weight Decay, Early stopping, Manifold Tangent Classifier, Noise injection. Hello! We have got some more math to cover. Again we use KL, both to keep our RL runs from over-optimizing reward models ... Elastic-Net Regression is combines Lasso Regression with Ridge Regression to give you the best of both worlds. It works well ...