Notes.
5 notes
Why the median minimises absolute error and the mean minimises squared error, by nudging the guess.
A mathematical textbook connecting likelihood, entropy, KL divergence, statistical estimation, and probabilistic machine learning, with worked examples and solved exercises.
One hidden coin connects conditional independence, Bayesian updating, prediction, Naive Bayes, and maximum-likelihood estimation.
Compare formal uncertainty propagation with significant-figure rules, and distinguish standard deviation from standard error.
Adding a constant feature folds the intercept into linear regression’s weight vector without conflating it with statistical bias.