Lecture 02b

k-Nearest Neighbor

argmax

Playlist

Slides

Additional Material

  • Chapter 1.4.1 - 1.4.3 in Machine Learning: A Probabilistic Perspective, Kevin Murphy.
  • Probabilistic k-NN: Chapter 14 Nearest Neighbour Classification in Bayesian Reasoning and Machine Learning, David Barber.
  • Neighbourhood Components Analysis, J. Goldberger, S. Roweis, G. Hinton, R. Salakhutdinov
  • Chris Colah gives a very nice introduction to information theory and can help you understand entropy.