Optimal separating hyperplanes and relaxations ✔ SVMs: nonlinear generalizations of separating hyperplanes ✔ SVM as a function estimation problem ✔ Kernel logistic regression ✔ Reproducing kernel Hilbert spaces ✔ Connections between SVM, KLR and Boosting.