Understanding Machine Learning

Understanding Machine Learning 2014
Course Lecture Notes and Videos

Shai Shalev-Shwartz

The course follows the book:
[Understanding Machine Learning: From Theory to Algorithms

• Motivation lecture, Lecture 1: Online learning, Linear predictors, python demonstration code.
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3 Part 4
• Lecture 2: PAC learning, the fundamental theorem of learning, VC dimension.
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 3: General PAC model, uniform convergence, linear regression and least squares, bias-complexity tradeoff, validation and model selection.
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 4: Boosting. I've also completed the last part of lecture 3 (validation and model selection).
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 5: MDL,SRM,Nonuniform learnability, Consistency, Decision Trees, Nearest Neighbor.
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 6: convexity, convex optimization, surrogate losses, SGD
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 7: SGD and RLM for convex learning problems
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 8: SVM and kernels
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 9: Multiclass, Ranking, and Structured Output Prediction
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Lecture 10: Neural Networks and Deep Learning
  Videos (in Hebrew) available on YouTube: Part 1 Part 2
• Deep Learning (as given in 2016)
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Deep Learning Part I (as given in 2017)
  Videos (in Hebrew) available on YouTube: Part 1 Part 2 Part 3
• Deep Learning Part II (as given in 2017 by Yonatan Wexler)
  Videos (in Hebrew) available on YouTube: Part 1 Part 2
  code
• Lecture 11: Dimensionality Reduction
  Videos (in Hebrew) available on YouTube: Part 1 Part 2
• Lecture 12: Clustering
  Videos (in Hebrew) available on YouTube: Part 1
• Lecture 13: Features
  Videos (in Hebrew) available on YouTube: Part 1 Part 2
• Lecture 14: Generative Models
  Videos (in Hebrew) available on YouTube: Part 1 Part 2
• Reinforcement Learning (given in 2016)
  Videos (in Hebrew) available on YouTube: Part 1 Part 2

Mario Marchand translated the slides to French.