Back to index
Other18 lectures, a serious term of work if you do the problems·Free

Learning From Data (Caltech CS156)

4.6

The course to take when you want to understand why machine learning works at all, not just how to call a library. Abu-Mostafa's lectures are a masterclass in making hard theory feel inevitable.

What We Liked

  • The clearest treatment of generalization theory, the VC dimension, and bias-variance I have come across
  • Abu-Mostafa is a superb lecturer who builds intuition before formality
  • Completely free, with all 18 lectures, problems, and the companion book material
  • Timeless, the theory it teaches does not age the way tool tutorials do

What Could Be Better

  • Mathematically demanding, you need comfort with probability and linear algebra
  • Predates the deep learning era, so modern architectures are not the focus
  • Theory first, so do not expect to be building trained models by the end

Detailed review

Learning From Data is the course I recommend to anyone who can already train a model but has a nagging sense they do not really know why it generalizes. Yaser Abu-Mostafa spends the term on the deep question underneath all of machine learning, which is how a finite amount of data can ever justify a claim about data you have not seen, and he answers it properly with the theory of generalization, the VC dimension, the bias-variance tradeoff, regularization, and validation. What makes it special is the teaching. Abu-Mostafa builds intuition first and reaches for the formalism only once you already feel why it has to be true, so results that look forbidding in a textbook arrive feeling almost obvious, and the famous lecture on overfitting alone is worth the price of admission, which is nothing.

It is rigorous without being cold, and the problems are where the understanding actually settles in, so treat it as a course to work through rather than a series to watch. The caveats are honest. This is mathematically demanding and assumes real comfort with probability and linear algebra, so it is not a gentle introduction and it will frustrate anyone hoping to skip the equations. It also predates the deep learning era, so you will not find transformers or modern architectures here, and that is fine because the principles it teaches apply to them anyway, but you should not expect coverage of today's models.

And it is theory first, so you finish it understanding learning deeply rather than holding a fresh pile of trained projects. Taken for what it is, the theoretical backbone that almost every practical course quietly leaves out, it is close to perfect, and I would tell any serious learner to take a hands-on course first and then come here to find out why all of it works.

[ final ]

The verdict.

Essential if you want the theoretical backbone that most practical courses skip. Take it after you can already train a model, and it will explain why everything you have been doing actually works.