Back to index
OtherOne to two hours per issue, published irregularly·Free, with an optional paid subscription

Ahead of AI by Sebastian Raschka

4.7

The best technical AI newsletter I know of. Individual issues are more substantial than most paid courses on the same topics, and the code that accompanies them is what makes it stick.

What We Liked

  • Genuine technical depth, with architecture comparisons and implementation detail rather than summaries
  • Accompanying code turns explanations into things you can run and modify
  • Honest about uncertainty and about which results are actually convincing
  • Free tier includes the substantive material rather than teasing it

What Could Be Better

  • Assumes real familiarity with transformers and training, and does not accommodate beginners
  • Publishes irregularly, so it is a resource rather than a routine
  • Focused tightly on language models, with little on other areas of the field
  • Individual issues are long enough that they require actual time set aside

Detailed review

Most AI newsletters are aggregation. Somebody reads the week's announcements, writes a paragraph about each, and sends it out. That has a place, and it is not the same activity as teaching. Ahead of AI is the other thing.

Individual issues run long, go deep on a specific technical question, and frequently include working code, and the result is closer to a well written technical article series that happens to arrive by email. The depth is what distinguishes it. When a new architectural idea gains attention, the typical treatment tells you it exists and what its proponents claim. The treatment here explains the mechanism, compares it against what came before, notes what the reported results actually demonstrate as opposed to what the abstract implies, and often shows an implementation.

Comparisons of attention variants, discussions of how positional information is handled across different model families, analyses of what changed between successive generations of open models, all get this treatment. You finish an issue understanding something rather than knowing that something happened. The accompanying code is what makes the material stick. Raschka writes clear, minimal implementations that show the idea without the surrounding machinery of a production library, and being able to run and modify a mechanism is the difference between having read about it and understanding it.

This is the same instinct that made his book on building a language model from scratch work, applied in shorter form, and it is the most valuable single feature of the newsletter. The intellectual honesty is worth naming separately. There is a persistent tendency in this field to treat every new result as a breakthrough, and Raschka consistently does not. When a paper's improvement is small, or the evaluation is weak, or the result may not hold outside its specific setup, he says so.

When something is genuinely uncertain, it is presented as uncertain. In a space full of confident overstatement, a writer who calibrates properly is enormously valuable, and it is why I trust the assessments here more than almost anywhere else. The free tier being genuinely substantive deserves credit. The main technical content is free.

The paid subscription supports the work and provides some extras, but the core is not held back to drive conversions, and given the quality of what is given away that is a generous arrangement. The main limitation is that this is not for beginners and does not pretend to be. You need to understand transformer architectures, attention, tokenisation, and the general shape of how these models are trained. Someone without that background will find the material impenetrable, not because it is badly explained but because it is explained at a level that assumes the foundations are in place.

That is the right choice for what this is, but it means it is a resource for people already some way in. Publication is irregular. Issues appear when there is something worth writing about at length rather than on a schedule, which is clearly the right editorial decision and does mean this cannot be your regular way of keeping up. Treat it as an archive to work through and a thing that arrives occasionally rather than a weekly habit.

The scope is tight. This is about language models, their architectures and their training, and adjacent topics get little attention. Computer vision, reinforcement learning outside of alignment applications, and the more applied side of deploying systems are largely absent. That focus is why the depth is possible, so it is a fair trade, but you need other sources for a complete picture.

The length is a real commitment. A substantial issue takes an hour or two to read properly, and skimming defeats the purpose since the value is in the detail. This competes with your actual time rather than with your idle attention, which is an argument for its quality and also a reason issues accumulate unread. Four point seven, and the only reason it is not higher is that it serves a narrow audience narrowly by design.

For someone who already has the foundations and wants to stay genuinely current on language model research, I do not know of anything free that is better. The combination of technical depth, working code and honest calibration is rare individually and close to unique in combination.

[ final ]

The verdict.

If you already understand transformers and want to stay genuinely current rather than merely aware, this is the single best free resource available.