Back to index
OtherHalf a day·Free tier, platform pricing on request

Encord Documentation and Tutorials

3.7

Detailed material on the unglamorous work that decides whether a vision model works, with genuinely good coverage of annotation quality and curation.

What We Liked

  • Annotation quality and inter annotator agreement are treated as first class problems
  • Dataset curation guidance is better than almost anything else available free
  • Realistic about how much labelling real projects actually require
  • Blog content on active learning and edge cases is substantive

What Could Be Better

  • Written for teams with dedicated annotation capacity, which most do not have
  • Platform specific workflow detail dominates the transferable concepts
  • Little practical guidance on managing an external annotation workforce
  • Cost of doing this properly is understated throughout

Detailed review

Computer vision projects fail on data far more often than on modelling, and Encord's material is one of the better free treatments of why. The annotation quality content is the standout. Inter annotator agreement, meaning the extent to which two people labelling the same image produce the same answer, is a measurement most teams never take and one that explains a great deal about why a model underperforms. The documentation explains how to measure it, what an acceptable level looks like and what to do when your annotators disagree, which is usually that your labelling guidelines are ambiguous rather than that your annotators are careless.

That insight alone is worth the reading time. Dataset curation is covered with unusual seriousness. Which images to label next, how to find the examples the model is currently getting wrong, how to avoid a training set that over represents easy cases, and how to build an evaluation set that actually reflects deployment conditions. This is the work that produces model improvements and it is almost never taught, because it is tedious and produces no satisfying diagram.

The material takes it seriously and I would recommend it on that basis alone. The blog content on active learning and edge case discovery is substantive rather than promotional, which is rarer than it should be. The realism about labelling volume is worth crediting too. The material does not pretend you can train a production vision model on two hundred examples, and it is clear that quality at scale requires process rather than enthusiasm.

The audience assumption is the main limitation. This is written for a team that has annotation capacity, whether internal or contracted, and a project large enough to justify a platform. A researcher labelling their own data or a small team doing this between other work will find the concepts useful and the workflow material aimed at an operation they do not have. Platform specific detail dominates in places, which is expected from vendor documentation and does mean you have to separate the transferable ideas from the interface tour.

The concepts survive translation to any tool. The workflow chapters do not. Managing an annotation workforce goes largely unaddressed and it is the hardest part in practice. Writing guidelines that a person unfamiliar with your domain can follow, handling disagreement, keeping quality steady as annotators change and deciding what to do about the genuinely ambiguous cases are process and management problems, not software problems.

The material treats them as things the platform handles, and mostly it does not. Cost realism is the other gap. Labelling a serious dataset properly is expensive in money or in time, and the material never puts a number anywhere near the reader. Teams routinely underestimate this by an order of magnitude and then compromise on quality, which is precisely the failure the rest of the documentation warns against.

Three point seven. Genuinely educational material on the least glamorous and most decisive part of computer vision work, marked down for assuming an annotation operation the reader may not have and for never confronting what doing it properly actually costs.

[ final ]

The verdict.

Read the curation and quality material regardless of tooling. The workflow content only matters if you run annotation at scale.