Back to index
OtherSelf-paced, ongoing reference·Documentation free, compute on reserved, on-demand and spot plans

CoreWeave Documentation

3.4

Serious infrastructure documentation for people running AI training at real scale. Clear and well-organised, and it assumes a level of Kubernetes and cluster knowledge that puts it out of reach for most learners.

What We Liked

  • Covers the genuine production stack, bare metal Kubernetes, Slurm, high-performance networking
  • SUNK, their Slurm on Kubernetes approach, addresses a real and rarely documented problem
  • Observability coverage with Grafana dashboards and alerting is properly practical
  • Documents storage and networking, which are the parts that actually bottleneck large training runs

What Could Be Better

  • Assumes substantial Kubernetes expertise, with no on-ramp for anyone without it
  • Pricing is referenced but not published in the docs, so you cannot plan costs from them
  • Almost nothing here is useful below multi-node cluster scale
  • Pure reference with no tutorials, concepts or learning sequence

Detailed review

CoreWeave has become one of the significant names in AI compute, and its documentation is aimed unapologetically at people running large workloads. The product surface covers CoreWeave Kubernetes Service, bare metal Kubernetes for training and inference; SUNK, which is Slurm on Kubernetes for batch work; inference with serverless and dedicated serving; S3-compatible object storage and distributed file systems; VPCs, Direct Connect and high-performance interconnects; and ephemeral sandbox environments. The docs cover account setup, environment configuration, running a first workload, security, instances, regions, billing and observability with Grafana dashboards and alerting. The educational value, for the right reader, is in seeing what production AI infrastructure actually consists of.

There is a persistent illusion in machine learning education that the model is the hard part. Read this documentation and the real picture emerges. Storage architecture, because feeding hundreds of GPUs means your data pipeline becomes the bottleneck long before your compute does. Networking, because gradient synchronisation across nodes is where distributed training performance lives or dies, which is why InfiniBand and interconnect topology get their own sections.

Scheduling, because keeping expensive hardware utilised is most of what determines whether a cluster is economic. None of that appears in a deep learning course and all of it determines whether a large training run succeeds. SUNK is the most interesting piece conceptually. There is a long-running tension between the HPC world, which runs Slurm and thinks in batch jobs and queues, and the cloud native world, which runs Kubernetes and thinks in containers and controllers.

AI workloads genuinely need both, batch scheduling for training and container orchestration for serving, and running Slurm on top of Kubernetes is a pragmatic answer to that. It is a real architectural problem that is barely written about publicly, and seeing how one company resolved it is instructive. The observability material is solid and practical, with Grafana dashboards and alerting covered properly rather than as an afterthought. GPU utilisation monitoring in particular is the sort of thing that sounds boring until you discover a training run has been at 30 percent utilisation for two days.

The limitations are stark for anyone outside the target audience. This assumes you know Kubernetes well, and not the tutorial version, the version where you understand node pools, taints, tolerations, CNI plugins and why your pods are pending. There is no on-ramp, no conceptual introduction and no tutorial sequence. It is a reference for people who already do this job.

Pricing is discussed structurally, reserved, on-demand and spot, without published rates in the docs, so you cannot cost anything from them. Compared with Daytona publishing per-second GPU rates openly, that is a step backwards for anyone trying to evaluate options. And the honest scoping point: essentially none of this matters below multi-node cluster scale. If you are training on one or two GPUs, none of these problems are yours yet.

Three point four. Excellent reference for a small and important audience, rated for its near-total inaccessibility to everyone else.

[ final ]

The verdict.

Read this if you are responsible for a training cluster. If you are learning machine learning, it is several years early and will only intimidate you.