Back to index
OtherSelf-paced, a day for the cookbooks·Free documentation, usage billed per token

Together AI Documentation and Cookbooks

4.0

Clear documentation with a genuinely useful cookbook collection, aimed at people who want open models without operating the hardware themselves. The fine tuning material is better than most vendor documentation.

What We Liked

  • Cookbooks are real working notebooks rather than marketing dressed as tutorials
  • Fine tuning documentation explains the process well enough to transfer elsewhere
  • Model comparison material helps you choose rather than just listing options
  • OpenAI compatible API means what you learn is portable

What Could Be Better

  • Vendor documentation, so tradeoffs against competitors are absent
  • Model catalogue changes fast and older notebooks reference deprecated models
  • Little coverage of what happens when you outgrow a hosted API
  • Cost implications of the choices being taught are underplayed

Detailed review

The open model world has a gap in it. On one side you have running things yourself, which teaches you a great deal and demands hardware, patience and a tolerance for CUDA errors. On the other you have the closed model APIs, which are effortless and give you no visibility into what you are running. Together AI sits in the middle, serving open weight models through an API, and its documentation is aimed squarely at people who want the flexibility of open models without the operational burden.

The cookbooks are the reason to spend time here. They are actual notebooks that run, covering retrieval augmented generation, structured outputs, fine tuning workflows and agent patterns, and they are written at a level that assumes you can code but not that you already know the domain. That combination is rarer than it should be. A lot of vendor tutorials are either trivial hello world examples or thinly disguised feature advertisements, and these are neither.

You can work through them and come out able to build something. The fine tuning documentation is the strongest section and the one I would point people to specifically. It covers data formatting, hyperparameter choices, what LoRA is doing and how to evaluate whether the resulting model is actually better. Crucially, most of that knowledge transfers.

If you later move to fine tuning on your own hardware with Axolotl or the Hugging Face stack, the conceptual grounding you got here still applies, because the underlying process is the same and only the interface changed. Vendor documentation that teaches transferable concepts rather than platform lock in deserves credit. The model selection material is more useful than the equivalent elsewhere. Rather than listing every available model with a parameter count, there is genuine guidance about which models suit which tasks, where the quality and cost tradeoffs sit, and when a smaller model is sufficient.

For someone new to open models, the catalogue is bewildering and this material meaningfully reduces the bewilderment. The OpenAI compatible API is a quiet virtue that is worth naming. Because the interface matches a widely used standard, code you write against it moves elsewhere with minimal change, and the patterns you learn are not specific to this company. That reduces the risk of investing learning time here, and it is a point in favour of the platform generally.

The limitations follow from what this is. It is vendor documentation and it will never tell you that a competitor serves a particular model faster or cheaper, or that for your use case a closed model would be better. That is not dishonesty, it is the nature of the format, and the correction is simply to read comparative material elsewhere before committing. Anyone treating a single vendor's documentation as a neutral survey of the field is making an error regardless of which vendor it is.

The pace of change causes real problems for the notebooks. Open models are released and deprecated quickly, and cookbooks written against a model that is no longer served fail in ways that confuse a newer learner. The concepts survive, the specific model names do not. Check what is currently available and substitute before you assume the notebook is broken.

Nothing is said about the point at which a hosted API stops being the right answer. There is a real threshold where volume makes self hosting cheaper, or where latency requirements demand something the API cannot provide, and that threshold matters to anyone planning a serious build. Vendor documentation is never going to cover it, but a learner should know that the question exists and should think about it before the bill makes the point for them. The cost framing is similarly light.

Per token pricing is stated clearly enough, but the tutorials do not consistently connect the techniques being taught to their cost implications. A retrieval pipeline that stuffs a large context on every request costs a great deal more than one that retrieves selectively, and that is a design decision with a price attached. Working through the material with an eye on what each pattern would cost at scale is a useful discipline and the documentation will not prompt you to do it. Four point zero for documentation that teaches genuinely transferable skills, particularly around fine tuning, with a cookbook collection that respects the reader's time.

Held back by the inevitable limits of vendor material and by a model catalogue that moves faster than the tutorials written against it.

[ final ]

The verdict.

A good practical route into working with open models if you would rather not manage GPUs. The fine tuning material in particular teaches concepts that survive a change of provider.