A general-audience deep dive into the full training stack of large language models — pretraining, fine-tuning, RLHF and everything else that turns a language model into a chatbot like ChatGPT.