Understand LLM reasoning by creating your own reasoning model–from scratch!
LLM reasoning models have the power to tackle truly challenging problems that require finding the right path through multiple steps. In
Build A Reasoning Model (From Scratch) you’ll learn how to build a working reasoning model from the ground up.
Sebastian Raschka, the bestselling author of
Build a Large Language Model (From Scratch), is your guide on this exciting journey. Sebastian mentors you every step of the way with clear explanations, practical code, and a keen focus on what really matters.
In
Build A Reasoning Model (From Scratch) you’ll learn how to:
- Implement core reasoning improvements for LLMs
- Evaluate models using judgment-based and benchmark-based methods
- Improve reasoning without updating model weights
- Use reinforcement learning to integrate external tools like calculators
- Apply distillation techniques to learn from larger reasoning models
- Understand the full reasoning model development pipeline
Reasoning models break problems into steps, producing more reliable answers in math, logic, and code. These improvements aren’t just a curiosity–they’re already integrated into top models like Grok 4 and GPT-5.
Build A Reasoning Model (From Scratch) demystifies these complex models with a simple philosophy: the best way to learn how something works is to build it yourself! You’ll begin with a pre-trained LLM, adding and improving its reasoning capabilities in ways you can see, test, and understand.