What Makes R1 Different
Most frontier models are trained with supervised fine-tuning (SFT) on human-labeled reasoning chains, then refined with RLHF. DeepSeek R1 took a different path: it trained reasoning capability using pure reinforcement learning (GRPO) without any SFT cold-start.
The model learns to reason through trial-and-error against verifiable rewards (math answers, code correctness) rather than imitating human-written chains of thought. The result is a reasoning style that sometimes looks alien but achieves remarkable accuracy on hard problems.
The full research paper is publicly available and worth reading for anyone interested in RL-based training.
Benchmark Results
| Benchmark | DeepSeek R1 | o1-mini | o1 |
|---|---|---|---|
| AIME 2024 | 79.8% | 63.6% | 74.4% |
| MATH-500 | 97.3% | 90.0% | 96.4% |
| Codeforces | 96.3th %ile | 93.4th %ile | 96.6th %ile |
| MMLU | 90.8% | 85.2% | 91.8% |
R1 ties or beats o1 on most benchmarks while being MIT licensed and available to run locally.