Construction pipeline
Textbook selection, hierarchical chapter recovery, Proof QA and Gap QA extraction, followed by five quality-control checks.
1 University of Science and Technology of China2 Fudan University 3 Shanghai AI Laboratory4 Shanghai Jiao Tong University
* Equal contribution † Corresponding authors
Mathematical supervision for language models is typically flattened into isolated problem–solution pairs, discarding the curricular organization and evidential structure of the original sources. We introduce TOME-Math (Textbook-Oriented Mathematical Evidence), a large-scale corpus that converts 2,118 textbooks spanning the core areas of university-level mathematics into approximately 380K structured proof-supervision records while preserving chapter order, proposition–proof links, dependency references, and source provenance.
Leveraging these structural signals, we explore curriculum learning across multiple mathematical subjects and characterize scaling patterns with supervision volume and source breadth. At full scale, fine-tuning on TOME-Math raises the unweighted mean score across our held-out evaluations and established public benchmarks by 16.7 percentage points over the base model, while exceeding all three public instruction-data baselines evaluated in aggregate. Our findings highlight structured textbooks as both a scalable source of mathematical supervision and an empirical framework for studying the impact of data organization on mathematical reasoning.
Overview of TOME-Math. Traditional pipelines flatten heterogeneous sources into isolated QA, while TOME-Math preserves textbook structure through structured QA construction and curriculum-based supervision.
How the corpus is built, filtered, and evaluated for quality.
Textbook selection, hierarchical chapter recovery, Proof QA and Gap QA extraction, followed by five quality-control checks.
The construction funnel shows how generated candidates become the final corpus; the radar plot compares model configurations across quality criteria.
Proof QA captures complete proposition–proof units. Gap QA turns missing local proof obligations into explicit training targets.
QA composition
Corpus hierarchy
Subject distribution
Top 10 target subjects.
Each textbook proposition yields a complete Proof QA and focused Gap QA that make its intermediate proof obligations explicit.
Differential Geometry
Parsed chapter Markdown Chapter 4.2 · \(\mathbb H^2\) shortest paths
Question
Answer
Question
Answer
Discrete Mathematics
Parsed chapter Markdown Chapter 2.6 · Spectrum and independence number
Question
Answer
Question
Answer
Probability
Parsed chapter Markdown Chapter 5.8 · The beta distributions
Question
Answer
Question
Answer
Abstract Algebra
Parsed chapter Markdown Chapter 6.8 · Action on cosets
Question
Answer
Question
Answer
Mathematical Analysis
Parsed chapter Markdown Chapter 6.11 · Taylor formula
Question
Answer
Question
Answer
Topology
Parsed chapter Markdown Chapter 2.6 · Interior
Question
Answer
Question
Answer
Textbook excerpts come directly from parsed chapter Markdown. QA wording is expert-edited for self-containment and to prevent answer leakage; each pair remains grounded in the same source record.
+16.7 ppaverage gain over the base model
| SFT corpus | TOME-LongForm | TOME-Objective | MiniF2F | ProofNet | MATH-500 | AIME-26 | Avg. |
|---|---|---|---|---|---|---|---|
| Base model No SFT | 13.25 | 32.93 | 34.45 | 17.14 | 68.80 | 8.44 | 29.17 |
| OpenMath1 1.82M | 20.16 | 33.86 | 22.87 | 19.25 | 70.40 | 8.21 | 29.13 |
| MetaMath 395K | 28.73 | 34.66 | 40.70 | 22.55 | 71.20 | 9.98 | 34.64 |
| MathInstruct 262K | 35.87 | 40.69 | 52.05 | 32.93 | 73.05 | 11.98 | 41.10 |
| TOME-Math 364.6K | 43.86 | 43.96 | 57.43 | 42.98 | 76.55 | 10.19 | 45.83 |
Same Qwen3-30B-A3B-Base backbone; one epoch per corpus. SFT = supervised fine-tuning; AIME-26 = AIME 2026. Scores (%); Avg. is the mean across six benchmarks; bold marks the best result. K / M = thousand / million training examples; pp = percentage points.
Our evaluation sets. TOME-LongForm: 300 proof-heavy exercises from held-out textbooks across six mathematical subjects, scored for proof correctness. TOME-Objective: 145 multidisciplinary objective questions, scored by final-answer equivalence.
Retrieving propositions and local proof obligations raises TOME-LongForm pass@1 from 13.25% to 17.38%.
Frozen base model, 300 problems. All four retrieval policies share the same context-token budget.
Single-solution success rate · Pass@1 (%)
Forward–Gap leads in all 18 subject–scale settings. Every schedule improves as the supervision budget grows.
More textbook sources improve learning at a fixed budget, while subject-specific supervision transfers across mathematical fields.
More sources, same budget. Expanding from 8 books (narrow–dense) to 16 books (broad–sparse) improves all six subjects by 3.3 percentage points on average, with the same 0.75M-token budget.
Reasoning transfers across subjects. Cross-subject pass@16 averages 0.92× the target specialist’s score. Values above 1 indicate performance exceeding that specialist.
Subject key: Alg. = Abstract algebra; Ana. = Mathematical analysis; Prob. = Probability; DG = Differential geometry; Disc. = Discrete mathematics; Top. = Topology. Heatmap rows show the training subject; columns show the evaluation subject.