Scaling Mathematical Proof Supervisionfrom Structured Textbooks

Youqing Fang1,3,*, Zhouqi Hua2,3,*, Yinhao Tang1,3, Yuzhe Gu3,4, Lingkai Kong3,4 Bin Liu1, Weiming Zhang1, Kai Chen3, Yanan Sun3,†, Wenwei Zhang3,†

1 University of Science and Technology of China2 Fudan University 3 Shanghai AI Laboratory4 Shanghai Jiao Tong University

* Equal contribution    † Corresponding authors

Brief Introduction

Mathematical supervision for language models is typically flattened into isolated problem–solution pairs, discarding the curricular organization and evidential structure of the original sources. We introduce TOME-Math (Textbook-Oriented Mathematical Evidence), a large-scale corpus that converts 2,118 textbooks spanning the core areas of university-level mathematics into approximately 380K structured proof-supervision records while preserving chapter order, proposition–proof links, dependency references, and source provenance.

Leveraging these structural signals, we explore curriculum learning across multiple mathematical subjects and characterize scaling patterns with supervision volume and source breadth. At full scale, fine-tuning on TOME-Math raises the unweighted mean score across our held-out evaluations and established public benchmarks by 16.7 percentage points over the base model, while exceeding all three public instruction-data baselines evaluated in aggregate. Our findings highlight structured textbooks as both a scalable source of mathematical supervision and an empirical framework for studying the impact of data organization on mathematical reasoning.

Overview of TOME-Math. Traditional pipelines flatten heterogeneous sources into isolated QA, while TOME-Math preserves textbook structure through structured QA construction and curriculum-based supervision.

380,292QA pairs
2,118textbooks
66,537chapters
29target math subjects

Construction and characterization.

How the corpus is built, filtered, and evaluated for quality.

Composition and quality

The construction funnel shows how generated candidates become the final corpus; the radar plot compares model configurations across quality criteria.

Dataset composition

Proof QA captures complete proposition–proof units. Gap QA turns missing local proof obligations into explicit training targets.

QA composition

Proof QA205,86154.1%
Gap QA174,43145.9%

Corpus hierarchy

Subjects29
Books2,118
Chapters66,537
QA records380,292

Subject distribution

Largest fields in the release candidate

Top 10 target subjects.

Representative supervision pairs

Each textbook proposition yields a complete Proof QA and focused Gap QA that make its intermediate proof obligations explicit.

Differential Geometry

Triangle inequality in the hyperbolic plane
Geometry: From Isometries to Special Relativity
Quality A
01 Original textbook excerpt Chapter 4.2 · \(\mathbb H^2\) shortest pathsRead the source theorem and textbook proof

Parsed chapter Markdown Chapter 4.2 · \(\mathbb H^2\) shortest paths

According to Theorem 4.9, we can formulate a triangle inequality for the hyperbolic plane. Corollary 4.11 (Triangle inequality for the hyperbolic plane). For three points \(p_{1}, p_{2}\) , and \(p_{3}\) in the hyperbolic plane,\[d_{\mathbb{H}^{2}}(p_{1}, p_{3}) \leq d_{\mathbb{H}^{2}}(p_{1}, p_{2}) + d_{\mathbb{H}^{2}}(p_{2}, p_{3}),\]where the equality holds if and only if \(p_{2}\) lies on the \(\mathbb{H}^{2}\) - shortest path from \(p_{1}\) to \(p_{3}\) . Proof. Let \(\gamma_{ij}\) be the \(\mathbb{H}^{2}\) - shortest path from \(p_{i}\) to \(p_{j}\) for \(1 \leq i < j \leq 3\) . Then,\[d_{\mathbb{H}^{2}}(p_{i}, p_{j}) = l_{\mathbb{H}^{2}}(\gamma_{ij}).\]Note that the union (denoted by \(\delta\) ) of \(\gamma_{12}\) and \(\gamma_{23}\) is a path from \(p_{1}\) to \(p_{3}\) (Figure 4.6). According to Theorem 4.9,\[d_{\mathbb{H}^{2}}(p_{1}, p_{2}) + d_{\mathbb{H}^{2}}(p_{2}, p_{3}) = l_{\mathbb{H}^{2}}(\delta) \geq l_{\mathbb{H}^{2}}(\gamma_{13}) = d_{\mathbb{H}^{2}}(p_{1}, p_{3}),\]and the equality holds if and only if \(\delta\) has the same path as \(\gamma_{13}\) , which means that point \(p_{2}\) lies on path \(\gamma_{13}\) . \(\square\)
02 Proof QA Recover the complete textbook proof.Open the generated question
Let \(p_1,p_2,p_3\) be points in the hyperbolic plane \(\mathbb H^2\). Prove the triangle inequality\[d_{\mathbb H^2}(p_1,p_3)\le d_{\mathbb H^2}(p_1,p_2)+d_{\mathbb H^2}(p_2,p_3),\]and prove that equality holds if and only if \(p_2\) lies on the unique hyperbolic shortest path from \(p_1\) to \(p_3\).
Let \(\gamma_{ij}\) be the hyperbolic shortest path from \(p_i\) to \(p_j\), and set \(\delta=\gamma_{12}*\gamma_{23}\). Then\[l_{\mathbb H^2}(\delta)=l_{\mathbb H^2}(\gamma_{12})+l_{\mathbb H^2}(\gamma_{23})=d_{\mathbb H^2}(p_1,p_2)+d_{\mathbb H^2}(p_2,p_3).\]Since \(\gamma_{13}\) is a shortest path from \(p_1\) to \(p_3\),\[d_{\mathbb H^2}(p_1,p_3)=l_{\mathbb H^2}(\gamma_{13})\le l_{\mathbb H^2}(\delta),\]which proves the triangle inequality. If equality holds, then \(\delta\) is also a shortest path from \(p_1\) to \(p_3\). Uniqueness implies that \(\delta\) and \(\gamma_{13}\) have the same trajectory, so \(p_2\in\gamma_{13}\). Conversely, if \(p_2\) lies on \(\gamma_{13}\), splitting \(\gamma_{13}\) at \(p_2\) gives two shortest subpaths whose lengths add, and equality follows.
03 Gap QA Make one intermediate proof obligation explicit.Open the generated question
Let \(p_1,p_2,p_3\in\mathbb H^2\). For \(1\le i<j\le3\), let \(\gamma_{ij}\) denote the unique hyperbolic shortest path from \(p_i\) to \(p_j\), and let \(\delta=\gamma_{12}*\gamma_{23}\) be their concatenation through \(p_2\). Assume that\[d_{\mathbb H^2}(p_1,p_3)=d_{\mathbb H^2}(p_1,p_2)+d_{\mathbb H^2}(p_2,p_3).\]Prove that \(\delta\) has the same trajectory as \(\gamma_{13}\), and hence that \(p_2\) lies on the hyperbolic shortest path from \(p_1\) to \(p_3\).
By construction,\[l_{\mathbb H^2}(\delta)=d_{\mathbb H^2}(p_1,p_2)+d_{\mathbb H^2}(p_2,p_3).\]The assumed equality therefore gives \(l_{\mathbb H^2}(\delta)=d_{\mathbb H^2}(p_1,p_3)\). Thus \(\delta\) attains the minimum possible length among all paths from \(p_1\) to \(p_3\), so it is itself a hyperbolic shortest path. The shortest path between two points of \(\mathbb H^2\) is unique up to reparametrization. Hence \(\delta\) and \(\gamma_{13}\) have the same trajectory. Since \(\delta\) passes through \(p_2\) by construction, \(p_2\) lies on \(\gamma_{13}\).

Textbook excerpts come directly from parsed chapter Markdown. QA wording is expert-edited for self-containment and to prevent answer leakage; each pair remains grounded in the same source record.

Results and insights

Stronger mathematical reasoning.

+16.7 ppaverage gain over the base model

Full-corpus comparison. Scores are percentages; Avg. is the unweighted mean of all six evaluations. Bold indicates the best score in each column.
SFT corpusTOME-LongFormTOME-ObjectiveMiniF2FProofNetMATH-500AIME-26Avg.
Base model No SFT13.2532.9334.4517.1468.808.4429.17
OpenMath1 1.82M20.1633.8622.8719.2570.408.2129.13
MetaMath 395K28.7334.6640.7022.5571.209.9834.64
MathInstruct 262K35.8740.6952.0532.9373.0511.9841.10
TOME-Math 364.6K43.8643.9657.4342.9876.5510.1945.83

Same Qwen3-30B-A3B-Base backbone; one epoch per corpus. SFT = supervised fine-tuning; AIME-26 = AIME 2026. Scores (%); Avg. is the mean across six benchmarks; bold marks the best result. K / M = thousand / million training examples; pp = percentage points.

Our evaluation sets. TOME-LongForm: 300 proof-heavy exercises from held-out textbooks across six mathematical subjects, scored for proof correctness. TOME-Objective: 145 multidisciplinary objective questions, scored by final-answer equivalence.

Useful structure.
Even without fine-tuning.

Retrieving propositions and local proof obligations raises TOME-LongForm pass@1 from 13.25% to 17.38%.

Frozen base model, 300 problems. All four retrieval policies share the same context-token budget.

Single-solution success rate · Pass@1 (%)

  1. No retrieved context13.25%
  2. Random context from the same book14.00%
  3. Context from nearby chapters14.71%
  4. Structure-guided proposition–proof pairs15.54%
  5. Proposition–proof pairs + explicit proof steps17.38%
Structure-guided retrieval uses chapter order and proposition dependencies. The final setting also retrieves Gap QA to make intermediate proof steps explicit. Scores are averaged across six subjects.

Better order. Greater gains with scale.

Forward–Gap leads in all 18 subject–scale settings. Every schedule improves as the supervision budget grows.

Pass@16 = the share of problems solved by at least one of 16 generated solutions. Budgets count training tokens (M = million); all schedules use the same examples within each subject and budget.Shuffle: random order. Forward–Gap / Reverse–Gap: forward / reverse chapter order, with Gap QA first at each stage. Forward–Mix: forward chapter order, mixing Proof and Gap QA within each stage.

Broader coverage. Transferable reasoning.

More textbook sources improve learning at a fixed budget, while subject-specific supervision transfers across mathematical fields.

More sources, same budget. Expanding from 8 books (narrow–dense) to 16 books (broad–sparse) improves all six subjects by 3.3 percentage points on average, with the same 0.75M-token budget.

Reasoning transfers across subjects. Cross-subject pass@16 averages 0.92× the target specialist’s score. Values above 1 indicate performance exceeding that specialist.

Subject key: Alg. = Abstract algebra; Ana. = Mathematical analysis; Prob. = Probability; DG = Differential geometry; Disc. = Discrete mathematics; Top. = Topology. Heatmap rows show the training subject; columns show the evaluation subject.