Life of Research
Appearance

Curriculum Is Three Claims, Not One: Ordering, Selection and Decomposition in RLVR, and the Random-Order Control Almost Nobody Runs

  1. SONYTECH

Journal article

DOI10.5281/zenodo.22941279 LOR-00051

Download PDF (5.8 MB) Cite

Cite

Curriculum Is Three Claims, Not One: Ordering, Selection and Decomposition in RLVR, and the Random-Order Control Almost Nobody Runs

Read

Abstract

(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0.

Curriculum learning entered large-scale reasoning training through reinforcement learning with verifiable rewards (RLVR): difficulty-ordered or difficulty-filtered problem schedules are now routine in systems built on GRPO and DAPO, and dozens of 2024-2026 papers report a gain from some version of "curriculum." Five years earlier, a controlled study spanning thousands of orderings on standard image and language benchmarks found that curricula beat random ordering only under a restricted training budget or noisy labels, and that even those gains were attributable to a dynamically expanding training set rather than to the ordering itself (Wu et al., 2021). This paper reads the RLVR curriculum literature against that finding and against the literature's own most careful recent attempt to re-run it. Of the RLVR papers surveyed here that report a curriculum or difficulty-selection gain, only one holds total training steps and total unique problems fixed while randomizing the schedule -- the control Wu et al. specify -- and that paper, tested across multiple model families on synthetic reasoning benchmarks, reports no robust advantage of difficulty-based sequencing over random sampling in either accuracy or response length (Mordig et al., 2026). The remaining papers, spanning math, writing, multi-domain and preference-data settings, compare against an unfiltered or uniformly-sampled baseline that changes what the model trains on, not merely the order it trains on it in, and a controlled theoretical treatment of the RLVR setting attributes the provable benefits of adaptive problem choice specifically to changing the training distribution, not to sequencing a fixed one (Rajaraman et al., 2026a). What the field calls "curriculum" in RLVR names at least three distinct mechanisms -- static ordering, adaptive selection, and structural decomposition -- with three different evidentiary records, and the one sharing its name and its instrumentation with a mechanism that failed a matched-control test twice, five years apart, is the one still invoked as the field's working premise.
The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against its arXiv, Crossref or publisher record before inclusion, with title and author list checked against the record returned, and every quantitative claim in this paper is taken from the abstract or stated headline result of the source credited with it. No experiment was run and no number in this paper was measured or recomputed by its author; the table and figure re-present numbers already published elsewhere and name their sources on every row and bar. The author is responsible for the final text and for all claims made in it.

Keywords

Files (1)

Cite this record

Mahendrakar, P. (2026). Curriculum Is Three Claims, Not One: Ordering, Selection and Decomposition in RLVR, and the Random-Order Control Almost Nobody Runs. Life of Research. https://doi.org/10.5281/zenodo.22941279

APA 7th edition
Export to a reference manager
BibTeX
@misc{mahendrakar2026curriculum,
  author       = {Mahendrakar, Pranay},
  title        = {{Curriculum Is Three Claims, Not One: Ordering, Selection and Decomposition in RLVR, and the Random-Order Control Almost Nobody Runs}},
  year         = {2026},
  month        = sep,
  date         = {2026-09-24},
  publisher    = {Life of Research},
  doi          = {10.5281/zenodo.22941279},
  url          = {https://lifeofresearch.com/articles/51},
  abstract     = {(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Curriculum learning entered large-scale reasoning training through reinforcement learning with verifiable rewards (RLVR): difficulty-ordered or difficulty-filtered problem schedules are now routine in systems built on GRPO and DAPO, and dozens of 2024-2026 papers report a gain from some version of "curriculum." Five years earlier, a controlled study spanning thousands of orderings on standard image and language benchmarks found that curricula beat random ordering only under a restricted training budget or noisy labels, and that even those gains were attributable to a dynamically expanding training set rather than to the ordering itself (Wu et al., 2021). This paper reads the RLVR curriculum literature against that finding and against the literature's own most careful recent attempt to re-run it. Of the RLVR papers surveyed here that report a curriculum or difficulty-selection gain, only one holds total training steps and total unique problems fixed while randomizing the schedule -- the control Wu et al. specify -- and that paper, tested across multiple model families on synthetic reasoning benchmarks, reports no robust advantage of difficulty-based sequencing over random sampling in either accuracy or response length (Mordig et al., 2026). The remaining papers, spanning math, writing, multi-domain and preference-data settings, compare against an unfiltered or uniformly-sampled baseline that changes what the model trains on, not merely the order it trains on it in, and a controlled theoretical treatment of the RLVR setting attributes the provable benefits of adaptive problem choice specifically to changing the training distribution, not to sequencing a fixed one (Rajaraman et al., 2026a). What the field calls "curriculum" in RLVR names at least three distinct mechanisms -- static ordering, adaptive selection, and structural decomposition -- with three different evidentiary records, and the one sharing its name and its instrumentation with a mechanism that failed a matched-control test twice, five years apart, is the one still invoked as the field's working premise. The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against its arXiv, Crossref or publisher record before inclusion, with title and author list checked against the record returned, and every quantitative claim in this paper is taken from the abstract or stated headline result of the source credited with it. No experiment was run and no number in this paper was measured or recomputed by its author; the table and figure re-present numbers already published elsewhere and name their sources on every row and bar. The author is responsible for the final text and for all claims made in it.},
  keywords     = {curriculum learning, reinforcement learning with verifiable rewards, RLVR, data selection, difficulty filtering, GRPO, DAPO, reproducibility},
  language     = {en},
  copyright    = {Creative Commons Attribution 4.0}
}

Using Zotero or Mendeley? Their browser connector saves this record from this page, with its PDF when there is one. On search and browse pages it lists every result so you can save many at once.

Guides What a complete citation needs What CC BY 4.0 allows What is a DOI?