2026-10-16T14:46:18Z https://lifeofresearch.com/oai2

oai:lifeofresearch.com:51 2026-09-25T08:54:10Z type:article openaire

10.5281/zenodo.22941279 https://lifeofresearch.com/articles/51 Pranay Mahendrakar 0009-0003-7224-029X SONYTECH Life of Research 2026 curriculum learning reinforcement learning with verifiable rewards RLVR data selection difficulty filtering GRPO DAPO reproducibility Journal article Creative Commons Attribution 4.0 (c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Curriculum learning entered large-scale reasoning training through reinforcement learning with verifiable rewards (RLVR): difficulty-ordered or difficulty-filtered problem schedules are now routine in systems built on GRPO and DAPO, and dozens of 2024-2026 papers report a gain from some version of "curriculum." Five years earlier, a controlled study spanning thousands of orderings on standard image and language benchmarks found that curricula beat random ordering only under a restricted training budget or noisy labels, and that even those gains were attributable to a dynamically expanding training set rather than to the ordering itself (Wu et al., 2021). This paper reads the RLVR curriculum literature against that finding and against the literature's own most careful recent attempt to re-run it. Of the RLVR papers surveyed here that report a curriculum or difficulty-selection gain, only one holds total training steps and total unique problems fixed while randomizing the schedule -- the control Wu et al. specify -- and that paper, tested across multiple model families on synthetic reasoning benchmarks, reports no robust advantage of difficulty-based sequencing over random sampling in either accuracy or response length (Mordig et al., 2026). The remaining papers, spanning math, writing, multi-domain and preference-data settings, compare against an unfiltered or uniformly-sampled baseline that changes what the model trains on, not merely the order it trains on it in, and a controlled theoretical treatment of the RLVR setting attributes the provable benefits of adaptive problem choice specifically to changing the training distribution, not to sequencing a fixed one (Rajaraman et al., 2026a). What the field calls "curriculum" in RLVR names at least three distinct mechanisms -- static ordering, adaptive selection, and structural decomposition -- with three different evidentiary records, and the one sharing its name and its instrumentation with a mechanism that failed a matched-control test twice, five years apart, is the one still invoked as the field's working premise. The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against its arXiv, Crossref or publisher record before inclusion, with title and author list checked against the record returned, and every quantitative claim in this paper is taken from the abstract or stated headline result of the source credited with it. No experiment was run and no number in this paper was measured or recomputed by its author; the table and figure re-present numbers already published elsewhere and name their sources on every row and bar. The author is responsible for the final text and for all claims made in it.