Life of Research
Appearance
Preprint Open access CC BY 4.0

Tiny in Parameters, Not in Compute: What a Recursive Reasoning Model's Puzzle Score Credits to Recursion, Why the Ablations Split by Task, and the Matched Comparisons That Would Assign the Rest

  1. SONYTECH

Preprint

DOI10.5281/zenodo.23598073 LOR-00132

Download PDF (391.1 KB) Cite

Cite

Tiny in Parameters, Not in Compute: What a Recursive Reasoning Model's Puzzle Score Credits to Recursion, Why the Ablations Split by Task…

Read

Abstract

(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0.

Life of Research Recursive reasoning models, which apply one small network many times to a latent state, report accuracies on Sudoku, maze and ARC-AGI puzzles above those of most frontier language models in their comparison tables, with 5 to 27 million parameters. The result is usually credited to recursion: iterating a latent state is said to buy the depth that reasoning needs. A 2025-2026 line of ablations, mechanistic studies and controlled re-evaluations disputes that credit. In this analysis the author reviews and synthesises published results to show that the disagreement dissolves once two things are separated: what the word recursion names, and which task the score comes from. Recursion names three functions - computation through iterated depth, regularisation through parameter sharing, and a source of candidate trajectories for a learned selector - and a reported score also carries per-task identity conditioning, training on the evaluation tasks' demonstrations, augmentation with voting, and an optimisation recipe. On Sudoku-Extreme the evidence credits iteration directly: one-pass models of equal size solve almost no puzzles, and running the recursion past its training horizon recovers most failures, though at matched effective depth part of the tied model's advantage is regularisation. On ARC-AGI the measured contribution of in-step recursion is small, the score falls to zero without the task identifier, and the evidence fits regularisation at least as well as depth. Test-time gains from stochastic restarts are selection gains whose size, on the benchmarks where both are reported, tracks how well the model's halting head verifies an answer. Parameter count is the wrong denominator for all of it. The paper consolidates the measured values in a table and a figure, states a crediting procedure as an algorithm, and specifies the matched comparisons that would assign what remains.

Keywords

Files (1)

Cite this record

Mahendrakar, P. (2026). Tiny in Parameters, Not in Compute: What a Recursive Reasoning Model's Puzzle Score Credits to Recursion, Why the Ablations Split by Task, and the Matched Comparisons That Would Assign the Rest [Preprint]. Life of Research. https://doi.org/10.5281/zenodo.23598073

APA 7th edition
Export to a reference manager
BibTeX
@misc{mahendrakar2026tiny,
  author       = {Mahendrakar, Pranay},
  title        = {{Tiny in Parameters, Not in Compute: What a Recursive Reasoning Model's Puzzle Score Credits to Recursion, Why the Ablations Split by Task, and the Matched Comparisons That Would Assign the Rest}},
  year         = {2026},
  month        = oct,
  date         = {2026-10-23},
  publisher    = {Life of Research},
  howpublished = {Preprint},
  doi          = {10.5281/zenodo.23598073},
  url          = {https://lifeofresearch.com/preprints/132},
  abstract     = {(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Life of Research Recursive reasoning models, which apply one small network many times to a latent state, report accuracies on Sudoku, maze and ARC-AGI puzzles above those of most frontier language models in their comparison tables, with 5 to 27 million parameters. The result is usually credited to recursion: iterating a latent state is said to buy the depth that reasoning needs. A 2025-2026 line of ablations, mechanistic studies and controlled re-evaluations disputes that credit. In this analysis the author reviews and synthesises published results to show that the disagreement dissolves once two things are separated: what the word recursion names, and which task the score comes from. Recursion names three functions - computation through iterated depth, regularisation through parameter sharing, and a source of candidate trajectories for a learned selector - and a reported score also carries per-task identity conditioning, training on the evaluation tasks' demonstrations, augmentation with voting, and an optimisation recipe. On Sudoku-Extreme the evidence credits iteration directly: one-pass models of equal size solve almost no puzzles, and running the recursion past its training horizon recovers most failures, though at matched effective depth part of the tied model's advantage is regularisation. On ARC-AGI the measured contribution of in-step recursion is small, the score falls to zero without the task identifier, and the evidence fits regularisation at least as well as depth. Test-time gains from stochastic restarts are selection gains whose size, on the benchmarks where both are reported, tracks how well the model's halting head verifies an answer. Parameter count is the wrong denominator for all of it. The paper consolidates the measured values in a table and a figure, states a crediting procedure as an algorithm, and specifies the matched comparisons that would assign what remains.},
  keywords     = {recursive reasoning models, tiny recursive model, hierarchical reasoning model, latent recursion, test-time compute, ARC-AGI, Sudoku, evaluation methodology},
  language     = {en},
  copyright    = {Creative Commons Attribution 4.0}
}

Using Zotero or Mendeley? Their browser connector saves this record from this page, with its PDF when there is one. On search and browse pages it lists every result so you can save many at once.

Guides How to cite a preprint Preprints vs journal articles What CC BY 4.0 allows