Life of Research
Appearance

Transfer Is a Directed Relation: Four Quantities Under One Word in the Cross-Domain RLVR Debate, and Why the Structural-Similarity Reading Does Not Survive Its Own Evidence

  1. SONYTECH

Journal article

DOI10.5281/zenodo.23022357 LOR-00066

Download PDF (475.6 KB) Cite

Cite

Transfer Is a Directed Relation: Four Quantities Under One Word in the Cross-Domain RLVR Debate, and Why the Structural-Similarity Reading…

Read

Abstract

(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0.

Reinforcement learning with verifiable rewards is the standard route to reasoning-tuned language models, and the field has split over whether its gains leave the training domain. One body of work reports that most models succeeding at mathematics fail to transfer and that single-domain post-training yields no statistically significant out-of-domain improvement; another reports that post-training on constraint-satisfaction puzzles alone raises hard-mathematics accuracy substantially. This paper argues that the two are not in direct contradiction, because the word transfer carries at least four logically independent quantities: whether training on a domain improves others, whether a domain improves when others are trained, whether a domain is preserved rather than degraded, and whether joint training beats separate training. Papers measuring one are routinely cited as evidence about another. The paper then argues that the reconciliation the field has settled on - that transfer follows structural similarity between source and target - is contradicted by the directional findings of the negative result usually cited for it, which reports unstructured domains transferring to structured ones while failing to transfer to each other. Similarity is symmetric; the reported relation is not, and multi-task learning has treated directed, sign-bearing task-affinity matrices as its normal object of study since Taskonomy. Two further problems are set out: the source-side gain may be substantially elicitation of a pretraining-frequent behaviour rather than acquired skill, which would relocate transfer to the base model, and the reported effect sizes sit near a documented seed-to-seed noise floor. What is not known is stated flatly: no published experiment reports a full directed transfer matrix over a fixed domain set, one protocol and more than one model family. Five measurements that would settle the open part are specified.
The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against the arXiv API and Crossref before inclusion, and every quantitative claim was read back against the cited source's own abstract or, where a claim is drawn from a paper's body, against the located passage. The author is responsible for the final text and for all claims made in it.

Keywords

Files (1)

Cite this record

Mahendrakar, P. (2026). Transfer Is a Directed Relation: Four Quantities Under One Word in the Cross-Domain RLVR Debate, and Why the Structural-Similarity Reading Does Not Survive Its Own Evidence. Life of Research. https://doi.org/10.5281/zenodo.23022357

APA 7th edition
Export to a reference manager
BibTeX
@misc{mahendrakar2026transfer,
  author       = {Mahendrakar, Pranay},
  title        = {{Transfer Is a Directed Relation: Four Quantities Under One Word in the Cross-Domain RLVR Debate, and Why the Structural-Similarity Reading Does Not Survive Its Own Evidence}},
  year         = {2026},
  month        = sep,
  date         = {2026-09-05},
  publisher    = {Life of Research},
  doi          = {10.5281/zenodo.23022357},
  url          = {https://lifeofresearch.com/articles/66},
  abstract     = {(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Reinforcement learning with verifiable rewards is the standard route to reasoning-tuned language models, and the field has split over whether its gains leave the training domain. One body of work reports that most models succeeding at mathematics fail to transfer and that single-domain post-training yields no statistically significant out-of-domain improvement; another reports that post-training on constraint-satisfaction puzzles alone raises hard-mathematics accuracy substantially. This paper argues that the two are not in direct contradiction, because the word transfer carries at least four logically independent quantities: whether training on a domain improves others, whether a domain improves when others are trained, whether a domain is preserved rather than degraded, and whether joint training beats separate training. Papers measuring one are routinely cited as evidence about another. The paper then argues that the reconciliation the field has settled on - that transfer follows structural similarity between source and target - is contradicted by the directional findings of the negative result usually cited for it, which reports unstructured domains transferring to structured ones while failing to transfer to each other. Similarity is symmetric; the reported relation is not, and multi-task learning has treated directed, sign-bearing task-affinity matrices as its normal object of study since Taskonomy. Two further problems are set out: the source-side gain may be substantially elicitation of a pretraining-frequent behaviour rather than acquired skill, which would relocate transfer to the base model, and the reported effect sizes sit near a documented seed-to-seed noise floor. What is not known is stated flatly: no published experiment reports a full directed transfer matrix over a fixed domain set, one protocol and more than one model family. Five measurements that would settle the open part are specified. The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against the arXiv API and Crossref before inclusion, and every quantitative claim was read back against the cited source's own abstract or, where a claim is drawn from a paper's body, against the located passage. The author is responsible for the final text and for all claims made in it.},
  keywords     = {reinforcement learning with verifiable rewards, cross-domain generalisation, transfer learning, LLM reasoning, negative transfer, post-training, evaluation methodology, task affinity},
  language     = {en},
  copyright    = {Creative Commons Attribution 4.0}
}

Using Zotero or Mendeley? Their browser connector saves this record from this page, with its PDF when there is one. On search and browse pages it lists every result so you can save many at once.

Guides What a complete citation needs What CC BY 4.0 allows What is a DOI?