Journal article
Which Signal Did the Synthesis Import? Information, Re-presentation and Selection in Synthetic Pretraining, Why 'the Verifier Is Doing the Work' Holds Only Where Correctness Is the Target, and the Controls That Would Assign the Credit
(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. The expectation that language models will keep improving after the supply of human text runs out rests on a claim about synthetic data: that a model, or a family of models, can produce training text worth more than the text it was trained on…