Life of Research
Appearance

Subject

Grokking

2 open-access preprints on grokking, published in 2026 in Life of Research. Every record is free to read and download, with a permanent link and a ready-made citation.

2 records

Preprint

A Learned Inverse Is Not a Lifted Curse: What Training Transformers on a Family Knowledge Graph Shows About the Reversal Curse, Why Its Bilinear Geometry Answers a Relation-Level Question the Original Curse Did Not Ask, and the Controls That Would Carry It to Pretrained Models

Life of Research A 2025 study trained decoder-only transformers from scratch on a synthetic family knowledge graph and reported that, under strong weight decay, some models infer withheld parent relations from the child relations they did see, that a bilinear probe in the style of the RESCAL…

Cite Related research LOR-00255 · 1 view · 3 downloads
PDF372.8 KB

Preprint

A Sharp Turn Is Not a Phase Transition: What Training-Time Transitions in Small Language Models Establish, Why Threshold Readouts, Fast Crossovers, Developmental Stages and Critical Behaviour Are Reported Under One Name, and the Controls That Would Tell Them Apart

Life of Research A 2025 study trains a 3.6-million-parameter character-level transformer on Tiny Shakespeare and reports a phase transition in the middle of training: around epochs 230 to 250, the dispersion indices of correct and incorrect word counts exchange which one sits near the Poisson…

Cite Related research LOR-00244 · 3 views · 3 downloads
PDF321.5 KB

Cite

APA

BibTeX


  
  

Import into a reference manager: BibTeX · RIS (Zotero, Mendeley, EndNote)