Life of Research
Appearance

Subject

Training dynamics

1 open-access preprint on training dynamics, published in 2026 in Life of Research. Every record is free to read and download, with a permanent link and a ready-made citation.

1 record

Preprint

A Sharp Turn Is Not a Phase Transition: What Training-Time Transitions in Small Language Models Establish, Why Threshold Readouts, Fast Crossovers, Developmental Stages and Critical Behaviour Are Reported Under One Name, and the Controls That Would Tell Them Apart

Life of Research A 2025 study trains a 3.6-million-parameter character-level transformer on Tiny Shakespeare and reports a phase transition in the middle of training: around epochs 230 to 250, the dispersion indices of correct and incorrect word counts exchange which one sits near the Poisson…

Cite Related research LOR-00244 · 3 views · 3 downloads
PDF321.5 KB

Cite

APA

BibTeX


  
  

Import into a reference manager: BibTeX · RIS (Zotero, Mendeley, EndNote)