Life of Research
Appearance

Subject

Continued pretraining

2 open-access preprints on continued pretraining, published in 2026 in Life of Research. Every record is free to read and download, with a permanent link and a ready-made citation.

2 records

Preprint

A Domain Label Is Not a Treatment: Why Specialist and General-Purpose Language Models Trade Places Across Studies, What a 'Medical' Checkpoint Leaves Unspecified, and the Matched Contrasts That Would Assign the Gain

Life of Research A September 2026 study compares an 8B general-purpose instruction-tuned model with a medically fine-tuned checkpoint built on the same base and finds that the general model scores higher both at selecting the meaning of medical jargon and at recognising when a word is being used…

Cite Related research LOR-00162 · 0 views · 0 downloads
PDF405.1 KB

Preprint

Which Loss Prices the English Share? What Target-Language Validation Loss Can and Cannot See in Continued Pretraining for Language Adaptation, Why Two Training Regimes Disagree About What English Buys, and the Instruments a Mixture Choice Needs

Life of Research When an English-centric language model is adapted to a new language by continued pretraining, practitioners usually keep a share of English in the training mixture, and a growing family of mixture laws chooses that share by predicting validation loss. A 2025 study found that…

Cite Related research LOR-00121 · 11 views · 13 downloads
PDF398.7 KB

Cite

APA

BibTeX


  
  

Import into a reference manager: BibTeX · RIS (Zotero, Mendeley, EndNote)