Preprint
Which Loss Prices the English Share? What Target-Language Validation Loss Can and Cannot See in Continued Pretraining for Language Adaptation, Why Two Training Regimes Disagree About What English Buys, and the Instruments a Mixture Choice Needs
Life of Research When an English-centric language model is adapted to a new language by continued pretraining, practitioners usually keep a share of English in the training mixture, and a growing family of mixture laws chooses that share by predicting validation loss. A 2025 study found that…