Journal article
Did the Model Change, or Did Your Measurement? A Drift Claim Is a Test Against a Declared Null, the Careful Longitudinal Studies Mostly Caught Announced Version Moves, and a Capability Change Under a Pinned Identifier Is the Claim the Evidence Supports Least
Two bodies of work describe the same deployed language models in opposite terms. One reports that models behind a fixed product name change over time and calls for continuous monitoring. The other reports that a single model, queried twice under settings meant to be deterministic, returns…