Life of Research
Appearance

Subject

Benchmark design

3 open-access journal articles on benchmark design, published in 2026 in Life of Research. Every record is free to read and download, with a permanent link and a ready-made citation.

3 records

Journal article

Two Kinds of Missing: Underspecified Inputs Versus Unknown Answers, and Why One Abstention Policy Cannot Serve Both

A language model that declines to answer is scored the same way whether the reason is that the question has several readings and it picked the wrong one, or that the question has one reading and the model does not know the fact it names. AbstentionBench (Kirichenko et al., 2025) makes the…

Cite Related research LOR-00010 · 6 views · 18 downloads
PDF387.4 KB

Journal article

Measured Against an Incomplete Answer Key: What Unknown Recall Certifies in Open-World Object Detection, Why Its Two Cost-Side Instruments Disagree, and the Separation That Was Published and Not Adopted

Open-world object detection asks a detector to put boxes on objects whose classes it was never trained on, and the field's headline number for that ability is unknown recall. This paper reconstructs where that metric came from and what it can certify. The founding paper of the task did not report…

Cite Related research LOR-00019 · 19 views · 6 downloads
PDF543.7 KB

Journal article

A Conflict Is Constructed Before It Is Measured: Seven Design Choices That Set Which Way a Language Model Bends, and Why the Context-Memory Results Do Not Compare

The literature on how language models behave when retrieved context contradicts parametric memory contains a flat contradiction, and neither of its two surveys resolves it. One body of results reports over-reliance on memorised information; another reports that models are highly receptive to…

Cite Related research LOR-00004 · 7 views · 23 downloads
PDF462 KB

Cite

APA

BibTeX


  
  

Import into a reference manager: BibTeX · RIS (Zotero, Mendeley, EndNote)