Subject
4 open-access journal articles on benchmark construction, published in 2026 in Life of Research. Every record is free to read and download, with a permanent link and a ready-made citation.
Journal article
A family of recent proposals aims to stop errors from spreading through LLM-based multi-agent systems: genealogy-graph governance over message dependencies, cross-channel causal monitoring, propagation-aware remediation of contaminated state, infection-aware safeguarding, and corrector placement…
Journal article
A family of recent proposals aims to stop errors from spreading through LLM-based multi-agent systems: genealogy-graph governance over message dependencies, cross-channel causal monitoring, propagation-aware remediation of contaminated state, infection-aware safeguarding, and corrector placement…
Journal article
A widely cited result reports that the open-set performance of an image classifier is strongly correlated with its closed-set accuracy, and that a well-trained baseline scoring rule is competitive with specialized open-set machinery. The result is often read as showing that specialized open-set…
Journal article
Automatic benchmark construction is presented as a response to saturation: a language model proposes topics, writes items, and supplies answer keys, and the resulting datasets are reported to be harder and more novel than human-built ones. The standard objection is that a model cannot examine…