Which Way the Verdict Falls: Noise-Induced Flips in an LLM Bias Judge Run Toward the Label Its Prompt Makes Easiest to Reach, the Harm-Detection Literature Records the Opposite Sign, and Whether Noise Inflates a Bias Score Depends on the Score

APA

Mahendrakar, P. (2026). Which Way the Verdict Falls: Noise-Induced Flips in an LLM Bias Judge Run Toward the Label Its Prompt Makes Easiest to Reach, the Harm-Detection Literature Records the Opposite Sign, and Whether Noise Inflates a Bias Score Depends on the Score [Preprint]. Life of Research. https://doi.org/10.5281/zenodo.23461021

Copy APA

BibTeX

@misc{lor1162026,
  title        = {Which Way the Verdict Falls: Noise-Induced Flips in an LLM Bias Judge Run Toward the Label Its Prompt Makes Easiest to Reach, the Harm-Detection Literature Records the Opposite Sign, and Whether Noise Inflates a Bias Score Depends on the Score},
  author       = {Pranay Mahendrakar},
  year         = {2026},
  publisher    = {Life of Research},
  doi          = {10.5281/zenodo.23461021},
  url          = {https://lifeofresearch.com/preprints/116},
  keywords     = {LLM-as-a-judge, social bias measurement, noisy user-generated text, robustness, label bias, calibration, prevalence estimation, evaluation methodology},
  note         = {LOR-00116}
}

Copy BibTeX More on the record page