Journal article
Faithful to What? Four Instruments for Chain-of-Thought Faithfulness Disagree With Each Other, and the One Ground-Truth Check Run So Far Found Most of Them Near Chance
A chain-of-thought (CoT) trace is called "faithful" when it accurately represents the computation that produced the model's answer, as opposed to a plausible-sounding story invented after the fact (Jacovi and Goldberg, 2020). Whether published CoT traces meet this bar is disputed, and the dispute…