Preprint
Optimism Needs a Way Back: What Value an Agent Should Give a State It Did Not Know Existed, Why Every Located Guarantee Borrows Its Answer From a Reset, a Data Horizon or a Reference, and What That Leaves for Unknown Unknowns
(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Life of Research A learning agent that reaches a state outside everything it has represented must give that state a value before it can act again, and the reinforcement learning literature offers three answers. Optimism values the unknown high…