What is the one-history problem?
Cover: - Relate back to single trajectory discussion in the post on good actions - All ways around this make assumptions which might be broken
References and further reading
Hardwick, Robert J. 2026a. “How can I tell luck from skill?” umbralcalculations, November. https://umbralcalc.github.io/posts/how_can_i_tell_luck_from_skill.html.
Hardwick, Robert J. 2026b. “How can I trust the actions I take in simulations?” umbralcalculations, August. https://umbralcalc.github.io/posts/how_can_i_trust_the_actions_i_take_in_simulations.html.
Hardwick, Robert J. 2026c. “What makes an action good?” umbralcalculations, August. https://umbralcalc.github.io/posts/what_makes_an_action_good.html.
Imbens, Guido W., and Donald B. Rubin. 2015. Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press.
Levine, Sergey, Aviral Kumar, George Tucker, and Justin Fu. 2020. Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems. arXiv preprint. https://arxiv.org/abs/2005.01643.
Questions whose answers cite this one