Running summarizing tools on a new article

Check the paper below, then start its synthesis.


Reinforcement Learning: Model Based

Shie Mannor (Technion – Israel Institute of Technology), Yishay Mansour (Tel Aviv University), Aviv Tamar (Technion – Israel Institute of Technology)

Cambridge University Press eBooks
DOI: 10.1017/9781009711067.010 (Computer Science)
License: not stated (all rights reserved)

Abstract: This chapter develops model-based RL approaches where agents explicitly learn MDP transition and reward models from experience. The effective horizon concept quantifies how many steps matter significantly. Off-policy learning with generative models is analyzed first. On-policy learning requires explicit exploration strategies. Several algorithms are presented, including explicit explore-or-exploit, R-MAX and the PAC-MDP framework that ensures probably approximately correct (PAC) policies.

Published on 31 Jul. 2026