Control Systems and Reinforcement Learning

Erscheinungsjahr 2022
ISBN: 978-1-316-51196-1
Verlag: Cambridge University Press

Buch, Englisch, 450 Seiten, Format (B × H): 186 mm x 264 mm, Gewicht: 1049 g

A high school student can create deep Q-learning code to control her robot, without any understanding of the meaning of 'deep' or 'Q', or why the code sometimes fails. This book is designed to explain the science behind reinforcement learning and optimal control in a way that is accessible to students with a background in calculus and matrix algebra. A unique focus is algorithm design to obtain the fastest possible speed of convergence for learning algorithms, along with insight into why reinforcement learning sometimes fails. Advanced stochastic process theory is avoided at the start by substituting random exploration with more intuitive deterministic probing for learning. Once these ideas are understood, it is not difficult to master techniques rooted in stochastic control. These topics are covered in the second part of the book, starting with Markov chain theory and ending with a fresh look at actor-critic methods for reinforcement learning.

Autoren/Hrsg.

Meyn, Sean

Fachgebiete

• Mathematik | Informatik Mathematik Stochastik Wahrscheinlichkeitsrechnung
• Mathematik | Informatik EDV | Informatik Programmierung | Softwareentwicklung Algorithmen & Datenstrukturen
• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz Maschinelles Lernen
• Mathematik | Informatik Mathematik Numerik und Wissenschaftliches Rechnen Numerische Mathematik
• Mathematik | Informatik Mathematik Stochastik Mathematische Statistik
• Wirtschaftswissenschaften Volkswirtschaftslehre Volkswirtschaftslehre Allgemein Ökonometrie

Inhaltsverzeichnis

1. Introduction; Part I. Fundamentals Without Noise: 2. Control crash course; 3. Optimal control; 4. ODE methods for algorithm design; 5. Value function approximations; Part II. Reinforcement Learning and Stochastic Control: 6. Markov chains; 7. Stochastic control; 8. Stochastic approximation; 9. Temporal difference methods; 10. Setting the stage, return of the actors; A. Mathematical background; B. Markov decision processes; C. Partial observations and belief states; References; Glossary of Symbols and Acronyms; Index.