© 2020

Deep Reinforcement Learning

Fundamentals, Research and Applications

  • Hao Dong
  • Zihan Ding
  • Shanghang Zhang

Table of contents

  1. Front Matter
    Pages i-xxvii
  2. Fundamentals

    1. Front Matter
      Pages 1-1
    2. Jingqing Zhang, Hang Yuan, Hao Dong
      Pages 3-46
    3. Zihan Ding, Yanhua Huang, Hang Yuan, Hao Dong
      Pages 47-123
    4. Hongming Zhang, Tianyang Yu
      Pages 125-133
    5. Yanhua Huang
      Pages 135-160
    6. Ruitong Huang, Tianyang Yu, Zihan Ding, Shanghang Zhang
      Pages 161-212
    7. Hongming Zhang, Tianyang Yu, Ruitong Huang
      Pages 213-245
  3. Research

    1. Front Matter
      Pages 247-248
    2. Zihan Ding, Hao Dong
      Pages 249-272
    3. Zihan Ding
      Pages 273-306
    4. Huaqing Zhang, Ruitong Huang, Shanghang Zhang
      Pages 307-316
    5. Yanhua Huang
      Pages 317-333
    6. Huaqing Zhang, Shanghang Zhang
      Pages 335-346
    7. Huaqing Zhang, Tianyang Yu
      Pages 347-364
  4. Applications

    1. Front Matter
      Pages 365-365
    2. Zihan Ding, Hao Dong
      Pages 367-377
    3. Yanhua Huang
      Pages 379-389
    4. Hongming Zhang, Tianyang Yu
      Pages 391-415
    5. Zihan Ding, Hao Dong
      Pages 417-442

About this book


Deep reinforcement learning (DRL) is the combination of reinforcement learning (RL) and deep learning. It has been able to solve a wide range of complex decision-making tasks that were previously out of reach for a machine, and famously contributed to the success of AlphaGo. Furthermore, it opens up numerous new applications in domains such as healthcare, robotics, smart grids and finance.
Divided into three main parts, this book provides a comprehensive and self-contained introduction to DRL. The first part introduces the foundations of deep learning, reinforcement learning (RL) and widely used deep RL methods and discusses their implementation. The second part covers selected DRL research topics, which are useful for those wanting to specialize in DRL research. To help readers gain a deep understanding of DRL and quickly apply the techniques in practice, the third part presents mass applications, such as the intelligent transportation system and learning to run, with detailed explanations.
The book is intended for computer science students, both undergraduate and postgraduate, who would like to learn DRL from scratch, practice its implementation, and explore the research topics. It also appeals to engineers and practitioners who do not have strong machine learning background, but want to quickly understand how DRL works and use the techniques in their applications.


Deep reinforcement learning DRL Deep Learning Reinforcement Learning Machine Learning

Editors and affiliations

  1. 1.EECSPeking UniversityBeijingChina
  2. 2.CSImperial College LondonLondonUK
  3. 3.EECSUniversity of California, BerkeleyBerkeleyUSA

About the editors

Dr. Hao Dong is currently an Assistant Professor at Peking University. He received his Ph.D. in Computing from Imperial College London in 2019, supervised by Prof. Yike Guo. Hao’s research chiefly involves Deep Learning and Computer Vision, with the goal of reducing the amount of data required for learning intelligent systems. He is passionate about popularizing artificial intelligence technologies and established TensorLayer, a deep learning and reinforcement learning library for scientists and engineers, which won the Best Open Source Software Award at ACM Multimedia 2017.

Zihan Ding received his M.Sc. degree in Machine Learning with distinction from the Department of Computing, Imperial College London, supervised by Dr. Edward Johns. He holds double Bachelor degrees from the University of Science and Technology of China: in Photoelectric Information Science and Engineering (Physics) and in Computer Science and Technology. His research interests include deep reinforcement learning, robotics, computer vision, quantum computation and machine learning. He has published papers in ICRA, AAAI, NIPS, IJCAI, and Physical Review. He also contributed to the open-source projects TensorLayer RLzoo, TensorLet and Arena.

Dr. Shanghang Zhang is a postdoctoral research fellow in the Berkeley AI Research (BAIR) Lab, the Department of Electrical Engineering and Computer Sciences, UC Berkeley, USA. She received her Ph.D. from Carnegie Mellon University in 2018. Her research interests cover deep learning, computer vision, and reinforcement learning, as reflected in her numerous publications in top-tier journals and conference proceedings, including NeurIPS, CVPR, ICCV, and AAAI.  Her research mainly focuses on machine learning with limited training data, including low-shot learning, domain adaptation, and meta-learning, which enables the learning system to automatically adapt to real-world variations and new environments. She was one of the “2018 Rising Stars in EECS” (a highly selective program launched at MIT in 2012, which has since been hosted at UC Berkeley, Carnegie Mellon, and Stanford annually). She has also been selected for the Adobe Academic Collaboration Fund, Qualcomm Innovation Fellowship (QInF) Finalist Award, and Chiang Chen Overseas Graduate Fellowship.

Bibliographic information