1. Special issue on approximate dynamic programming and reinforcement learning

   • Silvia Ferrari
   • Jagannathan Sarangapani
   • Frank L. Lewis

   Editorial 19 July 2011 Pages: 309 - 309

2. Approximate policy iteration: a survey and some new methods

   • Dimitri P. Bertsekas

   OriginalPaper 19 July 2011 Pages: 310 - 335

3. A review of stochastic algorithms with continuous value function approximation and some new approximate policy iteration algorithms for multidimensional continuous applications

   • Warren B. Powell
   • Jun Ma

   OriginalPaper 19 July 2011 Pages: 336 - 352

4. Adaptive dynamic programming for online solution of a zero-sum differential game

   • Draguna Vrabie
   • Frank Lewis

   OriginalPaper 19 July 2011 Pages: 353 - 360

5. Online optimal control of nonlinear discrete-time systems using approximate dynamic programming

   • Travis Dierks
   • Sarangapani Jagannathan

   OriginalPaper 19 July 2011 Pages: 361 - 369

6. Approximate dynamic programming solutions with a single network adaptive critic for a class of nonlinear systems

   • Jie Ding
   • S. N. Balakrishnan

   OriginalPaper 19 July 2011 Pages: 370 - 380

7. Finite horizon optimal control of discrete-time nonlinear systems with unfixed initial state using adaptive dynamic programming

   • Qinglai Wei
   • Derong Liu

   OriginalPaper 19 July 2011 Pages: 381 - 390

8. A model-based approximate λ-policy iteration approach to online evasive path planning and the video game Ms. Pac-Man

   • Greg Foderaro
   • Vikram Raju
   • Silvia Ferrari

   OriginalPaper 19 July 2011 Pages: 391 - 399

9. Asymptotic tracking by a reinforcement learning-based adaptive critic controller

   • Shubhendu Bhasin
   • Nitin Sharma
   • Warren Dixon

   OriginalPaper 19 July 2011 Pages: 400 - 409

10. Stable reinforcement learning with recurrent neural networks

    • James Nate Knight
    • Charles Anderson

    OriginalPaper 19 July 2011 Pages: 410 - 420

11. Semi-Markov adaptive critic heuristics with application to airline revenue management

    • Ketaki Kulkarni
    • Abhijit Gosavi
    • Katie Grantham

    OriginalPaper 19 July 2011 Pages: 421 - 430

12. Multiresolution state-space discretization for Q-Learning with pseudorandomized discretization

    • Amanda Lampton
    • John Valasek
    • Mrinal Kumar

    OriginalPaper 19 July 2011 Pages: 431 - 439

13. Hierarchical state-abstracted and socially augmented Q-Learning for reducing complexity in agent-based learning

    • Xueqing Sun
    • Tao Mao
    • Jerald Kralik

    OriginalPaper 19 July 2011 Pages: 440 - 450

14. Moving least-squares approximations for linearly-solvable stochastic optimal control problems

    • Mingyuan Zhong
    • Emanuel Todorov

    OriginalPaper 19 July 2011 Pages: 451 - 463