Skip to main content

Temporal Difference (TD) Based Critic-Actor Adaptive Control for a Fine Hand Motion Rehabilitation Robot

  • Chapter
  • First Online:
Mechatronics and Machine Vision in Practice 3

Abstract

Robot assisted post-stroke rehabilitation training is an effective approach in delivering the highly intensive repetitive training, aiming to retrain the neural pathways in the brain thus to restore and improve the affected mobility skills. The adaptive control of robotic devices, especially assist-as-needed control providing exact assistive force intensity along the intended motion trajectory for fine motion, can be a complex but effective method. A temporal difference based critic-actor reinforcement learning control method is explored in this study. The effectiveness of the method is verified through Matlab simulation and implemented on a hand rehabilitation robotic device. Results suggest that the control system can fulfil the control task with high performance and reliability, thus holding the promise of improving the fine hand motion rehabilitation training efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sale, P., V. Lombardi, and M. Franceschini. 2012. Hand robotics rehabilitation: Feasibility and preliminary results of a robotic treatment in patients with Hemiparesis. Stroke Research and Treatment 2012: 1–5.

    Article  Google Scholar 

  2. Hwang, C.H., J.W. Seong, and D.S. Son. 2012. Individual finger synchronized robot-assisted hand rehabilitation in subacute to chronic stroke: A prospective randomized clinical trial of efficacy. Clinical Rehabilitation 26: 696–704.

    Article  Google Scholar 

  3. Kaelbling, L.P., M.L. Littman, and A.W. Moore. 1996. Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4: 237–285.

    Google Scholar 

  4. Lewis, F.L., D. Vrabie, and K.G. Vamvoudakis. 2012. Reinforcement learning and feedback control: Using natural decision methods to design optimal adaptive controllers. Control Systems, IEEE 32: 76–105.

    Article  MathSciNet  Google Scholar 

  5. Papahristou, N., and I. Refanidis. 2011. Training neural networks to play backgammon variants using reinforcement learning. In Applications of evolutionary computation, vol. 6624, 113–122, eds. Di Chio C., S. Cagnoni, C. Cotta, M. Ebner, A. Ekárt, and A. Esparcia-Alcázar, et al. Heidelberg: Springer.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xianwei Huang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Huang, X., Naghdy, F., Du, H., Naghdy, G., Todd, C. (2018). Temporal Difference (TD) Based Critic-Actor Adaptive Control for a Fine Hand Motion Rehabilitation Robot. In: Billingsley, J., Brett, P. (eds) Mechatronics and Machine Vision in Practice 3. Springer, Cham. https://doi.org/10.1007/978-3-319-76947-9_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-76947-9_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-76946-2

  • Online ISBN: 978-3-319-76947-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics