CMDP-based intelligent transmission for wireless body area network in remote health monitoring

  • Weilin Zang
  • Fen Miao
  • Raffaele Gravina
  • Fangmin Sun
  • Giancarlo Fortino
  • Ye LiEmail author
Intelligent Biomedical Data Analysis and Processing


Remote health monitoring is one kind of E-health service, which transfer the users’ physiological data to the medical data center for analysis or diagnosis. Wireless body area network (WBAN) is a promising technology to achieve physiological information acquiring and delivering and thus has been widely adopted in remote health-monitoring applications. For WBAN, energy consumption is the major concern which has been addressed in many researches. Different from existing works, this work studies a joint scheduling and admission control problem with objective of optimizing the energy efficiency of both intra- and beyond-WBAN link. The problem is formulated as constrained Markov decision processes, and the relative value iteration and Lagrange multiplier approach are used to derive the optimal intelligent algorithm. Simulation results show the proposed algorithm is capable of, in comparison with greedy scheme, achieving nearly 100% throughput improvement in various power consumption budgets. Moreover, the proposed algorithm can achieve up to 5.5× power consumption saving for sensor node in comparison with other scheduling algorithms.


Constrained Markov decision processes (CMDP) Intelligent adaptive learning algorithm Joint intra- and beyond-WBAN Remote health monitoring Wireless body area network 



This work was supported in part by the National Natural Science Foundation of China (No. 61702497), Shenzhen Science and Technology Projects with Grant Number JCYJ20170412110753954.

Compliance with ethical standards

Conflict of interest

All authors declare that they have no conflict of interest.


  1. 1.
    Jermana M, Matheus R, Glauber V et al (2018) Advances in photopletysmography signal analysis for biomedical applications. Sensors 18(6):1894CrossRefGoogle Scholar
  2. 2.
    Marques JAL, Cortez PC, Madeiro JPV et al (2018) Nonlinear characterization and complexity analysis of cardiotocographic examinations using entropy measures. J Supercomput. Google Scholar
  3. 3.
    Proakis JG (2001) Digital communications. McGraw-Hill, New YorkzbMATHGoogle Scholar
  4. 4.
    Benharref A, Serhani MA (2014) Novel cloud and SOA-based framework for E-health monitoring using wireless biosensors. IEEE J Biomed Health Inf 18(1):46–55CrossRefGoogle Scholar
  5. 5.
    Junnila S, Kailanto H, Merilahti J et al (2010) Wireless, multipurpose in-home health monitoring platform: two case trials. IEEE Trans Inf Technol Biomed 14(2):447–455CrossRefGoogle Scholar
  6. 6.
    de Oliveira Júnior WG, Oliveira JMD, Munoz R et al. (2018) A proposal for internet of smart home things based on BCI system to aid patients with amyotrophic lateral sclerosis. Neural Comput Appl 2018:1–11Google Scholar
  7. 7.
    Cavallari R, Martelli F, Rosini R et al (2014) A survey on wireless body area networks: technologies and design challenges. IEEE Commun Surv Tutor 16(3):1635–1657CrossRefGoogle Scholar
  8. 8.
    Patel M, Wang J (2010) Applications, challenges, and prospective in emerging body area networking technologies. IEEE Wirel Commun 17(1):80–88CrossRefGoogle Scholar
  9. 9.
    He C, Fan X, Li Y (2013) Toward ubiquitous healthcare services with a novel efficient cloud platform. IEEE Trans Biomed Eng 60(1):230–234CrossRefGoogle Scholar
  10. 10.
    Mahmoud MME, Rodrigues JJPC, Ahmed SH et al (2018) Enabling technologies on cloud of things for smart healthcare. IEEE Access 2018:1Google Scholar
  11. 11.
    Rodrigues JJPC, Segundo DBDR, Junqueira HA et al (2018) Enabling technologies for the internet of health things. IEEE Access 6:13129–13141CrossRefGoogle Scholar
  12. 12.
    Abawajy JH, Hassan MM (2017) Federated internet of things and cloud computing pervasive patient health monitoring system. IEEE Commun Mag 55(1):48–53CrossRefGoogle Scholar
  13. 13.
    Ghanavati S, Abawajy J, Izadi D (2016) An alternative sensor cloud architecture for vital signs monitoring. In: International joint conference on neural networks. IEEEGoogle Scholar
  14. 14.
    Hussein AF, Kumar A, Burbano-Fernandez M et al (2018) An automated remote cloud-based heart rate variability monitoring system. IEEE Access 6:77055–77064CrossRefGoogle Scholar
  15. 15.
    Nia AM, Mozaffari-Kermani M, Sur-Kolay S et al (2015) Energy-efficient long-term continuous personal health monitoring. IEEE Trans Multi Scale Comput Syst 1(2):85–98CrossRefGoogle Scholar
  16. 16.
    Zang W, Li Y (2018) Gait cycle driven transmission power control scheme for wireless body area network. IEEE J Biomed Health Inf 22(3):697–706CrossRefGoogle Scholar
  17. 17.
    Su H, Zhang X (2009) Battery-dynamics driven TDMA MAC protocols for wireless body-area monitoring networks in healthcare applications. IEEE J Sel Areas Commun 27(4):424–434MathSciNetCrossRefGoogle Scholar
  18. 18.
    Marinkovic SJ, Popovici EM, Spagnol C et al (2009) Energy-efficient low duty cycle MAC protocol for wireless body area networks. IEEE Trans Inf Technol Biomed 13(6):915CrossRefGoogle Scholar
  19. 19.
    Liu B, Yan Z, Chen CW (2013) MAC protocol in wireless body area networks for E-health: challenges and a context-aware design. IEEE Wirel Commun 20(4):64–72CrossRefGoogle Scholar
  20. 20.
    Argyriou A, Breva AC, Aoun M (2015) Optimizing data forwarding from body area networks in the presence of body shadowing with dual wireless technology nodes. IEEE Trans Mobile Comput 14(3):632–645CrossRefGoogle Scholar
  21. 21.
    Li Y, Qi X, Keally M et al (2013) Communication energy modeling and optimization through joint packet size analysis of BSN and WiFi networks. IEEE Trans Parallel Distrib Syst 24(9):1741–1751CrossRefGoogle Scholar
  22. 22.
    “Zigbee alliance,”
  23. 23.
    Specification of the Bluetooth System version 4.0. Bluetooth SIG, June 2010. [Online].
  24. 24.
    Puterman M (1994) Markov decision processes. Wiley, New YorkCrossRefzbMATHGoogle Scholar
  25. 25.
    Altman E (1999) Constrained Markov decision processes. Chapman & Hall, LondonzbMATHGoogle Scholar
  26. 26.
    Sennott LI (1999) Stochastic dynamic programming and the control of queuing systems. Wiley, New YorkzbMATHGoogle Scholar
  27. 27.
    Sennott LI (1989) Average cost optimal stationary policies in infinite state markov decision processes with unbounded costs. Informs 37:626–633MathSciNetzbMATHGoogle Scholar
  28. 28.
    Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, CambridgeGoogle Scholar
  29. 29.
    Ngo MH, Krishnamurthy V (2010) Monotonicity of constrained optimal transmission policies in correlated fading channels with ARQ. IEEE Trans Signal Process 58(1):438–451MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  • Weilin Zang
    • 1
    • 2
  • Fen Miao
    • 1
    • 2
  • Raffaele Gravina
    • 3
  • Fangmin Sun
    • 1
    • 2
  • Giancarlo Fortino
    • 3
  • Ye Li
    • 1
    • 2
    Email author
  1. 1.Key Laboratory for Health Informatics, Shenzhen Institutes of Advanced TechnologyChinese Academy of SciencesShenzhenChina
  2. 2.Shenzhen Engineering Laboratory of Health Big DataShenzhenChina
  3. 3.Department of Informatics, Modeling, Electronics, and SystemsUniversity of CalabriaRendeItaly

Personalised recommendations