Abstract
The charging strategy for the mobile charger (MC) has been a hot research topic in wireless rechargeable sensor networks. We focus on the charging path for the MC, since the MC stops at each sensor node until the sensor node is fully charged. Most of the existing reports have designed optimization methods to obtain the charging path, with the target like minimizing the charging cost. However, the autonomous charging path planning for the MC in a changeable network is not taken into consideration. In this paper, Reinforcement Learning (RL) is introduced into the charging path planning for the MC in WRSNs. Considering the influences of the energy variation and the locations of the sensor nodes, a novel Charging Strategy in WRSNs based on RL (CSRL) is proposed so that the autonomy of the MC is improved. Simulation experiments show that CSRL can effectively prolong the lifetime of the network and improve the driving efficiency of the MC.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chen, Q., Gao, H., Cai, Z., Cheng, L., Li, J.: Energy-collision aware data aggregation scheduling for energy harvesting sensor networks. In: International Conference on Computer Communications. IEEE, Honolulu (2018)
Shi, Y., Xie, L., Hou, Y.T., Sherali, H.D.: On renewable sensor networks with wireless energy transfer. In: The 30th IEEE International Conference on Computer Communications, pp. 1350–1358. IEEE, Shanghai (2011)
Kurs, A., Karalis, A., Moffatt, R., Joannopoulos, J.D., Fisher, P., Soljai, M.: Wireless power transfer via strongly coupled magnetic resonances. Science 317(5834), 83–86 (2007)
Yau, K.L.A., Goh, H.G., Chieng, D., Kwong, K.H.: Application of reinforcement learning to wireless sensor networks: models and algorithms. Computing 97(11), 1045–1075 (2015)
Liang, W., Xu, W., Ren, X., Jia, X., Lin, X.: Maintaining large-scale rechargeable sensor networks perpetually via multiple mobile charging vehicles. ACM Trans. Sens. Netw. 12(2), 1–26 (2016)
Xu, J., Yuan, X., Wei, Z., Han, J., Shi, L., Lyu, Z.: A wireless sensor network recharging strategy by balancing lifespan of sensor nodes. In: Wireless Communications and Networking Conference, pp. 1–6. IEEE, San Francisco (2017)
Fu, L., Cheng, P., Gu, Y., Chen, J., He, T.: Optimal charging in wireless rechargeable sensor networks. IEEE Trans. Veh. Technol. 65(1), 278–291 (2016)
Liang, W., Xu, Z., Xu, W., Shi, J., Mao, G., Das, S.K.: Approximation algorithms for charging reward maximization in rechargeable sensor networks via a mobile charger. IEEE/ACM Trans. Netw. 25(5), 1–14 (2017)
Rao, X., Yang, P., Yan, Y., Zhou, H., Wu, X.: Optimal recharging with practical considerations in wireless rechargeable sensor network. IEEE Access 5(99), 4401–4409 (2017)
Cai, Z., Zheng, X.: A private and efficient mechanism for data uploading in smart cyber-physical systems. IEEE Trans. Netw. Sci. Eng. 5(1), 1–9 (2018)
Zheng, X., Cai, Z., Li, Y.: Data linkage in smart IoT systems: a consideration from privacy perspective. IEEE Commun. Mag. 10(2), 12–20 (2018)
Liang, Y., Cai, Z., Yu, J., Han, Q., Li, Y.: Deep learning based inference of private information using embedded sensors in smart devices. IEEE Netw. Mag. 5(8), 33–43 (2018)
Shi, T., Cheng, S., Cai, Z., Li, Y., Li, J.: Exploring connected dominating sets in energy harvest networks. IEEE/ACM Trans. Netw. 5(12), 1–15 (2017)
Goudarzi, S., Wan, H.H., Anisi, M.H., Soleymani, S.A.: MDP-based network selection scheme by genetic algorithm and simulated annealing for vertical-handover in heterogeneous wireless networks. Wirel. Pers. Commun. 92(2), 399–436 (2017)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Wei, Z., Liu, F., Lyu, Z., Ding, X., Shi, L., Xia, C. (2018). Reinforcement Learning for a Novel Mobile Charging Strategy in Wireless Rechargeable Sensor Networks. In: Chellappan, S., Cheng, W., Li, W. (eds) Wireless Algorithms, Systems, and Applications. WASA 2018. Lecture Notes in Computer Science(), vol 10874. Springer, Cham. https://doi.org/10.1007/978-3-319-94268-1_40
Download citation
DOI: https://doi.org/10.1007/978-3-319-94268-1_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94267-4
Online ISBN: 978-3-319-94268-1
eBook Packages: Computer ScienceComputer Science (R0)