Skip to main content

A Prediction and Learning Based Approach to Network Selection in Dynamic Environments

  • Conference paper
  • First Online:
Book cover Artificial Neural Networks and Machine Learning – ICANN 2017 (ICANN 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10613))

Included in the following conference series:

  • 2842 Accesses

Abstract

The heterogeneous property in the next generation wireless network arises challenges of network selection problem. Existing approaches are mainly implemented in static network environments while cannot handle unpredictable dynamics in practice. In this paper, we propose a prediction and learning based approach, which considers both the fluctuation of radio resource and the variation of user demand. The network selection scenario is modeled as a multiagent coordination problem, in which a population of rational agents compete to maximize their benefits with incomplete information (no prior knowledge of network bandwidth and other users’ demands). Terminal users adaptively adjust their selections in response to the gradually or abruptly changing environment. The system is shown to converge to Nash equilibrium, which also turns out to be both Pareto optimal and socially optimal. Extensive simulation results show that our approach achieves significantly better performance compared with two existing approaches in terms of load balancing, user payoff and the overall bandwidth utilization efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barve, S.S., Kulkarni, P.: Dynamic channel selection and routing through reinforcement learning in cognitive radio networks. In: IEEE International Conference on Computational Intelligence & Computing Research, pp. 1–7 (2012)

    Google Scholar 

  2. Brockwell, P.J., Davis, R.A.: Introduction to Time Series and Forecasting. STS. Springer, Cham (2016). doi:10.1007/b97391

    Book  MATH  Google Scholar 

  3. Charilas, D.E., Panagopoulous, A.D.: Multiaccess radio network enviroments. IEEE Veh. Technol. Mag. 5(4), 40–49 (2010)

    Article  Google Scholar 

  4. Jain, K., Padhye, J., Padmanabhan, V.N., Qiu, L.: Impact of interference on multi-hop wireless network performance. Wireless Netw. 11(4), 471–487 (2005)

    Article  Google Scholar 

  5. Kianercy, A., Galstyan, A.: Dynamics of Boltzmann q learning in two-player two-action games. Phys. Rev. E 85(4), 041145 (2012)

    Article  Google Scholar 

  6. Kittiwaytang, K., Chanloha, P., Aswakul, C.: CTM-based reinforcement learning strategy for optimal heterogeneous wireless network selection. In: Computational Intelligence, Modelling and Simulation (CIMSiM), pp. 73–78. IEEE (2010)

    Google Scholar 

  7. Martinez-Morales, J.D., Pineda-Rico, U., Stevens-Navarro, E.: Performance comparison between madm algorithms for vertical handoff in 4G networks. In: Electrical Engineering Computing Science and Automatic Control (CCE), pp. 309–314. IEEE (2010)

    Google Scholar 

  8. Monsef, E., Keshavarz-Haddad, A., Aryafar, E., Saniie, J., Chiang, M.: Convergence properties of general network selection games. In: 2015 IEEE Conference on Computer Communications (INFOCOM), pp. 1445–1453. IEEE (2015)

    Google Scholar 

  9. Niyato, D., Hossain, E.: Dynamics of network selection in heterogeneous wireless networks: an evolutionary game approach. IEEE Trans. Veh. Technol. 58(4), 2008–2017 (2009)

    Article  Google Scholar 

  10. Perkins, D.D., Hughes, H.D., Owen, C.B.: Factors affecting the performance of ad hoc networks. In: IEEE International Conference on Communications, vol. 4, pp. 2048–2052 (2002)

    Google Scholar 

  11. Trestian, R., Ormond, O., Muntean, G.M.: Game theory-based network selection: solutions and challenges. IEEE Commun. Surv. Tutor. 14(4), 1212–1231 (2012)

    Article  Google Scholar 

  12. Xu, Y., Chen, J., Ma, L., Lang, G.: Q-learning based network selection for WCDMA/WLAN heterogeneous wireless networks. In: 2014 IEEE 79th Vehicular Technology Conference (VTC Spring), pp. 1–5. IEEE (2014)

    Google Scholar 

Download references

Acknowledgements

This work has partially been sponsored by the National Science Foundation of China (No. 61572349, No. 61272106), Tianjin Research Program of Application Foundation and Advanced Technology (No.:16JCQNJC00100).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jianye Hao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Li, X., Cao, R., Hao, J., Feng, Z. (2017). A Prediction and Learning Based Approach to Network Selection in Dynamic Environments. In: Lintas, A., Rovetta, S., Verschure, P., Villa, A. (eds) Artificial Neural Networks and Machine Learning – ICANN 2017. ICANN 2017. Lecture Notes in Computer Science(), vol 10613. Springer, Cham. https://doi.org/10.1007/978-3-319-68600-4_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-68600-4_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-68599-1

  • Online ISBN: 978-3-319-68600-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics