Matching Heterogeneous User Demands: Localized Self-organization Game and MARL Based Network Selection

  • Zhiyong DuEmail author
  • Bin Jiang
  • Qihui Wu
  • Yuhua Xu
  • Kun Xu


This chapter focuses on network selection for multiple user cases. Since users’ network selection decision determines the load distribution of networks, users’ decision-making is interacted. In particular, when heterogeneous user demand is considered, the solution of the optimal match between users and networks becomes a challenge. Centralized solutions could achieve a fair performance at a high optimization cost. Distributed solutions incur less cost but commonly result in low efficiency due to user competition. Different from centralized approaches or distributed approaches, we propose a local improvement algorithm, where networks that share users, called coupled network pairs (CNPs), cooperatively re-associate users with user demand awareness. Under a novel localized self-organization game formulation, we proved that the local improvement algorithm can achieve promising performance. To speed up the convergence of the algorithm, we further exploit the spatial independence among CNPs and propose an enhanced local improvement algorithm. Finally, simulation results indicate that the proposed algorithms achieve much better performance with relatively short convergence time, compared with three distributed algorithms.


  1. 1.
    Xue P, Gong P, Park J et al (2012) Radio resource management with proportional rate constraint in the heterogeneous networks. IEEE Trans Wirel Commun 11(3):1066–1075CrossRefGoogle Scholar
  2. 2.
    Prasad N, Zhang H, Zhu H et al (2014) Multiuser scheduling in the 3GPP LTE cellular uplink. IEEE Trans Mob Comput 13(1):130–145CrossRefGoogle Scholar
  3. 3.
    Keshavarz-Haddad A, Aryafar E, Wang M, Chiang M (2017) HetNets selection by clients: convergence, efficiency, and practicality. IEEE ACM Trans Netw 25(1):406–419CrossRefGoogle Scholar
  4. 4.
    Malanchini I, Cesana M, Gatti N (2013) Network selection and resource allocation games for wireless access networks. IEEE Trans Mob Comput 12(12):2427–2440CrossRefGoogle Scholar
  5. 5.
    Feng X, Gan X et al (2017) Distributed cell selection in heterogeneous wireless networks. Comput Commun 109:13–23CrossRefGoogle Scholar
  6. 6.
    Nguyen DD, Nguyen HX, White LB (2017) Reinforcement learning with network-assisted feedback for heterogeneous RAT selection. IEEE Trans Wirel Commun 16(9):6062–6076CrossRefGoogle Scholar
  7. 7.
    Du Z, Wu Q, Yang P, Yuhua Xu, Yao YD (2014) User-demand-aware wireless network selection: a localized cooperation approach. IEEE Trans Veh Technol 63(9):4492–4507CrossRefGoogle Scholar
  8. 8.
    Rakocevic V, Griffiths J, Cope G (2001) Performance analysis of bandwidth allocation schemes in multiservice IP networks using utility functions. In: Proceedings of the 17th international teletraffic congress (ITC)Google Scholar
  9. 9.
    Deb S, Nagaraj K, Srinivasan V (2011) MOTA: engineering an operator agnostic mobile service. MobiCom 2011Google Scholar
  10. 10.
    Arnborg S (1985) Efficient algorithms for combinatorial problems on graphs with bounded decomposability-a survey. BIT Numer 25(1):1–23MathSciNetCrossRefGoogle Scholar
  11. 11.
    Niyato D, Hossain E (2009) Dynamics of network selection in heterogeneous wireless networks: an evolutionary game approach. IEEE T Veh Technol 58(4):2008–2017CrossRefGoogle Scholar
  12. 12.
    Costa-Pérez X et al (2013) Latest trends in telecommunication standards. ACM Comput Commun RevGoogle Scholar
  13. 13.
    Monderer D, Sharpley LS (1996) Potential games. Games Econ Behav 14:124–143MathSciNetCrossRefGoogle Scholar
  14. 14.
    Diestel R (2000) Graph theory, 2nd edn. Springer, New York, p 2000zbMATHGoogle Scholar
  15. 15.
    Faudree RJ, Gould RJ, Jacobson MS et al (1992) On independent generalized degrees and independence numbers in K(l, m)-free graphs. Discrete Math 103:17–24MathSciNetCrossRefGoogle Scholar
  16. 16.
    Raychaudhuri D, Mandayam NB (2012) Frontiers of wireless and mobile communications. Proc IEEE 100(4):824–840CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Zhiyong Du
    • 1
    Email author
  • Bin Jiang
    • 1
  • Qihui Wu
    • 2
  • Yuhua Xu
    • 3
  • Kun Xu
    • 1
  1. 1.National University of Defense TechnologyChangshaChina
  2. 2.Nanjing University of Aeronautics and AstronauticsNanjingChina
  3. 3.Army Engineering University of PLANanjingChina

Personalised recommendations