Sequential Learning and Decision-Making in Wireless Resource Management

  • Rong Zheng
  • Cunqing Hua

Part of the Wireless Networks book series (WN)

Table of contents

  1. Front Matter
    Pages i-xiii
  2. Theory

    1. Front Matter
      Pages 1-1
    2. Rong Zheng, Cunqing Hua
      Pages 3-7
    3. Rong Zheng, Cunqing Hua
      Pages 9-25
    4. Rong Zheng, Cunqing Hua
      Pages 27-39
    5. Rong Zheng, Cunqing Hua
      Pages 41-57
  3. Applications

    1. Front Matter
      Pages 59-59
    2. Rong Zheng, Cunqing Hua
      Pages 61-69
    3. Rong Zheng, Cunqing Hua
      Pages 91-101
    4. Rong Zheng, Cunqing Hua
      Pages 103-115
  4. Back Matter
    Pages 117-118

About this book


This book lays out the theoretical foundation of the so-called multi-armed bandit (MAB) problems and puts it in the context of resource management in wireless networks. Part I of the book presents the formulations, algorithms and performance of three forms of MAB problems, namely, stochastic, Markov and adversarial. Covering all three forms of MAB problems makes this book unique in the field. Part II of the book provides detailed discussions of representative applications of the sequential learning framework in cognitive radio networks, wireless LANs and wireless mesh networks. 

Both individuals in industry and those in the wireless research community will benefit from this comprehensive and timely treatment of these topics. Advanced-level students studying communications engineering and networks will also find the content valuable and accessible.


Sequential learning Multi-armed bandit Wireless resource management Exploration and exploitation Incomplete information Wireless data services Bandits Wireless networks Cognitive radio networks Wireless mesh networks Wireless LANs

Authors and affiliations

  • Rong Zheng
    • 1
  • Cunqing Hua
    • 2
  1. 1.Department of ComputingMcMaster UniversityHamiltonCanada
  2. 2.School of Information Security EngineeringShanghai Jiao Tong UniversityShanghaiChina

Bibliographic information

  • DOI
  • Copyright Information Springer International Publishing AG 2016
  • Publisher Name Springer, Cham
  • eBook Packages Computer Science
  • Print ISBN 978-3-319-50501-5
  • Online ISBN 978-3-319-50502-2
  • Series Print ISSN 2366-1186
  • Series Online ISSN 2366-1445
  • Buy this book on publisher's site
Industry Sectors
Finance, Business & Banking
IT & Software
Energy, Utilities & Environment