A Bayesian Game-Theoretic Approach for Distributed Resource Allocation in Fading Multiple Access Channels
- 1.3k Downloads
A Bayesian game-theoretic model is developed to design and analyze the resource allocation problem in Open image in new window -user fading multiple access channels (MACs), where the users are assumed to selfishly maximize their average achievable rates with incomplete information about the fading channel gains. In such a game-theoretic study, the central question is whether a Bayesian equilibrium exists, and if so, whether the network operates efficiently at the equilibrium point. We prove that there exists exactly one Bayesian equilibrium in our game. Furthermore, we study the network sum-rate maximization problem by assuming that the users coordinate according to a symmetric strategy profile. This result also serves as an upper bound for the Bayesian equilibrium. Finally, simulation results are provided to show the network efficiency at the unique Bayesian equilibrium and to compare it with other strategies.
KeywordsChannel State Information Channel Gain Ergodic Capacity Multiple Access Channel Bayesian Game
The fading multiple access channel (MAC) is a basic wireless channel model that allows several transmitters connected to the same receiver to transmit over it and share its capacity. The capacity region of the fading MAC and the optimal resource allocation algorithms have been characterized and well studied in many pioneering works with different information assumptions [1, 2, 3, 4]. However, in order to achieve the full capacity region, it usually requires a central computing resource (a scheduler with comprehensive knowledge of the network information) to globally allocate the system resources. This process is centralized, since it involves feedback and overhead communication whose load scales linearly with the number of transmitters in the network. In addition, with the fast evolution of wireless techniques, this centralized network infrastructure begins to expose its weakness in many aspects, for example, slow reconfiguration against varying environment, increased computational complexity, and so forth. This is especially crucial for femto-cell networks where it is quite difficult to centralize the information due to a limited capacity backhaul. Moreover, the high density of base stations would increase the cost of centralizing the information.
In recent years, increased research interest has been given to self-organizing wireless networks in which mobile devices allocate resources in a decentralized manner . Tools from game theory  have been widely applied to study the resource allocation and power control problems in fading MAC , as well as many other types of channels, such as orthogonal frequency division multiplexing (OFDM) , multiple input and multiple output (MIMO) channels [9, 10], and interference channels . Typically, the game-theoretic models used in these previous works assume that the knowledge, for example, channel state information (CSI), about other devices is available to all devices. However, this assumption is hardly met in practice. In practical wireless scenarios, mobile devices can have local information but can barely access to global information on the network status.
A static noncooperative game has been introduced in the context of the two-user fading MAC, known as "waterfilling game" . By assuming that users compete with transmission rates as utility and transmit powers as moves, the authors show that there exists a unique Nash equilibrium  which corresponds to the maximum sum-rate point of the capacity region. This claim is somewhat surprising, since the Nash equilibrium is in general inefficient compared to the Pareto optimality. However, their results rely on the fact that both transmitters have complete knowledge of the CSI, and in particular, perfect CSI of all transmitters in the network. As we previously pointed out, this assumption is rarely realistic in practice.
Thus, this power allocation game needs to be reconstructed with some realistic assumptions made about the knowledge level of mobile devices. Under this consideration, it is of great interest to investigate scenarios in which devices have "incomplete information" about their components, for example, a device is aware of its own channel gain, but unaware of the channel gains of other devices. In game theory, a strategic game with incomplete information is called a "Bayesian game." Over the last ten years, Bayesian game-theoretic tools have been used to design distributed resource allocation strategies only in a few contexts, for example, CDMA networks [13, 14], multicarrier interference networks . The primary motivation of this paper is therefore to investigate how Bayesian games can be applied to study the resource allocation problems in the fading MAC. In some sense, this study can help to design a self-organizing femto-cell network where different frequency bands or subcarriers are used for the femto-cell coverage, for example, different femto-cells operate on different frequency bands to avoid interference.
In this paper, we introduce a Bayesian game-theoretic model to design and analyze the resource allocation problem in a fading MAC, where users are assumed to selfishly maximize their ergodic capacity with incomplete information about the fading channel gains. In such a game-theoretic study, the central question is whether a Bayesian equilibrium exists, and if so, whether the network operates efficiently at the equilibrium point. We prove that there exists exactly one Bayesian equilibrium in our game. Furthermore, we study the network sum-rate maximization problem by assuming that all users coordinate to an optimization-based symmetric strategy. This centralized strategy is important when the fading processes for all users are relatively stationary and the global system structure is fixed for a long period of time. This result also serves as an upper bound for the unique Bayesian equilibrium.
The paper is organized in the following form: In Section 2, we introduce the system model and state important assumptions. In Section 3, the Open image in new window -user MAC is formulated as a static Bayesian game. In Section 4, we characterize the Bayesian equilibrium set. In Section 5, we give a special discussion on the optimal symmetric strategy. Some numerical results are provided to show the efficiency of the Bayesian equilibrium in Section 6. Finally, we close with some concluding remarks in Section 7.
2. System Model and Assumptions
2.1. System Model
where Open image in new window is a vector of channel gain variables. Note that in (3) we assume that the receiver applies a single-user decoding and there is not sophisticated successive decoding to be used. An intuitive understanding of this result can be obtained by viewing capacities in terms of time averages of mutual information . Although the study of multiuser decoding is important, which may involve Stackelberg games, fairness concepts, and generalized Nash games, it is not provided in this study. The interested readers are referred to  for this topic.
2.2. Assumption of Finite Channel States
Before introducing our game model, we need to clarify a prior assumption for this section.
Assumption 1. We assume that each user's channel gain Open image in new window is i.i.d. from two discrete values: Open image in new window and Open image in new window with probability Open image in new window and Open image in new window , respectively. Without loss of generality, we assume Open image in new window .
On the one hand, our assumption is closely related to the way how feedback information is signalled to the transmitters. In order to get the channel information Open image in new window at the transmitter side, the base station is required to feedback an estimate of Open image in new window to user Open image in new window at a given precision. Since in digital communications, any information is represented by a finite number of bits (e.g., Open image in new window bits), channels gains are mapped into a set that contains a finite number of states ( Open image in new window states).
On the other hand, this is a necessary assumption for analytical tractability, since in principle the functional strategic form of a player can be quite complex with both actions and states being continuous (or infinite). To avoid this problem, in  the authors successfully modelled a multicarrier Gaussian interference channel as a Bayesian game with discrete (or finite) actions and continuous states. Inspired from , we also model the fading MAC as a Bayesian game under the assumption of continuous actions and discrete states.
3. Game Formulation
We model the Open image in new window -user fading MAC as a Bayesian game, in which users do not have complete information. In a Open image in new window -user MAC, to have "complete information" means that, at each time Open image in new window , the channel gain realizations Open image in new window are known at all the transmitters, denoted by Open image in new window . Any other condition corresponds to a situation of incomplete information. In this paper, the "incomplete information" particularly refers to a situation where each Open image in new window only knows its own channel gain realization Open image in new window , but does not know the channel gains of other transmitters Open image in new window . We will denote by Open image in new window the channel gain variable of user Open image in new window , whose distribution is assumed to be stationary and ergodic in this section.
where Open image in new window and Open image in new window are transmit power strategy and average power constraint of user Open image in new window , respectively. Under the assumption that each user has incomplete information about the channel gains, user Open image in new window 's strategy Open image in new window is defined as a function of its own channel gain Open image in new window , that is, Open image in new window . Note that (4) implies that user Open image in new window should know at least the statistics of other users' channels.
where the dual variable Open image in new window is chosen such that the power constraint in (4) is satisfied with equality. However, the solution of (5) depends on Open image in new window which user Open image in new window does not know, and the same holds for all other users. Thus, in order to obtain the optimal power allocation, each user must adjust its power level based on the guess of all other users' strategies. Now, given the following game model, each user is able to adjust its strategy according to the belief it has about the strategy of the other user.
Player set: Open image in new window .
Type set: Open image in new window (" Open image in new window " stands for the Cartesian product) where Open image in new window . A player's type is defined as its channel gain, that is, Open image in new window .
In games of incomplete information, a player's type represents any kind of private information that is relevant to its decision making. In our context, the fading channel gain Open image in new window is naturally considered as the type of user Open image in new window , since its decision (in terms of power) can only rely on Open image in new window . Note that this is a continuous game (a continuous game extends the notion of a discrete game (where players choose from a finite set of pure strategies), it allows players to choose a strategy from a continuous pure strategy set) with discrete states, since each player's action Open image in new window can take any value satisfying the constraint Open image in new window and the channel state Open image in new window is finite Open image in new window .
4. Bayesian Equilibrium
4.1. Definition of Bayesian Equilibrium
What we can expect from the outcome of a Bayesian game if every selfish and rational (rational player means a player chooses the best response given its information) participant starts to play the game? Generally speaking, the process of such players' behaviors usually results in a Bayesian equilibrium, which represents a common solution concept for Bayesian games. In many cases, it represents a "stable" result of learning and evolution of all participants. Therefore, it is important to characterize such an equilibrium point, since it concerns the performance prediction of a distributed system.
Definition 2 (Bayesian equilibrium).
where we define Open image in new window .
From this definition, it is clear that at the Bayesian equilibrium no player can benefit from changing its strategy while the other players keep theirs unchanged. Note that in a strategic-form game with complete information each player chooses a concrete action, whereas in a Bayesian game each player Open image in new window faces the problem of choosing a set or collection of actions (power strategy Open image in new window ), one for each type (channel gain Open image in new window ) it may encounter. It is also worth to mention that the action set of each player is independent of the type set, that is, the actions available to user Open image in new window are the same for all types.
4.2. Characterization of the Bayesian Equilibrium Set
It is well known that, in general, an equilibrium point does not necessarily exist . Therefore, our primary interest in this paper is to investigate the existence and uniqueness of a Bayesian equilibrium in Open image in new window . We now state our main result.
It is easy to prove the existence part, since the strategy space Open image in new window is convex, compact, and nonempty for each Open image in new window ; the payoff function Open image in new window is continuous in both Open image in new window and Open image in new window ; Open image in new window is concave in Open image in new window for any Open image in new window .
In order to prove the uniqueness part, we should rely on a sufficient condition given in : a non-cooperative game has a unique equilibrium, if the nonnegative weighted sum of the payoff functions is diagonally strictly concave. We firstly give the definition.
Definition 4 (diagonally strictly concave).
We start with the following lemma.
The weighted nonnegative sum of the average payoffs Open image in new window in Open image in new window is diagonally strictly concave for Open image in new window , where Open image in new window is a positive scalar, Open image in new window is a vector whose every entry is Open image in new window .
Since Open image in new window are assumed to be two different vectors, we must have Open image in new window . Now, we can draw a conclusion from the equation above: Open image in new window . This is because: Open image in new window the first part Open image in new window for all Open image in new window , since Open image in new window and Open image in new window for all Open image in new window ; Open image in new window the second part Open image in new window for all Open image in new window , and there exists at least one nonzero term Open image in new window , due to Open image in new window and Open image in new window for all Open image in new window . Therefore, the summation of all the products of the first and the second terms must be positive. From Definition 4, the sum-payoff function Open image in new window satisfies the condition of diagonally strictly concave. This completes the proof of this lemma.
Since our sum-payoff function Open image in new window given in (12) is diagonally strictly concave, the uniqueness of Bayesian equilibrium in our game Open image in new window follows directly from [19, Theorem Open image in new window ].
5. Optimal Symmetric Strategies
The Bayesian game-theoretic approach provides us a better understanding of the wireless resource competition existing in the fading MAC when every mobile device acts as a selfish and rational decision maker (this means a device always chooses the best response given its information). The advantage of this model is that it mathematically captures the behavior of selfish wireless entities in strategic situations, which can automatically lead to the convergence of system performance. The introduced Bayesian game-theoretic framework fits very well the concept of self-organizing networks, where the intelligence and decision making is distributed. Such a scheme has apparent benefits in terms of operational complexity and feedback load.
However, from the global system performance perspective, it is usually inefficient to give complete "freedom" to mobile devices and let them take decisions without any policy control over the network. It is very interesting to note that a similar situation happens in the market economy, where consumers can be modeled as players to complete for the market resources. In the famous literature The Wealth of Nations, Adam Smith (a Scottish moral philosopher, pioneer of political economy, and father of modern economics) expounded how rational self-interest and competition can lead to economic prosperity and well-being through macroeconomic adjustments. For example, all states today have some form of macroeconomic control over the market that removes the free and unrestricted direction of resources from consumers and prices such as tariffs and corporate subsidies.
In particular, wireless service providers would like to design an appropriate policy to efficiently manage the system resource so that the global network performance can be optimized or enhanced to a certain theoretical limit, for example, Shannon capacity or capacity region . Apparently, a centralized scheduler with comprehensive knowledge of the network status can globally optimize the resource utility. However, this approach usually involves sophisticated optimization techniques and a feedback load that grows with the number of wireless devices in the network. Thus, the optimization-based centralized decision has to be frequently updated as long as the wireless environment varies, or the system structure changes, for example, a user joins or exits the network.
In this section, we consider that the channel statistics (fading processes) for all wireless devices are jointly stationary for a relatively long period of signal transmission, and the global system structure remains unchanged. In addition, we neglect the problem of computational complexity at the scheduler and the impact of feedback load to the useful data transmission rate. In this case, the network service provider would strictly prefer to use a centralized approach, that is, a scheduler assigns some globally optimal strategies to the wireless devices, guiding them how to react under all kinds of different situations. Based on the Bayesian game settings, we provide a special discussion on the optimal symmetric strategy design. Note that this result can be treated as a theoretical upperbound for the performance measurement of Bayesian equilibrium.
We now introduce a necessary assumption.
Mobile devices are designed to use the same power strategies, that is, they send the same power if their observations on the channel states are symmetric. In addition, we assume that the mobile devices have the same average power constraint, that is, Open image in new window .
5.1. Two Channel States
Under Assumption 6, it can be shown that (due to the symmetric property) this single-user maximization problem is equivalent to the multiuser sum average rate maximization problem, that is, Open image in new window , which is our object in this section.
Note that in this setting the choice of the optimal symmetric strategy is to concentrate the full available power on a single channel state. The selection of the channel state on which to transmit depends not only on the channel conditions but also on the probability of the channel states. This result implies that, in the high SNR regime, the optimal symmetric power strategy is to transmit information in an "opportunistic" way. For a better understanding of the "opportunistic" transmission, the interested reads are referred to .
5.2. Multiple Channel States
In this subsection, we discuss the extension to arbitrary Open image in new window ( Open image in new window ) channel states. Note that the result of this subsection can also be applied to the case of two channel states.
Each user's channel gain Open image in new window has Open image in new window positive states, which are Open image in new window with probability Open image in new window , respectively (Without loss of generality, Open image in new window ), and we have Open image in new window .
we say that the lower bound (26) is tight with equality at a chosen value Open image in new window .
where Open image in new window is chosen such that Open image in new window . Thus, for some fixed value of Open image in new window , we can directly apply (35) to maximize the lower bound Open image in new window (28). Then, it is natural to improve the bound periodically. Based on the discussion above, we propose the following algorithm, namely Lower Bound Tightening (LBT) algorithm
The algorithm convergence can be easily proved, since the objective is monotonically increasing at each iteration. However, the global optimum is not always guaranteed, due to the nonconvex property.
6. Numerical Results
First, we show the existence and uniqueness of Bayesian equilibrium in the scenario of two-user fading MAC. In Figure 1(a), we assume the channel gains are Open image in new window ; in Figure 1(b), we assume Open image in new window . On both Open image in new window and Open image in new window axis, Open image in new window and Open image in new window represent the power allocated by user Open image in new window and user Open image in new window when the channel gain is Open image in new window . The curves Open image in new window and Open image in new window represent the best-response functions of user Open image in new window and user Open image in new window , respectively. As expected, the Bayesian equilibrium is unique in both cases, that is, (0.6,0.6) and (0.5,0.5).
Second, we investigate the efficiency of Bayesian equilibrium from the viewpoint of global average network performance. The Open image in new window axis, SNR is defined as the ratio between the power constraint Open image in new window and the noise variance Open image in new window . In Figure 2(a), again, we assume Open image in new window ; in Figure 2(b), we assume Open image in new window . The curve "Pareto" represents the Nash equilibrium in the waterfilling game, in which users have complete information. This gives the upper bound for our Bayesian equilibrium, since it is also the Pareto optimal solution . The curve "Uniform" represents the time-domain uniform power allocation. Since this is the strategy when users have no information about the channel gains, it corresponds obviously to a lower bound. The curve "Symmetric" represents the optimal symmetric strategy presented in Section 5. This can be treated as a weaker upper bound (inferior to the Pareto optimality) for the Bayesian equilibrium. From the slopes of these curves, we can clearly observe the inefficiency of the Bayesian equilibrium, especially in the high SNR regime. This can be explained as follows: in our game Open image in new window , users with incomplete information improve the global network performance (comparing to the scenario in which the users have no information), however, it does not improve the performance slope.
We presented a Bayesian game-theoretic framework for distributed resource allocation in fading MAC, where users are assumed to have only information about their own channel gains. By introducing the assumption of finite channel states, we successfully found a analytical way to characterize the Bayesian equilibrium set. First, we proved the existence and uniqueness. Second, the inefficiency was shown from numerical results. Furthermore, we analyzed the optimal symmetric power strategy based on the practical concerns of resource allocation design. Future extension is considered to improve the efficiency of Bayesian equilibrium through pricing or cooperative game-theoretic approaches.
Algorithm 1: Lower Bound Tightening (LBT).
update Open image in new window using (34)
until Open image in new window
- 5.Debbah M: Mobile flexible networks: the challenges ahead. Proceedings of the International Conference on Advanced Technologies for Communications (ATC '08), October 2008, Hanoi, Vietnam 3-7.Google Scholar
- 6.Fudenberg D, Tirole J: Game Theory. MIT Press, Cambridge, Mass, USA; 1991.Google Scholar
- 8.He G, Beta S, Debbah M: Game-theoretic deployment design of small-cell OFDM networks. Proceedings of the 3rd ICST/ACM International Workshop on Game Theory in Communication Networks, October 2009Google Scholar
- 11.Altman E, Debbah M, Silva A: Game theoretic approach for routing in Dense ad-hoc networks. Proceedings of the Stochastic Networks Workshop, July 2007, Edinburg, UKGoogle Scholar
- 13.Heikkinen T: A minmax game of power control in a wireless network under incomplete information. Tech. Rep. 99-43, DIMACS, August 1999.Google Scholar
- 14.Jean CASt, Jabbari B: Bayesian game-theoretic modeling of transmit power determination in a self-organizing CDMA wireless network. Proceedings of the 60th IEEE Vehicular Technology Conference (VTC '04), 2004 5: 3496-3500.Google Scholar
- 15.Adlakha S, Johari R, Goldsmith A: Competition in wireless systems via Bayesian interference games. http://arxiv.org/abs/0709.0516
- 17.Altman E, Avrachenkov K, Cottatellucci L, Debbah M, He G, Suarez A: Operating point selection in multiple access rate regions. Proceedings of the 21st International Teletraffic Congress (ITC '09), June 2009, Paris, FranceGoogle Scholar
- 21.Papandriopoulos J, Evans JS: Low-complexity distributed algorithms for spectrum balancing in multi-user DSL networks. Proceedings of IEEE International Conference on Communications (ICC '06), June 2006 7: 3270-3275.Google Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.