1 Introduction

The availability of versatile and resilient wireless networks with high-speed performance and Wi-Fi on-the-go service with always-connected features for bandwidth-intensive applications is considered a basic necessity these days. Faster connection and speedy performance are the bare requirements for emerging bandwidth intensive services like high resolution video uploading (i.e., YouTube), video streaming (i.e., Netflix), virtual reality, augmented reality, real-time updating data (i.e., Facebook), online gaming, and live stream video (i.e. surveillance camera data). For example, Cisco announced [11] that it is expecting the global traffic to extend to 3.3 ZB per year by 2021 or 278 EB per month [11]. Devices and connections are growing at a 10 percent compound annual growth rate (CAGR) [5], and North American growth is expected to be the highest rate in the world [11]. Adaptation of IPv6 throughout the Internet allows for an effortless interaction among the Internet of Things (IoT) [12]. Internet traffic is increased by internet video, video-streaming, gaming, video-conferencing, and video specific applications. Most internet users use the internet on their mobile devices such as tablets, phone, laptop, etc., and they get their connection through wireless data services. They require high throughput and seamless connectivity without outage from their network services. IEEE 802.11 [25] wireless network standards, which is the most publicly used, have evolved to meet these growing requirements in terms of features like extended channel binding, multi-user Multiple In Multiple Out (MIMO) [26] ability, wide range of modulation, beam-forming, MAC modification, coexistence mechanisms, throughput and much more [16].

Fig. 1.
figure 1

An example of coverage map

Fig. 2.
figure 2

Network traffic

University Wi-Fi network accommodate thousands of mobile and wireless devices being used on a campus network. Multiple features of network utilization such as device variation, bandwidth requirements, application variability, operating system variability, user authentication and data off-loading, can be observed in a campus network. Each university strives to provide the best network service to its users despite the challenge of a fixed budget. To support the growing demand, it was necessary to upgrade the Wi-Fi network to improve coverage area, network speed, and throughput. The network team has taken two major steps for this enhancement. First, increase the number of access points (APs) to address the coverage gap. Second, upgrade the Wi-Fi network to 802.11 (ac) protocol to increase performance. In this paper, we conduct an extensive measurement analysis of the Wi-Fi network condition throughout the access layer of a university campus network, the University of Missouri - Kansas City (UMKC). We found some interesting phenomena like the variety of user density in the different locations with diversified bandwidth demands, lacking coverage in some area resulting in coverage gap, data rate degradation in certain points, and protocol compatibility issues. Figure 1 represents the signal strength and coverage map of a floor in a campus building prior to the upgrade. Furthermore, our observation indicates that between December 2016 and October 2017, the network’s traffic (upstream and downstream) has increased by up to 20%, even though the number of clients has decreased, as illustrated in Fig. 2.

The remainder of the paper is organized as follows. Section 2 discusses the related work. Section 3 outlines the deployment consideration and design. Section 4 presents our evaluation of measurement and analysis. We conclude the paper in Sect. 5.

2 Related Work

2.1 Wi-Fi Performance

Performance measurement analysis research done by [24] on IEEE 802.11 (ac) Wi-Fi in a large 24-node indoor test-bed reveals the impact of channel width, network deployment density, and type/volume of traffic on the achieved network performance in dense indoor deployments [27]. A Framework of Heterogeneous Network(HetNet) for Mobile cloud computing (MCC) has been introduced by [21], and they discuss the challenges for supporting MCC applications in HetNet. A focused study of dual-band APs performance in heterogeneous client adapter was done in [14] with a goal to understand the characteristics of 802.11 (n) networks in heterogeneous deployments. Their result reveals that dual band routers can effectively help in reducing the negative effects of adapters heterogeneity as well as providing backward compatibility.

Wi-Fi network supports varying levels of performance, depending on the technology standard. Research [22] introduces a key mandatory and optional PHY features, as well as the MAC enhancements of 802.11 (ac) over the existing 802.11 (n) standard in the evolution towards higher data rates. They compare the MAC performance between 802.11 (ac) and 802.11 (n) over three different frame aggregation mechanisms, viz., aggregate MAC service data unit (A-MSDU), aggregate MAC protocol data unit (A-MPDU), and hybrid A-MSDU/A-MPDU aggregation through numerical analysis and simulations. The result showed 802.11 (ac) outperforms 802.11 (n) with maximum throughput by 28% (84%).

2.2 Wi-Fi Usage

Study on the usage of the Google Wi-Fi network deployed in Mountain View, CA has been done by [15]. Their finding showed that usage naturally falls into three categories based almost entirely on client device type, traditional laptop users, fixed-location access devices, and PDA-like smart-phone devices and they have a diverse set of mobility patterns that map well to the archetypal use cases for traditional access technologies. In a study done by [19], for mobile clients to evaluate and select both APs and spectral bands in wide-spectrum networks that provide access to four bands at 700 MHz, 900 MHz, 2.4 GHz and 5 GHz by a single operational access network. Their finding showed under a diverse set of operating conditions, mobile clients can accurately predict their performance without a direct measurement at their current location and spectral bands. The challenge to provide seamless mobility emerges as a key topic in various standardization bodies as explored by [18] discusses the support of seamless handover between homogeneous networks. The continued effort in pursuit of gigabit wireless communications has been most noticeable in the IEEE 802.11 WLAN [20] in recent years. In 2010, the Wireless Gigabit (WiGig) Alliance, formed by a consortium of industry leaders, has completed the defined first draft of a unified architecture to enable tri-band communications over the frequency bands of 2.4, 5, and 60 GHz in their WiGig specification [23].

Our research differs from these authors; we focused on usage behavior measurement study of the access layer to bring light to the management issue discovered during incremental Wi-Fi deployment. We analyze less known network management issues such as coverage gap, bandwidth overload, and association/authentication failures due to roaming in a campus network.

Note that while there are a number of Wi-Fi measurement works available little studies have been done to provide insight on network management issues resulting from incremental, heterogeneous high-density [8] Wi-Fi deployment.

3 Wi-Fi Deployment Design

Incremental deployments were done over four years period. How to design heterogeneous compatibility, data rate, coverage, and performance were factored into the deployment plan and roll-out schedules [17].

Table 1. Data sets used
Table 2. Data source and tools used for analyzing coverage, authentication and bandwidth issues

3.1 Analysis Tool

Wireless devices need to be compatible with most of the wireless protocols and decide to select the best channel and wireless protocol based on wide range of parameters. The upgrade had to be backward compatible to accommodate heterogeneous devices [27]. The University Information Services department use network log events with Splunk and Ekahau Spectrum Analyzers to locate the coverage gaps through out the campus Wi-Fi network. There were many errors from re-authentication failure, and co-channel interference due to the wide range of the 2.4 GHz APs. Additionally, Wi-Fi network faced bandwidth overload in most of the 2.4 GHz APs due to the extensive coverage area which reaches too many clients far more than the APs’ capacity. Deploying an upgrade to replace the older APs which supported 802.11 (b/g/n) [13] with newer APs that supports both 802.11 (b/g/n/ac) and the adaptive 802.11 (r) [3] with FT feature would address these rising concerns. There are several tools used for the analysis of the upgrade and the different issues resolved by the upgrade as listed in Table 2. Table 1 discusses the data set used for our analysis. We had 15.3 billion records generated by Syslog server over four years period. The second data source is Cisco Prime consisting of 1 h, 1 week, 1 month and/or 1 year reports data from 14 different Categories, Autonomous AP, Clean Air, Clients, Compliance, Composite, Device, Guests, Identity Service Engin, Mesh, Network Summary, Performance, Raw NetFlow, Security and System Monitoring. There are 126 items reports under these categories.

3.2 Channel Planning and Band Select Feature

Several questions came to mind while planning the Wi-Fi protocol. What channels do the heterogeneous devices in the campus network support? Many older devices may not support the Extended channels and when that happens, the upgrade should only be providing redundant coverage. What is the student capacity in each class rooms? High density deployments were needed in some of the large auditoriums, which required increasing the number of APs in addition to the Wi-Fi upgrade. Consideration was given for APs to be allocated where coverage is optimized with minimum number of APs. Clients inside a pair of APs need to be within coverage distance from at least one of APs.

The 2.4 GHz band covers a larger range than 5 GHz and is commonly used on the campus network. Cisco APs by default send quicker probe response from 2.4 GHz band, resulting in more connection to 2.4 GHz band until the AP is overloaded and can no longer accept new connections. To overcome this crowding issue, Cisco introduced a feature called ‘Band Select’ [4], which allows dual-band clients to prefer the 5 GHz band over the 2.4 GHz. Band selection works by regulating probe responses to clients by making 5 GHz channels more attractive to dual-band clients from delaying 2.4 GHz probe responses. For example, the number of device association that is higher than N (our network set N to be 12) will have 2.4 GHz response suppressed M (our network set M to be 4) times before allowing the clients to receive Probe Response from 2.4 GHz wireless band. This may cause a small delay for non-dual band 2.4 GHz only devices, however, will alleviate the crowding issue of 2.4 GHz wireless band and send dual-band clients to 5 GHz wireless band creating a more balanced network.

3.3 Addressing Roaming Issue

Wi-Fi 802.11 (ac) has the fastest data rate, 1300 Megabits per second (Mbps) and compared to 802.11 (n) [25] typically 450 Mbps, it is 3x faster. Fast Transition(FT) [1], a feature of 802.11 (ac), makes roaming between two adjacent 5 GHz band seamless. However, if a client roams outside of 802.11 (ac) or even between two adjacent 5 GHz band and 2.4 GHz band, there is bound to be a delay. FT feature, included in the Wi-Fi deployment, permit continuous connectivity aboard wireless devices in motion, with fast and secure hand-offs from one base station to another while the client is roaming. FT will not be explored in this work. However, it will be scoped as part of future works.

3.4 Managing Coverage Gap

It is part of the design process to locate the holes in the existing Wi-Fi coverage area in order to identify the precise locations to place the new APs to provide the ultimate coverage. The initial installation had the APs stacked in one location of the building providing inefficiency and weak coverage to no coverage outside of the stacked APs coverage area. The current design fans out these APs to maximize the coverage area with minimum number of APs. Additional APs were placed throughout the campus locations to manage the load capacity for high-density areas.

Table 3. 802.11 (ac) wireless upgrade summary

3.5 Wi-Fi Upgrade Summary

The incremental Wi-Fi upgrade targeted the wireless infrastructure of several buildings including the university dormitories, and an off-campus network. There were 1187 APs upgraded to 802.11 (ac). Several of the old APs were replaced by the new APs with updated features. Majority of the APs (735), had Model 1810 Wave 2 with feature MU-MIMO [26]. MU-MIMO provides concurrent downstream communications to multiple wireless devices allowing client devices to get on and off the network faster, enabling more clients to use the network. 199 of the APs were with Model 3702 Wave 1 dual-band radios with a data rate of 150 Mbps. Table 3 lists the model and the number of AP which were deployed over the summer/winter weeks targeting minimal impact to clients.

4 Evaluation

In this section we perform pre-and-post upgrade evaluation using different network performance analysis tools. Cisco Prime Infrastructure reporting [9] is a tools used by network team to help monitor the system and network health and is used for troubleshooting network problems. To evaluate the sheer volume of Syslog messages generated from the Wi-Fi network during the upgrade period between 2015 and 2018, we use Big Data analytic tool named Splunk. We used Ekahau Wi-Fi Site Survey tool to capture the coverage map before and after the deployment. We used Wireshark to capture the packets of the roaming clients and FT authentications. We also used Wireless LAN Controller (WLC) and Radius logs to gather the Wi-Fi traffic activities.

Fig. 3.
figure 3

Campus network architecture with three layers: core, distribution, and access layers

4.1 Campus Network Setup

The campus network is hierarchical with three layers which is a common practice for campus or enterprise networks, illustrated by Fig. 3. UMKC network’s core routing depends mainly on two core routers, one as primary and the second as fail-over and load-balance. There is a third core router that is dedicated to the University housing and eduroam network. The second or middle layer is the distribution layer, connects the core layer (using routers) to the access layer (using switches). The lower layer includes all the edge switches, and APs which connect to the end users. The Wi-Fi network extends from our main university campus to nearby campus in downtown Kansas City, to Union Station of Kansas City, which is about 15 miles away. Within our university network, there are many networks, each serving a specific service. UMKCWPA is the main SSID for the UMKC wireless network. The eduroam is the network SSID for the educational network access for all the eduroam [6] parties. eduroam (education roaming) is an international roaming service for users in research, higher education and further education. It provides a single authentication access for all the mobile connectivity requirements of an institution across 78 countries in thousands of locations. The Wi-Fi network is primarily accessed by students, faculty, staff. Guest accounts use the guest network, which is dedicated for guests with very limited temporary access. The media network is the network that connects the media devices such as ROKUs [10], Firesticks [7], Chromecast [2], and Digital Video Recorder (DVR) boxes.

Fig. 4.
figure 4

Impact of band redirection

4.2 Client Redirection of 2.4 GHz to 5 GHz Band

5 GHz band offers a lot more space compared to 2.4 GHz, though it is not always fully utilized. Figure 4 illustrates authentication before and after the Band Select Feature suppresses client’s association request to 2.4 GHz multiple times guiding the requests to 5 GHz band. We can see that “Before: Band Redirect” most clients where connecting to 2.4 GHz band by default. However, “After: Band Redirect”, the dual band clients are guided toward the 5 GHz band. Our campus analysis indicated that there we more 5 GHz band authentication than 2.4 GHz as most laptops are only 5 GHz enabled. Between October 2016 and 2017 we observe the gradual decline in use of 2.4 GHz band and increase in 5 GHz band as illustrated by Fig. 6. Each dot on the graph represents the aggregated authentication count for a week. The lower peaks are due to holiday seasons, such as season break where student attendance is low. Comparing the first five weeks of the graph with the last five weeks, we can see that the client using 5 GHz band increased by up to 1150 count a week while clients using 2.4 GHz band decreased by up to 750 counts a week.

Fig. 5.
figure 5

802.11 total vs 802.11(ac) throughput

Fig. 6.
figure 6

2.4 GHz vs 5 GHz authentication

4.3 Throughput: Total 802.11 vs 802.11 (ac)

There were several activities during the last year that impacted the throughput to fluctuate during the Spring semester. The week of February 27th the WiFi network faced brief outage causing a dip in the traffic report. However, the controller/fail-over instantly corrected itself and traffic resumed. The week of April 2nd following spring break, our campus network upgraded to a new router resulting in short interruption. The third dip during April 23rd was due to performance issue which caused the router to reboot. Total Wireless network vs. 802.11 (ac) illustrated by Fig. 5 shows the weekly aggregated throughput in Mbps (Mega bit per second) between February 2017 and October 2017, with an increase in throughput for both Wi-Fi 802.11 (ac) and Total wireless (Wi-Fi 802.11) between spring and fall semester. Each dot on the graph represents the value of aggregated throughput for one week. Shortly after the Wi-Fi upgrade, throughput increased for both Wi-Fi 802.11 as a whole and 802.11(ac).

Fig. 7.
figure 7

Coverage in 2014 (Color figure online)

Fig. 8.
figure 8

Coverage in 2016 (Color figure online)

Fig. 9.
figure 9

Coverage 2018 (Color figure online)

4.4 Coverage Gap

After the recent implementation in January 2018 which included installation of several new APs to provide coverage to the red zone, the coverage improved significantly. Figure 7 represents the initial coverage with 9 APs in 2014, where the majority of the area was red and orange indicating coverage gaps. Figure 8 illustrates the coverage map in 2016 after 2 additional APs were installed and coverage showed improvement. Figure 9, recent coverage representation January 2018, with total of 19 APs and majority of them were dual band high-density.

Fig. 10.
figure 10

Authentication failure due to roaming

Fig. 11.
figure 11

Usage summary by protocol

4.5 Authentication Failure Due to Roaming

Figure 10 illustrates authentication failure due to roaming between February 2017 and January 2018. The highest failure event in the spring semester happened in April with the total of 87K messages. In the fall semester, the peak month was September total failure message of 68.7K, showing a decrease of 18K compared to the spring semester. The upgraded feature enables fast and smooth roaming transition between 802.11 (ac), decreasing the authentication failure caused by roaming clients.

4.6 Heterogeneous Protocols

Figure 11 illustrates the percentage of all the protocols used in the campus network over a 31 days period grouped by sessions, clients, users, session time and traffic. Although, the top three protocols were 802.11 (n) 2.4 GHz, 802.11 (ac) and 802.11 (n) 5 GHz in respective order. Protocol 802.11 (ac) shows the highest Session to Traffic ratio and the most Session Time with the least clients. Protocols 802.11 (a/b/g) are the least used protocol in the campus network. However, the campus network has to support these heterogeneous protocols to provide the environment for all devices needing Wi-Fi access.

5 Conclusions and Future Work

We have conducted extensive analysis of heterogeneity issues encountered during an incremental campus Wi-Fi protocol deployment. We have explored various design considerations for heterogeneous compatibility, data rate, coverage, and performance. Furthermore, we discussed the issues around coverage gap, load balance, and roaming. This study of a campus incremental Wi-Fi deployment provides insights on the behaviors of Wi-Fi access network availability, and potential end-to-end expectations for high-speed and bandwidth-intensive clients. After the deployment, the most traffic is generated by 802.11 (ac) protocol. However, heterogeneous protocols such as 802.11 (a/b/g/n) still need to coexist until all devices are 802.11 (ac) compatible.

In the future, we plan to explore fast transition, performance enhancement, power saving, and time improvement benefits gained from upgrading to Wi-Fi 802.11 (ac) protocol.