Abstract
Wireless Intrusion Detection System (WIDS) is a pivotal element in wireless network security. WIDS monitors the radio spectrum and system activities to detect intrusive events, and then alerts the complementary prevention part to combat the intrusions. Selecting a reliable WIDS system depends significantly on its performance evaluation. Many different attributes judge the WIDS performance such as effectiveness, efficiency, immunity, interoperability, etc. We introduce in this paper a novel methodology which consists of sequential tasks that cover all necessary dimensions for a credible evaluation of WIDSs performance. We also introduce a new evaluation metric E ID(intrusion detection effectiveness) for evaluating the WIDS effectiveness that is considered the basic factor in evaluating the WIDS performance. Our developed metric E ID manipulates the drawbacks of the previously proposed metrics. We follow our methodology and conduct experimental evaluation tests of two popular WIDSs (Kismet and AirSnare), to demonstrate the utility of E ID.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Axelsson, S.: The Base-Rate Fallacy and its Implications for the Difficulty of Intrusion Detection. In: Proceedings of the 6th ACM Conference on Computer and Communications Security (CCS 1999), pp. 1–7 (November 1999)
Gaffney, J.E., Ulvila, J.W.: Evaluation of intrusion detectors: A decision theory approach. In: Proceedings of the IEEE Symposium on Security and Privacy (S&P 2001), Oakland, CA, USA, pp. 50–61 (2001)
Gu, G., Fogla, P., Dagon, D., Lee, W., Skoric, B.: Measuring Intrusion Detection Capability: An Information-Theoretic Approach. In: Proceedings of ACM Symposium on Information, Computer and Communications Security (ASIACCS 2006), Taiwan (2006)
Stolfo, S., Fan, W., Lee, W., Prodromidis, A., Chan, P.: Cost-based modeling for fraud and intrusion detection: Results from the JAM project. In: Proceedings of DARPA Information Survivability Conference and Exposition (DISCEX 2000), pp. 130–144 (2000)
Puketza, N., Zhang, K., Chung, M., Mukherjee, B., Olsson, R.A.: A Methodology for Testing Intrusion Detection Systems. IEEE Transactions on Software Engineering 22(10), 719–729 (1996)
Puketza, N., Chung, M., Olsson, R.A., Mukherjee, B.: A Software Platform for Testing Intrusion Detection Systems. Journal of IEEE Software 14(5), 43–51 (1997)
Debar, H., Dacier, M., Wespi, A., Lampart, S.: An Experimentation Workbench for Intrusion Detection Systems. Research Report RZ 2998, IBM Zurich Research Laboratory, Switzerland (1998)
Lippmann, R., Fried, D., Graf, I., Haines, J., Kendall, K., McClung, D., Weber, D., Webster, S., Wyschogrod, D., Cunningham, R., Zissman, M.: Evaluating Intrusion Detection Systems: The 1998 DARPA Off-line Intrusion Detection Evaluation. In: Proceedings of the DARPA Information Survivability Conference and Exposition (DISCEX 2000), Los Alamitos, CA, USA, pp. 12–26 (2000)
Lippmann, R., Haines, J.W., Fried, D., Korba, J., Das, K.: Analysis and Results of the 1999 DARPA Off-Line Intrusion Detection Evaluation. In: Debar, H., Mé, L., Wu, S.F. (eds.) RAID 2000. LNCS, vol. 1907, pp. 162–182. Springer, Heidelberg (2000)
McHugh, J.: Testing Intrusion Detection Systems: A Critique of the 1998 and 1999 DARPA Intrusion Detection System Evaluations as Performed by Lincoln Laboratory. ACM Transactions on Information and System Security 3(4), 262–294 (2000)
Cardenas, A.A., Baras, J.S., Seamon, K.: A Framework for the Evaluation of Intrusion Detection Systems. In: Proceedings of IEEE Symposium on Security and Privacy (S&P 2006), pp. 63–77 (2006)
Wilkerson, J., Skeen, M., Patrick, D., Hodges, R., Schimizzi, R., Vora, S., Zhiping, F., Gard, K., Steer, M.: Acoustic-RF anechoic chamber construction and evaluation. In: Proceedings of IEEE Radio and Wireless Symposium, pp. 331–334 (2008)
Di-Pietro, R., Mancini, L.V.: Intrusion Detection Systems. Advances in Information Security Series, vol. 38. Springer, Heidelberg (2008)
Brutch, P., Ko, C.: Challenges in Intrusion Detection for Wireless Ad-Hoc Networks. In: Proceedings of the 2003 Symposium on Applications and the Internet Workshops, Orlando, Florida, USA, pp. 368–373 (2003)
Singh, J., Kaur, L., Gupta, S.: Analysis of Intrusion Detection Tools for Wireless Local Area Networks. International Journal of Computer Science and Network Security (IJCSNS) 9, 168–177 (2009)
Debar, H., Dacier, M., Wespi, A.: Towards a Taxonomy of Intrusion Detection Systems. International Journal of Computer and Telecommunications Networking 31, 805–822 (1999)
Sobh, T.: Wired and Wireless Intrusion Detection System: Classifications, Good Characteristics and State-of-The-Art. Computer Standards and Interfaces 28, 670–694 (2006)
Nasr, K., Abou El Kalam, A., Fraboul, C.: A Holistic Methodology for Evaluating Wireless Intrusion Detection Systems. In: Proceedings of International Conference on Network and System Security (NSS 2011), Milan, Italy, pp. 9–16 (September 2011)
Airodump-ng, http://www.aircrack-ng.org/doku.php?id=airodump-ng
Aireplay-ng, http://www.aircrack-ng.org/doku.php?id=aireplay-ng
Rude/Grude, http://rude.sourceforge.net/
Metasploit, http://www.metasploit.com/
Nasr, K., Abou El Kalam, A., Fraboul, C.: An IDS Evaluation-Centric Taxonomy of Wireless Security Attacks. In: Wyld, D.C., Wozniak, M., Chaki, N., Meghanathan, N., Nagamalai, D. (eds.) CNSA 2011. CCIS, vol. 196, pp. 402–413. Springer, Heidelberg (2011)
Jain, R.: The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation and Modeling, 1st edn. John Wiley & Sons (1991)
Kismet, http://www.kismetwireless.net/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nasr, K., Kalam, A.AE., Fraboul, C. (2012). Performance Analysis of Wireless Intrusion Detection Systems. In: Xiang, Y., Pathan, M., Tao, X., Wang, H. (eds) Internet and Distributed Computing Systems. IDCS 2012. Lecture Notes in Computer Science, vol 7646. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34883-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-34883-9_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34882-2
Online ISBN: 978-3-642-34883-9
eBook Packages: Computer ScienceComputer Science (R0)