A Case Study on State-Based Robustness Testing of an Operating System for the Avionic Domain

  • Domenico Cotroneo
  • Domenico Di Leo
  • Roberto Natella
  • Roberto Pietrantuono
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6894)


This paper investigates the impact of state on robustness testing, by enhancing the traditional approach with the inclusion of the OS state in test cases definition. We evaluate the relevance of OS state and the effects of the proposed strategy through an experimental campaign on the file system of a Linux-based OS, to be adopted by Finmeccanica for safety-critical systems in the avionic domain. Results show that the OS state plays an important role in testing those corner cases not covered by traditional robustness testing.


Robustness Testing Operating Systems Safety-Critical Systems DO-178B FIN.X-RTOS 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Koopman, P., DeVale, J.: The exception handling effectiveness of POSIX operating systems. IEEE Trans. on Software Engineering 26(9) (2002)Google Scholar
  2. 2.
    Koopman, P., Sung, J., Dingman, C., Siewiorek, D., Marz, T.: Comparing operating systems using robustness benchmarks. In: SRDS (1997)Google Scholar
  3. 3.
    Sullivan, M., Chillarege, R.: Software Defects and their Impact on System Availability-A Study of Field Failures in Operating Systems. In: FTCS (1991)Google Scholar
  4. 4.
    RTCA Inc., Software considerations in airborne systems and equipment certification, RTCA DO-178B, EUROCAEED-12B (1992)Google Scholar
  5. 5.
    IEEE Standard for Information Technology-Portable Operating System Interface (POSIX). IEEE Std 1003.1b-1993, IEEE CS (1994)Google Scholar
  6. 6.
    Kanoun, K., Crouzet, Y., Kalakech, A., Rugina, A.-E., Rumeau, P.: Benchmarking the Dependability of Windows and Linux using PostMarkTM Workloads. In: ISSRE (2005)Google Scholar
  7. 7.
    Kalakech, A., Kanoun, K., Crouzet, Y., Arlat, J.: Benchmarking The Dependability of Windows NT4, 2000 and XP. In: DSN (2004)Google Scholar
  8. 8.
    Cotroneo, D., Natella, R., Pietrantuono, R., Russo, S.: Software Aging Analysis of the Linux Operating System. In: ISSRE (2010)Google Scholar
  9. 9.
    Chou, A., Yang, J., Chelf, B., Hallem, S., Engler, D.: An empirical study of operating systems errors. In: SOSP (2001)Google Scholar
  10. 10.
    Albinet, A., Arlat, J., Fabre, J.C.: Characterization of the Impact of Faulty Drivers on the Robustness of the Linux Kernel. In: DSN (2004)Google Scholar
  11. 11.
    Johansson, A., Suri, N., Murphy, B.: On the selection of error model(s) for OS robustness evaluation. In: DSN (2007)Google Scholar
  12. 12.
    Duraes, J., Madeira, H.: Multidimensional characterization of the impact of faulty drivers on the operating systems behavior. IEICE Trans. on Information and Systems 86(12) (2003)Google Scholar
  13. 13.
    Gu, W., Kalbarczyk, Z., Iyer, R.K., Yang, Z.: Characterization of Linux kernel behavior under errors. In: DSN (2003)Google Scholar
  14. 14.
    Skarin, D., Barbosa, R., Karlsson, J.: GOOFI-2: A tool for experimental dependability assessment. In: DSN (2010)Google Scholar
  15. 15.
    Bairavasundaram, L.N., Rungta, M., Agrawa, N., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H., Swift, M.M.: Analyzing the effects of disk-pointer corruption. In: DSN (2008)Google Scholar
  16. 16.
    Dreges, R.J., Nanya, T.: Analysis of Inter-Module Error Propagation Paths in Monolithic Operating System Kernels. In: EDCC (2010)Google Scholar
  17. 17.
    Johansson, A., Suri, N., Murphy, B.: On the impact of injection triggers for OS robustness evaluation. In: ISSRE (2007)Google Scholar
  18. 18.
    Sarbu, C., Johansson, A., Suri, N., Nagappan, N.: Profiling the operational behavior of OS device drivers. Empirical Soft. Eng. 15(4) (2009)Google Scholar
  19. 19.
    Prabhakaran, V., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Model-based failure analysis of journaling file systems. In: DSN (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Domenico Cotroneo
    • 1
  • Domenico Di Leo
    • 1
  • Roberto Natella
    • 1
  • Roberto Pietrantuono
    • 1
  1. 1.Dipartimento di Informatica e SistemisticaUniversità degli Studi di Napoli Federico IINaplesItaly

Personalised recommendations