Abstract
Software for space applications requires significant testing. This paper presents an evaluation of the CoFI testing methodology as applied to actual space software, where deterministic fault cases derived from state-based models were executed using the software-implemented fault injection technique. Different models were used to represent the behavior of embedded software in a real satellite computer under the presence of both normal inputs and external faults in communication, processor, and memory. CoFI methodology was used for model construction, the Condado tool for test derivation, and the QSEE-TAS tool for test execution. In total, 8,620% of 471 fault cases detected errors in the software; this is a very large number, and more so considering that the software had already been tested by the company which developed it before being subject the CoFI methodology.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ambrosio, A.M.: CoFI: uma abordagem combinando teste de conformidade e injeção de falhas para validação de software em aplicações espaciais. INPE-13264-TDI/1031. Instituto Nacional de Pesquisas Espaciais - INPE (2005)
Ambrosio, A.M., Martins, E., Vijaykumar, N.L., Carvalho, S.V.: A Methodology for Designing Fault Injection Experiments as an Addition to Communication Systems Conformance Testing. In: Proceedings of the 1st Workshop on Dependable Software - Tools and Methods in the IEEE Conference on Dependable System and Network, Yokohama, Japan, 28 June - 1 July 2005 (2005)
Arlat, J., Aguera, M., Amat, L., Crouzet, Y., Fabre, J.-C., Laprie, J.-C., Martins, E., Powell, D.: Fault Injection for Dependability Validation: A Methodology and Some Applications. IEEE Tr on SE 16(2), 166–182 (1990)
Binder, R.: Testing Object-Oriented Systems-Models, Patterns and Tools. Addison-Wesley, Reading (2000)
Cavalli, A., Gervy, C., Prokopenko, S.: New Approaches for Passive Testing using Extended Finite State Machine Specification. In: WTCS, Canada (2001)
Chandra, R., Lefever, R.M., Cukier, M., Sanders, W.H.A: global-state triggered fault injector for distributed system evaluation. IEEE Transaction on Parallel and Distributed Systems 15(7), 593–605 (2004)
Chow, T.S.: Testing software design modeled by finite state machines. IEEE Trans on Sw Engineering (TSE) 3, 178–187 (1978)
Dssouli, H., Salek, K., Aboulhamid, E., En-Nouaary, A., Bourhfir, C.: Test Development for Comm. Protocols: Towards Automation. Computer Networks 31, 1835–1872 (1999)
Echtle, K., Chen, Y.: Evaluation of Deterministic Fault Injection for Fault-Tolerant Protocol Testing. In: IEEE 21th Annual International Symposium on Fault-Tolerant Computing, Montreal, pp. 418–425. IEEE Computer Society Press, Los Alamitos (1991)
Goddard Space Flight Center (GSFC) (accessed March 2007), available at: http://radhome.gsfc.nasa.gov/radhome/papers/seeca1.htm
Holzmann, G.J.: Design and validation of computer protocols. Prentice-Hall, Englewood Cliffs (1990)
International Organization for Standardization ISO/IEC- IS9646 International standard conformance testing methodology and framework. Geneve (1991)
Martins, E., Mattiello-Francisco, F.A: Tool for Fault Injection and Conformance Testing of Distributed Systems. LNCS, vol. 2847/2003, pp. 282–302 (2003)
Martins, E., Sabião, S.B., Ambrosio, A.M.: ConData: a Tool for Automating Specification-based Test Case Generation for Communication Systems. Software Quality Journal 8(4), 303–319 (1999)
Mattiello-Francisco, M.F., Santiago, V.A., Costa, R., Jogaib, L.: Verificação e Validação na terceirização de software embarcado em aplicaçães espaciais. In: SBQS 2006. Simpósio Brasiliero de Qualidade de Software, Villa Velha, ES, Brazil, pp. 368–375 (2006)
Santiago, V., Mattiello-Francisco, F., Costa, R., Silva, W.P., Ambrosio, A.M.: QSEE Project: An Experience in Outsourcing Software Development for Space Applications. In: SEKE 2007. The Nineteenth International Conference on Software Engineering and Knowledge Engineering, Boston, EUA (2007)
Silva, W.P., et al.: QSEE-TAS: Uma Ferramenta para Execução e Relato Automatizados de Testes de Software para Aplicaçães Espaciais. In: XX Brazilian Symposium on Software Engineering-SBES (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ambrosio, A.M., Mattiello-Francisco, F., Santiago, V.A., Silva, W.P., Martins, E. (2007). Designing Fault Injection Experiments Using State-Based Model to Test a Space Software. In: Bondavalli, A., Brasileiro, F., Rajsbaum, S. (eds) Dependable Computing. LADC 2007. Lecture Notes in Computer Science, vol 4746. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75294-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-75294-3_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75293-6
Online ISBN: 978-3-540-75294-3
eBook Packages: Computer ScienceComputer Science (R0)