Reducing Complexity of Data Flow Testing in the Verification of a IEC-62304 Flexible Workflow System
In the development of SW applications, the workflow abstraction gives primary relevance to the way how some process can be accomplished through a sequence of connected steps. This largely conditions analysis, implementation architecture, and verification. In particular, testing activities are naturally oriented towards a data flow approach, which effectively exercises dependencies among steps. In several application scenarios, the workflow model cannot completely determine the sequencing of actions and it must rather leave space to variability. While easily encompassed both in the analysis and implementation stages, this comprises a major hurdle for the testing stage due to the explosion in the number of allowed execution orders and paths.
We address the problem reporting on the verification of the control software of a Computer Assisted Surgery system. In this case, the workflow abstraction captures the constraints of a medical protocol, and variability in the order of steps reflects dynamic adaptation of the course of actions to the specific characteristics of each patient. This largely increases the testing effort needed to accomplish the prescriptions of the IEC-62304 certification standard. To cope with the problem, we show how data flow analysis can be used to identify an appropriate set of constraints that can be exploited in the verification stage, so as to reduce the test suite while preserving coverage.
KeywordsWorkflow architecture Workflow verification Data Flow testing
Unable to display preview. Download preview PDF.
- 1.International Electrotechnical Commission: Medical device software - Software life-cycle processes, IEC62304:2006 (2006)Google Scholar
- 3.Fowler, M., Scott, K.: UML distilled (3rd ed.): a brief guide to the standard object modeling language, 3rd edn. Addison-Wesley Professional, Reading (September 25, 2003) ISBN:978-0321193681Google Scholar
- 6.Mei, L., Chan, W.K., Tse, T.H.: Data flow testing of service oriented workflow applications. In: ICSE 2008 Proceedings of the 30th International Conference on Software Engineering (2008)Google Scholar
- 7.Mei, L., Chan, W.K., Tse, T.H.: An empirical study of the use of Frankl-Weyuker data flow testing criteria to test BPEL Web services. In: 33rd Annual IEEE International Computer Software and Applications Conference (2009)Google Scholar
- 9.Rapps, S., Weyuker, E.J.: Selecting test data using data flow information. IEEE Transactions on Software Engineering SE-11(4) (April 1985)Google Scholar
- 10.Frankl, P.G., Weiss, S.N.: An experimental comparison of the effectiveness of branch testing and data flow testing. IEEE Transactions on Software Engineering 19(8) (August 1993)Google Scholar
- 12.Sadiq, S.W., Orlowska, M.E., Lin, J., Sadiq, W.: Quality of Service in flexible workflows through process constraints. In: Enterprise Information Systems, vol. VII, part 3, pp. 187–195 (2006)Google Scholar
- 13.Schep, N.W.L., Broeders, I.A.M.J., van der Werken, C.: Computer assisted orthopaedic and trauma surgery: State of the art and future perspectives. Original Research Article Injury 34(4), 299–306 (2003)Google Scholar
- 14.Saragaglia, D., Picard, F., Chaussard, C., Montbarbon, E., Leitner, F., Cinquin, P.: Computer-assisted knee arthroplasty: comparison with a conventional procedure. Results of 50 cases in a prospective randomized study. Rev Chir Orthop Reparatrice Appar Mot. 87(1), 18–28 (2001)Google Scholar
- 15.Bathis, H., Perlick, L., Tingart, M., Luring, C., Zurakowski, D., Grifka, J.: Alignment in total knee arthroplasty, A Comparison of Computer-Assisted Surgery with the Conventional Technique. Journal of Bone and Joint Surgery - British 86-B(5), 682–687Google Scholar
- 16.Sadiq, S.W., Orlowska, M.E., Sadiq, W., Foulger, C.: Data Flow and Validation in Workflow Modelling. In: ADC 2004, Proceedings of the 15th Australasian Database Conference, vol. 27 (2004)Google Scholar
- 17.Binkley, D., Gallagher, K.B.: Program Slicing, Advances in Computers, vol. 43, pp. 1–50. Academic Press, London (1996)Google Scholar
- 19.Baudry, B., Le Sunyé, Y., Jézéquel, J.-M.: Towards a ’Safe’ Use of Design Patterns to Improve OO Software Testability. In: Proceeding ISSRE 2001 Proceedings of the 12th International Symposium on Software Reliability Engineering. IEEE Computer Society, Washington, DC, USA (2001), table of contents ISBN:0-7695-1306-9Google Scholar
- 20.Baudry, B., Le Traon, Y., Sunyé, G.: Testability Analysis of a UML Class Diagram Software Metrics. In: IEEE International Symposium on Eighth IEEE International Symposium on Software Metrics (METRICS 2002), p. 54 (2002)Google Scholar