A Framework for Interoperability Testing in Pan-European Public Service Provision
A major challenge of interoperability projects and initiatives is to validate that different implementations work together and are compliant with underlying standard specifications. Interoperability testing can ensure that required end-to-end functionality is adequately fulfilled and all systems are implemented in conformity with existing standards. Adopters of standards have different methods to prove fulfillment of interoperability requirements. This often results in different efficiency, different quality and a lack of conformity. In this paper, we present the interoperability testing framework used in PEPPOL (Pan-European Public Procurement Online). The framework has supported the project well in establishing various production pilots that interoperate together in the field of e-procurement. It thereby aggregates different testing perspectives ranging from conformance testing to compliance testing and provides guidelines how to prove implementations through testing scenarios. Consequently, the key research question in this paper is how interoperability initiatives can prove that different implementations are compliant with underlying standard specifications and how interoperability can be ensured among different implementations beyond the technical approval mechanisms provided through conformance testing.
KeywordsPan-European Public Service Provision Interoperability Testing Conformance Testing Compliance Testing Public E-Procurement
- 1.CEN Workshop Agreement (CWA 16408): Testing Framework for Global eBusiness Interoperability Test Beds (GITB). European Committee for Standardization, Brussels (2012)Google Scholar
- 3.European Commission: European Interoperability Framework (EIF) for European public services - Annex II - Towards interoperability for European public services, Brussels (2010)Google Scholar
- 4.Gebase, L., Snelick, R., Skall, M.: Conformance Testing and Interoperability: A Case Study in Healthcare Data Exchange. In: Arabnia, H.R., Reza, H. (eds.) Proceedings of the 2008 International Conference on Software Engineering Research & Practice, SERP 2008, Las Vegas Nevada, USA, 2 vols., pp. 143–151. CSREA Press (2008)Google Scholar
- 7.Kubicek, H., Cimander, R.: Three dimensions of organizational interoperability. Insights from recent studies for improving interoperability frameworks. European Journal of ePractice (6), 13–14 (2009)Google Scholar
- 8.Mertins, K., Ruggaber, R., Popplewell, K., Xu, X.: Enterprise Interoperability III. Springer (2008)Google Scholar