A Framework for Interoperability Testing in Pan-European Public Service Provision

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8074)


A major challenge of interoperability projects and initiatives is to validate that different implementations work together and are compliant with underlying standard specifications. Interoperability testing can ensure that required end-to-end functionality is adequately fulfilled and all systems are implemented in conformity with existing standards. Adopters of standards have different methods to prove fulfillment of interoperability requirements. This often results in different efficiency, different quality and a lack of conformity. In this paper, we present the interoperability testing framework used in PEPPOL (Pan-European Public Procurement Online). The framework has supported the project well in establishing various production pilots that interoperate together in the field of e-procurement. It thereby aggregates different testing perspectives ranging from conformance testing to compliance testing and provides guidelines how to prove implementations through testing scenarios. Consequently, the key research question in this paper is how interoperability initiatives can prove that different implementations are compliant with underlying standard specifications and how interoperability can be ensured among different implementations beyond the technical approval mechanisms provided through conformance testing.


Pan-European Public Service Provision Interoperability Testing Conformance Testing Compliance Testing Public E-Procurement 


  1. 1.
    CEN Workshop Agreement (CWA 16408): Testing Framework for Global eBusiness Interoperability Test Beds (GITB). European Committee for Standardization, Brussels (2012)Google Scholar
  2. 2.
    Dahn, I., Zimmermann, S.: Application Profiles and Tailor-Made Conformance Test Systems. International Journal of IT Standards and Standardization Research (IJITSR) 8(2), 60–73 (2010)CrossRefGoogle Scholar
  3. 3.
    European Commission: European Interoperability Framework (EIF) for European public services - Annex II - Towards interoperability for European public services, Brussels (2010)Google Scholar
  4. 4.
    Gebase, L., Snelick, R., Skall, M.: Conformance Testing and Interoperability: A Case Study in Healthcare Data Exchange. In: Arabnia, H.R., Reza, H. (eds.) Proceedings of the 2008 International Conference on Software Engineering Research & Practice, SERP 2008, Las Vegas Nevada, USA, 2 vols., pp. 143–151. CSREA Press (2008)Google Scholar
  5. 5.
    Gottschalk, P., Solli-Sæther, H.: E-Government Interoperability and Information Resource Integration: Frameworks for Aligned Development. Information Science Reference, Hershey (2009)CrossRefGoogle Scholar
  6. 6.
    Kosanke, K.: ISO Standards for Interoperability: A Comparison. In: Konstantas, D., Bourrières, J.-P., Léonard, M., Boudjlida, N. (eds.) Interoperability of Enterprise Software and Applications, pp. 55–64. Springer, London (2006)CrossRefGoogle Scholar
  7. 7.
    Kubicek, H., Cimander, R.: Three dimensions of organizational interoperability. Insights from recent studies for improving interoperability frameworks. European Journal of ePractice (6), 13–14 (2009)Google Scholar
  8. 8.
    Mertins, K., Ruggaber, R., Popplewell, K., Xu, X.: Enterprise Interoperability III. Springer (2008)Google Scholar
  9. 9.
    Mondorf, A., Wimmer, M.A.: The European VCD System: Facilitating Public Procurement through Criteria-to-Evidence Mapping. In: Berleur, J., Hercheui, M.D., Hilty, L.M. (eds.) HCC9 2010. IFIP AICT, vol. 328, pp. 73–85. Springer, Heidelberg (2010)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2013

Authors and Affiliations

  1. 1.Institute for Information Systems ResearchUniversity of Koblenz-LandauKoblenzGermany

Personalised recommendations