BeSEPPI: Semantic-Based Benchmarking of Property Path Implementations

  • Adrian SkubellaEmail author
  • Daniel Janke
  • Steffen Staab
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11503)


In 2013 property paths were introduced with the release of SPARQL 1.1. These property paths allow for describing complex queries in a more concise and comprehensive way. The W3C introduced a formal specification of the semantics of property paths, to which implementations should adhere. Most commonly used RDF stores claim to support property paths. In order to give insight into how well current implementations of property paths work we have developed BeSEPPI, a benchmark for the semantic-based evaluation of property path implementations. BeSEPPI checks whether RDF stores follow the W3Cs semantics by testing the correctness and completeness of query result sets. The results of our benchmark show that only one out of 5 benchmarked RDF stores returns complete and correct result sets for all benchmark queries.


  1. 1.
    Arenas, M., Pérez, J.: Federation and navigation in SPARQL 1.1. In: Eiter, T., Krennwallner, T. (eds.) Reasoning Web 2012. LNCS, vol. 7487, pp. 78–111. Springer, Heidelberg (2012). Scholar
  2. 2.
    Bizer, C., Schultz, A.: The Berlin SPARQL benchmark. Int. J. Semant. Web Inf. Syst. 5, 1–24 (2009)Google Scholar
  3. 3.
  4. 4.
  5. 5.
  6. 6.
    DuCharme, B.: Learning SPARQL. O’Reilly Media Inc., Sebastopol (2011). Chap. 2, pp 19–44; Chap. 3. pp 45–100Google Scholar
  7. 7.
    Gubichev, A., Bedathur, S., Seufert, S.: Sparqling kleene: fast property paths in RDF-3X, June 2013Google Scholar
  8. 8.
    Guo, Y., Pan, Z., Heflin, J.: LUBM: A benchmark for OWL knowledge base systems. Web Semant. 3(2–3), 158–182 (2005). Scholar
  9. 9.
    Harris, S., Seaborne, A.: SPARQL 1.1 query language.
  10. 10.
    Hoffart, J., Suchanek, F.M., Berberich, K., Weikum, G.: YAGO2: a spatially and temporally enhanced knowledge base from Wikipedia. Artif. Intell. 194, 28–61 (2013). artificial Intelligence, Wikipedia and Semi-Structured ResourcesMathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Janke, D., Skubella, A., Staab, S.: Evaluating SPARQL 1.1 property path support. In: BLINK/NLIWoD3@ISWC (2017)Google Scholar
  12. 12.
    Kostylev, E.V., Reutter, J.L., Romero, M., Vrgoč, D.: SPARQL with property paths. In: Arenas, M., Corcho, O., Simperl, E., Strohmaier, M., d’Aquin, M., Srinivas, K., Groth, P., Dumontier, M., Heflin, J., Thirunarayan, K., Staab, S. (eds.) ISWC 2015. LNCS, vol. 9366, pp. 3–18. Springer, Cham (2015). Scholar
  13. 13.
    Malyshev, S., Krötzsch, M., González, L., Gonsior, J., Bielefeldt, A.: Getting the most out of Wikidata: semantic technology usage in Wikipedia’s knowledge graph. In: Vrandečić, D., Bontcheva, K., Suárez-Figueroa, M.C., Presutti, V., Celino, I., Sabou, M., Kaffee, L.-A., Simperl, E. (eds.) ISWC 2018. LNCS, vol. 11137, pp. 376–394. Springer, Cham (2018). Scholar
  14. 14.
    Morsey, M., Lehmann, J., Auer, S., Ngonga Ngomo, A.-C.: DBpedia SPARQL benchmark – performance assessment with real queries on real data. In: Aroyo, L., Welty, C., Alani, H., Taylor, J., Bernstein, A., Kagal, L., Noy, N., Blomqvist, E. (eds.) ISWC 2011. LNCS, vol. 7031, pp. 454–469. Springer, Heidelberg (2011). Scholar
  15. 15.
    Prud’hommeaux, E., Seaborne, A.: SPARQL query language for RDF W3C recommendation (2008).
  16. 16.
    Cyganiak, R., Wood, D.,Lanthaler, M.: RDf 1.1 concepts and abstract syntax. Technical report, W3C Recommendation (2014)Google Scholar
  17. 17.
    Skubella, A., Janke, D., Staab, S.: BeSEPPI: semantic-based benchmarking of property path implementations technical report. Technical report, Institute for Web Science and Technologies (2019)Google Scholar
  18. 18.
    Thost, V., Dolby, J.: QED: out-of-the-box datasets for SPARQL query evaluation. In: Proceedings of the ISWC 2018 Posters & Demonstrations, Industry and Blue Sky Ideas Tracks co-located with 17th International Semantic Web Conference (ISWC 2018), Monterey, USA, 8th–12th October 2018. (2018).
  19. 19.
    Zhang, Y., Duc, P.M., Corcho, O., Calbimonte, J.-P.: SRBench: a streaming RDF/SPARQL benchmark. In: Cudré-Mauroux, P., Heflin, J., Sirin, E., Tudorache, T., Euzenat, J., Hauswirth, M., Parreira, J.X., Hendler, J., Schreiber, G., Bernstein, A., Blomqvist, E. (eds.) ISWC 2012. LNCS, vol. 7649, pp. 641–657. Springer, Heidelberg (2012). Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  1. 1.Institute for Web Science and TechnologiesUniversität Koblenz-LandauKoblenzGermany
  2. 2.Web and Internet Science GroupUniversity of SouthamptonSouthamptonUK

Personalised recommendations