Abstract
Pattern matching on large graphs is the foundation for a variety of application domains. Strict latency requirements and continuously increasing graph sizes demand the usage of highly parallel in-memory graph processing engines that need to consider non-uniform memory access (NUMA) and concurrency issues to scale up on modern multiprocessor systems. To tackle these aspects, graph partitioning becomes increasingly important. Hence, we present a technique to process graph pattern matching on NUMA systems in this paper. As a scalable pattern matching processing infrastructure, we leverage a data-oriented architecture that preserves data locality and minimizes concurrency-related bottlenecks on NUMA systems. We show in detail, how graph pattern matching can be asynchronously processed on a multiprocessor system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bagan, G., et al.: Generating flexible workloads for graph databases. PVLDB 9, 1457–1460 (2016)
Decker, S., et al.: The semantic web: the roles of xml and rdf. IEEE 4, 63–73 (2000)
Fard, A., et al.: A distributed vertex-centric approach for pattern matching in massive graphs. In: 2013 IEEE International Conference on Big Data (Oct 2013)
Gonzalez, J.E., et al.: Powergraph: Distributed graph-parallel computation on natural graphs. In: OSDI (2012)
Karypis, G., et al.: A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20(1), 359–392 (1998)
Kissinger, T., et al.: ERIS: A numa-aware in-memory storage engine for analytical workload. In: ADMS (2014)
Krause, A., et al.: Asynchronous graph pattern matching on multiprocessor systems (2017). https://arxiv.org/abs/1706.03968
Krause, A., et al.: Partitioning Strategy Selection for In-Memory Graph Pattern Matching on Multiprocessor Systems (2017). http://wwwdb.inf.tu-dresden.de/europar2017/. Accepted at Euro-Par 2017
McCune, R.R., et al.: Thinking like a vertex: A survey of vertex-centric frameworks for large-scale distributed graph processing. ACM Comput. Surv. 48(2), 25:1–25:39 (2015)
Nguyen, D., et al.: A lightweight infrastructure for graph analytics. In: SIGOPS (2013)
Ogata, H., et al.: A heuristic graph comparison algorithm and its application to detect functionally related enzyme clusters. Nucleic Acids Res. 28, 4021–4028 (2000)
Otte, E., et al.: Social network analysis: a powerful strategy, also for the information sciences. J. Inf. Sci. 28, 441–453 (2002)
Pandis, I., et al.: Data-oriented transaction execution. PVLDB 2, 928–939 (2010)
Pandit, S., et al.: Netprobe: A fast and scalable system for fraud detection in online auction networks. In: WWW (2007)
Seo, J., et al.: Distributed socialite: A datalog-based language for large-scale graph analysis. PVLDB 6, 1906–1917 (2013)
Shun, J., et al.: Ligra: a lightweight graph processing framework for shared memory. IN: SIGPLAN (2013)
Tas, M.K., et al.: Greed is good: Optimistic algorithms for bipartite-graph partial coloring on multicore architectures. CoRR (2017)
Tran, T., et al.: Top-k exploration of query candidates for efficient keyword search on graph-shaped (RDF) data. In: ICDE (2009)
Valiant, L.G.: A bridging model for parallel computation. Commun. ACM 33, 103–111 (1990)
Wood, P.T.: Query languages for graph databases. SIGMOD 41, 50–60 (2012)
Yasui, Y., et al.: Numa-aware scalable graph traversal on SGI UV systems. IN: HPGP (2016)
Acknowledgments
This work is partly funded within the DFG-CRC 912 (HAEC).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Krause, A., Ungethüm, A., Kissinger, T., Habich, D., Lehner, W. (2017). Asynchronous Graph Pattern Matching on Multiprocessor Systems. In: Kirikova, M., et al. New Trends in Databases and Information Systems. ADBIS 2017. Communications in Computer and Information Science, vol 767. Springer, Cham. https://doi.org/10.1007/978-3-319-67162-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-67162-8_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67161-1
Online ISBN: 978-3-319-67162-8
eBook Packages: Computer ScienceComputer Science (R0)