Abstract
Large-scale information gathering becomes more and more common with the increasing popularity of smartphones, GPS, social networks, and sensor networks. Services based on this real-time data are the logical next step. Service Oriented Stream Systems (SOSS) have a focus on one-time ad hoc queries as opposed to continuous queries. High availability is crucial in these services. However, data replication has inherent costs, which are particularly burdensome for high rate, often overloaded, SOSS. To provide high availability and to cope with the problem of overloading the system, we propose a mechanism called soft quorums. Soft quorums provide high availability of data, a tradeoff between query result accuracy and performance, and adaptation to dynamic data/query stream rates. Finally, we conduct a comprehensive experimental study using real-world and synthetic datasets.
Tingjian Ge was supported in part by the NSF, under the grants IIS-1149417, IIS-1319600, and IIS-1633271.
Jie Wang was supported in part by the NSF under grant CNS-1331632 and by Eola Solutions Inc. under a research grant.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
https://drive.google.com/file/d/0B9Umiq2eYGoVdWZRMjBKMEpWSDQ/view?usp=sharing
Aiyer, A., Alvisi, L., Bazzi, R.A.: On the availability of non-strict quorum systems. In: Fraigniaud, P. (ed.) DISC 2005. LNCS, vol. 3724, pp. 48–62. Springer, Heidelberg (2005). doi:10.1007/11561927_6
Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J.: Models and issues in data stream systems. In: PODS (2002)
Bailis, P., Venkataraman, S., Frnaklin, J.M., Joseph, H.M., Stoica, I.: Probabilistically bounded staleness for practical partial quorums. In: VLDB (2012)
Balazinska, M., Hwang, J.H., Shah, A.M.: Fault-tolerance and high availability in data stream management systems. In: Liu, L., Özsu, M.T. (eds.) Encyclopedia of Database Systems, pp. 1109–1115. Springer, Heidelberg (2009)
Basho, R.: http://basho.com/products/riak-overview/ (2012)
Decandia, G. et al.: Dynamo: Amazon’s highly available key-value store. In: SOSP (2007)
Feinberg, A.: Project voldemort: reliable distributed storage. In: ICDE (2011)
Golab, L., Ozsu, M.T.: Issues in data stream management. In: SIGMOD (2003)
Harris, J.W., Stocker, H.: Maximum likelihood method. In: Handbook of Mathematics and Computational Science. Springer, New York (1998)
Hwang, J.-H., Xing, Y., Cetintemel, U., Zdonik, S.: A cooperative, self-configuring high-availability solution for stream processing. In: ICDE (2007)
Lakshman, A., Malik, P.: Cassandra - a decentralized structured storage system. In: LADIS (2008)
Malkhi, D., Reiter, M.K., Wool, A., Wright, R.N.: Probabilistic quorum systems. Inf. Commun. 170(2), 184–206 (2001)
Naor, M., Wool, A.: The load, capacity, and availability of quorum systems. SIAM J. Comput. 27(2), 423–447 (1998)
Tan, P.-N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson, Upper Saddle River (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Song, C., Ge, T., Chen, C., Wang, J. (2017). Soft Quorums: A High Availability Solution for Service Oriented Stream Systems. In: Candan, S., Chen, L., Pedersen, T., Chang, L., Hua, W. (eds) Database Systems for Advanced Applications. DASFAA 2017. Lecture Notes in Computer Science(), vol 10178. Springer, Cham. https://doi.org/10.1007/978-3-319-55699-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-55699-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-55698-7
Online ISBN: 978-3-319-55699-4
eBook Packages: Computer ScienceComputer Science (R0)