Abstract
Developing complex data-centric applications, which manage intricate interactions between distributed and heterogeneous entities from pervasive environments, is a tedious task. In this paper we pursue the difficult objective of assessing the ”easiness” of data-centric development in pervasive environments, which turns out to be much more challenging than simply measuring execution times in performance analyses and requires highly qualified programmers. We introduce P-Bench, a benchmark that comparatively evaluates the easiness of development using three types of systems: (1) the Microsoft StreamInsight unmodified Data Stream Management System, LINQ and C#, (2) the StreamInsight++ ad hoc framework, an enriched version of StreamInsight, that meets pervasive application requirements, and (3) our SoCQ system, designed for managing data, streams and services in a unified manner. We define five tasks that we implement in the analyzed systems, based on core needs for pervasive application development. To evaluate the tasks’ implementations, we introduce a set of metrics and provide the experimental results. Our study allows differentiating between the proposed types of systems based on their strengths and weaknesses when building pervasive applications.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Abiteboul, S., Manolescu, I., Taropa, E.: A Framework for Distributed XML Data Management. In: Ioannidis, Y., Scholl, M.H., Schmidt, J.W., Matthes, F., Hatzopoulos, M., Böhm, K., Kemper, A., Grust, T., Böhm, C. (eds.) EDBT 2006. LNCS, vol. 3896, pp. 1049–1058. Springer, Heidelberg (2006)
Arasu, A., Babcock, B., Babu, S., Datar, M., Ito, K., Motwani, R., Nishizawa, I., Srivastava, U., Thomas, D., Varma, R., Widom, J.: STREAM: The Stanford Stream Data Manager. IEEE Data Eng. Bull. 26(1), 19–26 (2003)
Arasu, A., Cherniack, M., Galvez, E.F., Maier, D., Maskey, A., Ryvkina, E., Stonebraker, M., Tibbetts, R.: Linear Road: A Stream Data Management Benchmark. In: VLDB 2004, pp. 480–491 (2004)
Creus Tomàs, J., Amann, B., Travers, N., Vodislav, D.: RoSeS: A Continuous Query Processor for Large-Scale RSS Filtering and Aggregation. In: CIKM 2011, pp. 2549–2552 (2011)
Cuevas-Vicenttín, V., Vargas-Solar, G., Collet, C.: Evaluating Hybrid Queries through Service Coordination in HYPATIA (demo). In: EDBT 2012, pp. 602–605 (2012)
Fenton, N.E., Pfleeger, S.L.: Software Metrics: A Rigorous and Practical Approach. PWS Publishing Co., Boston (1998)
Gray, J.: Benchmark Handbook: For Database and Transaction Processing Systems. Morgan Kaufmann Publishers Inc., San Francisco (1992)
Gripay, Y., Laforest, F., Lesueur, F., Lumineau, N., Petit, J.-M., Scuturici, V.-M., Sebahi, S., Surdu, S.: ColisTrack: Testbed for a Pervasive Environment Management System (demo). In: EDBT 2012, pp. 574–577 (2012)
Gripay, Y., Laforest, F., Petit, J.-M.: A Simple (yet Powerful) Algebra for Pervasive Environments. In: EDBT 2010, pp. 359–370 (2010)
Kazemitabar, S.J., Demiryurek, U., Ali, M.H., Akdogan, A., Shahabi, C.: Geospatial Stream Query Processing using Microsoft SQL Server StreamInsight. PVLDB 3(2), 1537–1540 (2010)
Meijer, E.: The World According to LINQ. Commun. ACM 54(10), 45–51 (2011)
Pugh, W.: Technical Perspective: A Methodology for Evaluating Computer System Performance. Commun. ACM 51(8), 82–82 (2008)
Rys, M.: Scalable SQL. Commun. ACM 54(6), 48–53 (2011)
Scuturici, V.-M., Surdu, S., Gripay, Y., Petit, J.-M.: UbiWare: Web-Based Dynamic Data & Service Management Platform for AmI. In: Middleware 2012, pp. 11:1–11:2 (2012)
International Telecommunication Union: ITU Internet Reports. The Internet of Things. International Telecommunication Union (2005)
Weiser, M.: The Computer for the 21st Century. Scientific American 265(3), 94–104 (1991)
Xue, W., Luo, Q.: Action-Oriented Query Processing for Pervasive Computing. In: CIDR 2005, pp. 305–316 (2005)
StreamBase, http://www.streambase.com/
Microsoft StreamInsight 1.2, http://technet.microsoft.com/en-us/library/hh849326v=sql.10.aspx
Transaction Processing Performance Council, http://www.tpc.org
Wheeler, D.: Counting Source Lines of Code (SLOC), http://www.dwheeler.com/sloc/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Surdu, S., Gripay, Y., Scuturici, VM., Petit, JM. (2013). P-Bench: Benchmarking in Data-Centric Pervasive Application Development. In: Hameurlain, A., Küng, J., Wagner, R., Amann, B., Lamarre, P. (eds) Transactions on Large-Scale Data- and Knowledge-Centered Systems XI. Lecture Notes in Computer Science, vol 8290. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45269-7_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-45269-7_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-45268-0
Online ISBN: 978-3-642-45269-7
eBook Packages: Computer ScienceComputer Science (R0)