Skip to main content

Accelerating Concurrent Analytic Tasks with Cost-Conscious Result Set Replacement Algorithm

  • Conference paper
  • First Online:
Security, Privacy and Anonymity in Computation, Communication and Storage (SpaCCS 2016)

Part of the book series: Lecture Notes in Computer Science ((LNSC,volume 10067))

  • 877 Accesses

Abstract

High concurrent analytic applications such as SaaS based BI services face the problem of how to meet performance SLAs (Service Level Agreement) when the number of users and concurrency increased. In order to reduce the task processing overheads and services response time, analytic applications tend heavily rely on various main-memory data management and cache techniques. In this paper, we designed a cost-conscious cache replacement approach named CRSR (Cost-conscious Result Sets Replacement), which take task result sets as the essential data unit and replace the existing result set by a specialized cost estimation strategy. We conduct a series of evaluation to compare the proposed CRSR approach with representative cache management methods, the experiments show that in most cases, the proposed CRSR algorithm can efficiently reduce the response time of high concurrency analysis service and outperform its competitors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. E. TenWolde: Worldwide Software on Demand 2007–2011 Forecast: A Preliminary Look at Delivery Model Performance, IDC No. 206240, IDC Report (2007)

    Google Scholar 

  2. What is Software as a Service (SaaS). https://www.salesforce.com/saas/

  3. Aulbach, S., Grust, T., Jacobs, D., Kemper, A., Rittinger, J.: Multi-tenant databases for software as a service: schema-mapping techniques. In: SIGMOD, pp. 1195–1206 (2008)

    Google Scholar 

  4. Tanenbaum, A.S.: Modern Operating System. Prentice-Hall, Upper Saddle River (1992)

    MATH  Google Scholar 

  5. Jiang, S., Zhang, X.: LIRS: an efficient low interreference recency set replacement policy to improve buffer cache performance. In: 2002 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, 15–19 June (2002)

    Google Scholar 

  6. MySQL. http://www.mysql.com

  7. ORACLE. http://www.oracle.com

  8. Williams, S., et al.: Removal policies in network caches for world-wide-web objects. In: Proceedings of the 1996 ACM SIGCOMM Conference. ACM Press, New York, pp. 293–305 (1996)

    Google Scholar 

  9. Bestavros, A., Jin, S.: Popularity-aware greedy dual-size web proxy caching algorithms. In: ICDCS 2000, pp. 254–261 (2000)

    Google Scholar 

  10. GREENPLUM. http://greenplum.org

  11. Redis. http://redis.io

  12. Hyokyung, B., kern, K., Noh, S.H., et al.: Efficient replacement of nonuniform objects in Web caches. Computer 35(6), 65–73 (2002)

    Google Scholar 

  13. TPC-Current Specifications. http://www.tpc.org/tpch/default.asp

  14. Megiddo, N., Modha, D.S.: ARC: a sef-tuning low overhead replacement cache. In: The 2nd USENIX Conference on File and Storage Technologies, pp. 115–130 (2003)

    Google Scholar 

  15. Pan, A., Pai, V.S.: Runtime-driven shared last-level cache management for task-parallel programs. In: The International Conference for High Performance Computing, Networking, Storage and Analysis. ACM (2015)

    Google Scholar 

  16. Xu, M., et al.: Analysis and implementation of global preemptive fixed-priority scheduling with dynamic cache allocation. In: 2016 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS). IEEE (2016)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the China Ministry of Science and Technology under the State Key Development Program for Basic Research (2012CB821800), Fund of National Natural Science Foundation of China (No. 61462012, 61562010), the Joint Research Fund in Astronomy under cooperative agreement between the National Natural Science Foundation of China and Chinese Academy of Sciences (No. U1531246), the Strategic Priority Research Program “The Emergence of Cosmological Structures” of the Chinese Academy of Sciences (No. XDB09000000), High Tech. Project Fund of Guizhou Development and Reform Commission (No. [2013]2069), Industrial Research Projects of the Science and Technology Plan of Guizhou Province (No. GY[2014]3018), the Major Applied Basic Research Program of Guizhou Province (No. JZ20142001, JZ20142001-01, JZ20142001-05).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hui Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Min, S., Li, H., Chen, M., Dai, Z., Zhu, M. (2016). Accelerating Concurrent Analytic Tasks with Cost-Conscious Result Set Replacement Algorithm. In: Wang, G., Ray, I., Alcaraz Calero, J., Thampi, S. (eds) Security, Privacy and Anonymity in Computation, Communication and Storage. SpaCCS 2016. Lecture Notes in Computer Science(), vol 10067. Springer, Cham. https://doi.org/10.1007/978-3-319-49145-5_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-49145-5_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-49144-8

  • Online ISBN: 978-3-319-49145-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics