Abstract
This paper introduces host load trace playback, a new tech- nique for generating a background workload from a trace of the Unix load average that results in realistic and repeatable CPU contention behavior. Such workloads are invaluable for evaluating various forms of distributed middleware, including resource prediction systems and application-level schedulers. We describe the technique and then evaluate a tool, playload, that implements it. Playload faithfully reproduces workloads from traces on the four platforms on which we have evaluated it. Both playload and a large set of host load traces are publicly available from the web at the following URL: http://www.cs.cmu.edu/~pdinda/LoadTraces
This research was sponsored by the Defense Advanced Research Projects Agency (DARPA) and the Air Force Research Laboratory (AFRL), the Office of Naval Research (ONR) and the Space and Naval Warfare Systems Center (SPAWARSYSCEN), the Air Force Materiel Command (AFMC), the National Sci- ence Foundation, and through an Intel Corporation Fellowship.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arabe, J., Beguelin, A., Lowekamp, B., E. Seligman, M.S., and Stephan, P. Dome: Parallel programming in a heterogeneous multi-user environment. Tech. Rep. CMU-CS-95-137, Carnegie Mellon University, School of Computer Science, April 1995.
Arndt, O., Freisleben, B., Kielmann, T., and Thilo, F. Dynamic load distri-bution with the winner system. In Proceedings of Workshop Anwendungsbezogene Lastverteilung (ALV’98) (March 1998), pp. 77–88. Also available as Technische Universitt Mnchen Technical Report TUM-I9806.
Berman, F., and Wolski, R. Scheduling from the perspective of the application. In Proceedings of the Fifth IEEE Symposium on High Performance Distributed Computing HPDC96 (August 1996), pp. 100–111.
Dinda, P., Lowekamp, B., Kallivokas, L., and O’Hallaron, D. The case for prediction-based best-effort real-time systems. In Proc. of the 7th Interna-tional Workshop on Parallel and Distributed Real-Time Systems (WPDRTS 1999), vol. 1586 of Lecture Notes in Computer Science. Springer-Verlag, San Juan, PR, 1999, pp. 309–318. Extended version as CMU Technical Report CMU-CS-TR-98-174.
Dinda, P. A. The statistical properties of host load. Scientific Programming 7, 3,4 (1999). A version of this paper is also available as CMU Technical Report CMU-CS-TR-98-175. A much earlier version appears in LCR ’98 and as CMU-CS-TR-98-143.
Dinda, P. A. Resource Signal Prediction and Its Application to Real-time Schedul-ing Advisors. PhD thesis, School of Computer Science, Carnegie Mellon University, May 2000. Available as Carnegie Mellon University Computer Science Department Technical Report CMU-CS-00-131.
Dinda, P. A., and O’Hallaron, D. R. An evaluation of linear models for host load prediction. In Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing (HPDC ’99) (August 1999), pp. 87–96. Extended version available as CMU Technical Report CMU-CS-TR-98-148.
Harchol-Balter, M., and Downey, A. B. Exploiting process lifetime distri-butions for dynamic load balancing. In Proceedings of ACM SIGMETRICS ’96 (May 1996), pp. 13–24.
Mehra, P., and Wah, B. Synthetic workload generation for load-balancing ex-periments. IEEE Parallel and Distributed Technology 3, 2 (Summer 1995), 4–19.
Noble, B. D., Satyanarayanan, M., Nguyen, G. T., and Katz, R. H. Trace-based mobile network emulation. In Proceedings of the ACM SIGCOMM Confer-ence (Cannes, France, September 1997).
Ryu, K. D., and Hollingsworth, J. K. Fine-grain cycle stealing for networks of workstations. In Proceedings of ACM/IEEE SC98 (Supercomputing ’98) (Novem-ber 1998), pp. 801–821.
Siegell, B., and Steenkiste, P. Automatic generation of parallel programs with dynamic load balancing. In Proceedings of the Third International Symposium on High-Performance Distributed Computing (August 1994), pp. 166–175.
Willinger, W., Taqqu, M. S., Leland, W. E., and Wilson, D. V. Self-similarity in high-speed packet traffic: Analysis and modeling of ethernet traffic measurements. Statistical Science 10, 1 (January1995), 67–85.
Wolski, R., Spring, N., and Hayes, J. Predicting the CPU availability of time-shared unix systems. In Proceedings of the Eighth IEEE Symposium on High Performance Distributed Computing HPDC99 (August 1999), IEEE, pp. 105–112. Earlier version available as UCSD Technical Report Number CS98-602.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dinda, P.A., O’Hallaron, D.R. (2000). Realistic CPU Workloads through Host Load Trace Playback. In: Dwarkadas, S. (eds) Languages, Compilers, and Run-Time Systems for Scalable Computers. LCR 2000. Lecture Notes in Computer Science, vol 1915. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-40889-4_19
Download citation
DOI: https://doi.org/10.1007/3-540-40889-4_19
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41185-7
Online ISBN: 978-3-540-40889-5
eBook Packages: Springer Book Archive