Generic Online Optimization of Multiple Configuration Parameters with Application to a Database Server

  • Yixin Diao
  • Frank Eskesen
  • Steven Froehlich
  • Joseph L. Hellerstein
  • Lisa F. Spainhower
  • Maheswaran Surendra
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2867)


Optimizing configuration parameters is time-consuming and skills-intensive. This paper proposes a generic approach to automating this task. By generic, we mean that the approach is relatively independent of the target system for which the optimization is done. Our approach uses online adjustment of configuration parameters to discover the system’s performance characteristics. Doing so creates two challenges: (1) handling interdependencies between configuration parameters and (2) minimizing the deleterious effects on production workload while the optimization is underway. Our approach addresses (1) by including in the architecture a rule-based component that handles interdependencies between configuration parameters. For (2), we use a feedback mechanism for online optimization that searches the parameter space in a way that generally avoids poor performance at intermediate steps. Our studies of a DB2 Universal Database Server under an e-commerce workload indicate that our approach can be effective in practice.


Pool Size Target System Direct Search Method Online Optimization Common Information Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    IBM: Autonomic computing: IBM’s perspective on the state of information technology (2001), available at
  2. 2.
    Franklin, G.F., Powell, J.D., Emani-Naeini, A.: Feedback Control of Dynamic Systems, 3rd edn. Addison-Wesley, Reading (1994)Google Scholar
  3. 3.
    Hollot, C.V., Misra, V., Towsley, D., Gong, W.B.: On designing improved controllers for AQM routers supporting TCP flows. In: INFOCOM (2001)Google Scholar
  4. 4.
    Lu, C., Stankovic, J.A., Abdelzaher, T.F., Tao, G., Son, S., Marley, M.: Performance specifications and metrics for adaptive real time systems. In: Proceedings 21st IEEE Real Time Systems Symposium, November 2000, pp. 13–24 (2000)Google Scholar
  5. 5.
    Menasce, D., Barbara, D., Dodge, R.: Preserving QoS of e-commerce sites through self-tuning: A performance model approach. In: Proceedings of 2001 ACM Conference on E-commerce (2001)Google Scholar
  6. 6.
    Liu, Z., Squillante, M.S., Wolf, J.L.: On maximizing service-level-agreement profits. In: Proceedings of the ACM Conference on Electronic Commerce (2001)Google Scholar
  7. 7.
    Diao, Y., Hellerstein, J.L., Parekh, S.: Optimizing quality of service using fuzzy control. In: Proceedings of Distributed Systems Operations and Management (2002)Google Scholar
  8. 8.
    Raghavachari, M., Reimer, D., Johnson, R.: The deployer’s problem: Configuring application servers for performance and reliability. In: Proceedings of the International Conference on Software Engineering, Portland, OR (2003)Google Scholar
  9. 9.
    Diao, Y., Eskesen, F., Froehlich, S., Hellerstein, J.L., Keller, A., Spainhower, L., Surendra, M.: Generic on-line discovery of quantitative models for service level management. In: Proceedings of IEEE/IFIP Symposium on Integrated Network Management (2003)Google Scholar
  10. 10.
    Weikum, G., Moenkeberg, A., Hasse, C., Zabback, P.: Self-tuning database technology and information services: from wishful thinking to viable engineering. In: International Conference on Very Large Data Bases (2002)Google Scholar
  11. 11.
    Lohman, G.M., Lightstone, S.S.: Smart: Making db2 (more) autonomic. In: Proceedings of the 28th International Conference on Very Large Data Bases, Hong Kong, China (2002)Google Scholar
  12. 12.
    Rao, J., Zhang, C., Lohman, G.M., Megiddo, N.: Automating physical database design in a parallel database. In: SIGMOD (2002)Google Scholar
  13. 13.
    Common Information Model (CIM) Core Model, Version 2.4, white paper (August 2000),
  14. 14.
    Bigus, J.P., Schlosnagle, D.A., Pilgrim, J.R., Mills III, W.N., Diao, Y.: ABLE: A toolkit for building multiagent autonomic systems. IBM Systems Journal 41(3) (2002)Google Scholar
  15. 15.
    Luenberger, D.G.: Linear and nonlinear programming. Addison-Wesley, Reading (1984)zbMATHGoogle Scholar
  16. 16.
    Liu, X., Sha, L., Diao, Y., Froehlich, S., Hellerstein, J.L., Parekh, S.: Online response time optimization of apache web server. In: Proceedings of the 11th International Workshop on Quality of Service, pp. 461–478 (2003)CrossRefGoogle Scholar
  17. 17.
    Nelder, J.A., Mead, R.: A simplex method for function minimizatioin. Computer Journal (1965)Google Scholar
  18. 18.
    Walters, F.H., Parker, J.L.R., Morgan, S.L., Deming, S.N.: Sequential Simplex Optimization: A technique for improving quality and productivity in research, development, and manufacturing. CRC Press, Boca Raton (1991)Google Scholar
  19. 19.
    Brooks, C.H.: An introduction to amoeba, available at
  20. 20.
    Kephart, J.O., Das, R., MacKie-Mason, J.K.: Two-sided learning in an agent economy for information bundles. In: AmEC IJCAI (1999)Google Scholar
  21. 21.
    Smith, W.D.: TPC-W: Benchmarking an ecommerce solution, in

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Yixin Diao
    • 1
  • Frank Eskesen
    • 1
  • Steven Froehlich
    • 1
  • Joseph L. Hellerstein
    • 1
  • Lisa F. Spainhower
    • 2
  • Maheswaran Surendra
    • 1
  1. 1.IBM T.J. Watson Research CenterYorktown HeightsUSA
  2. 2.IBM Server GroupPoughkeepsieUSA

Personalised recommendations