Databases in Grid Applications: Locality and Distribution

  • Paul Watson
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3567)


This paper focuses on two areas that experience in building database-oriented e-science applications has shown to be important. Firstly, methods of promoting data locality are vital due to the high cost of moving data in service-based distributed systems. Databases provide an excellent basis for achieving this due to their potential for moving computation to data. The paper also describes a new infrastructure that further promotes locality by enabling service-based computations to migrate to data. Secondly, the ability to combine information from a set of distributed databases has proved invaluable in many applications. The paper describes the design of an adaptive distributed query processing system that is able to exploit facilities offered by an underlying grid infrastructure. In addressing these two areas, the paper gives an overview of some of the generic components that have been designed to simplify the integration of databases into e-science applications.


Query Processing Database Service Execution Plan Query Execution Grid Application 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Watson, P.: Databases and the Grid. In: Berman, F., Fox, G., Hey, A.J.G. (eds.) Grid Computing: Making the Global Infrastructure a Reality, p. 1060. Wiley, Chichester (2002)Google Scholar
  2. 2.
    Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of Supercomputer Applications 15 (2001)Google Scholar
  3. 3.
    Gray, J.: Distributed Computing Economics. Presented at A Tribute to Roger Needham. Springer Monographs in Computing Science (2004)Google Scholar
  4. 4.
  5. 5.
    Sandoz, P., Triglia, A., Pericas-Geertsen, S.: Fast Infoset. Sun Microsystems (2004),
  6. 6.
    Kuric, T.M., Catalyurek, U.V., Chang, C., Saltz, J.H.: DataCutter and A Client Interface for the Storage Resource Broker with DataCuttter Services, University of Maryland, CS-TR-4133 (2000)Google Scholar
  7. 7.
  8. 8.
    Welch, V., Foster, I., Kesselman, C., Mulmo, O., Pearlman, L., Tuecke, S., Gawor, J., Meder, S., Siebenlist, F.: Security for Grid Services. Presented at High-Performance Distributed Computing, Seattle (2003)Google Scholar
  9. 9.
    OASIS. Web Services Security (WS-Security),
  10. 10.
    Global Grid Forum. GGF, Database Access and Integration Services (DAIS-WG) (2005) Google Scholar
  11. 11.
    Nieto-Santisteban, M.A., Szalay, A.S., Thakar, A.R., O’Mullane, W.J., Gray, J., Annis, J.: When Database Systems Meet the Grid. Microsoft Research, MSR-TR-2004-81 (December 2004)Google Scholar
  12. 12.
    Watson, P., Lee, P.: The NU-Grid Persistent Object Computation Server. Presented at 1st European Grid Workshop, Poznan, Poland (2000)Google Scholar
  13. 13.
    Watson, P., Fowler, C.: An Architecture for the Dynamic Deployment of Web Services on a Grid or the Internet. School of Computing Science, University of Newcastle CS-TR- 890 (February 2005)Google Scholar
  14. 14.
    Palmer, J., Mitrani, I.: Optimal Server Allocation in Reconfigurable Clusters with Multiple Job Types. In: Laganá, A., Gavrilova, M.L., Kumar, V., Mun, Y., Tan, C.J.K., Gervasi, O. (eds.) ICCSA 2004. LNCS, vol. 3044, pp. 76–86. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  15. 15.
    Kubicek, C., Fisher, M., McKee, P., Smith, R.: Dynamic Allocation of Servers to Jobs in a Grid Hosting Environment. BT Technology Journal 22, 251–260 (2004)CrossRefGoogle Scholar
  16. 16.
    OASIS. OASIS Web Services Business Process Execution Language,
  17. 17.
    Stevens, R., McEntire, R., Goble, C.A., Greenwood, M., Zhao, J., Wipat, A., Li, P.: My- Grid and the Drug Discovery Process. BIOSILICO 2, 140–148 (2004)Google Scholar
  18. 18.
    Alpdemir, M.N., Mukherjee, A., Paton, N.W., Watson, P., Fernandes, A.A.A., Gounaris, A., Smith, J.: Service Based Distributed Querying on the Grid.Presented at First International Conference on Service Oriented Computing, Trento, Italy (2003)Google Scholar
  19. 19.
    Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor A Distributed Job Scheduler. In: Sterling, T. (ed.) Beowulf Cluster Computing with Linux, The MIT Press, Cambridge (2002)Google Scholar
  20. 20.
    Foster, I., Kesselman, C.: Globus: A Metacomputing Infrastructure Toolkit. International Journal of Supercomputing 11, 115–128 (1997)CrossRefGoogle Scholar
  21. 21.
    Graefe, G.: Encapsulation of Parallelism in the Volcano Query Processing System. Presented at SIGMOD Conference, Atlantic City, NJ, USA (1990)Google Scholar
  22. 22.
    Smith, J., Watson, P.: Fault-Tolerance in Distributed Query Processing School of Computing Science, University of Newcastle CS-TR-893 (February 2005)Google Scholar
  23. 23.
    Gounaris, A., Paton, N.W., Fernandes, A.A.A., Sakellariou, R.: Self-monitoring Query Execution for Adaptive Query Processing. Data and Knowledge Engineering 51, 325–348 (2004)CrossRefGoogle Scholar
  24. 24.
    Walton, N.A., Lawrence, A., Linde, T.: AstroGrid: Initial Deployment of the UK’s Virtual Observatory. Presented at Astronomical Data Analysis Software and Systems XIII, Strasbourg (2003)Google Scholar
  25. 25.
    Plale, B., Alameda, J., Wilhelmson, B., Gannon, D., Hampton, S., Rossi, A., Droegemeier, K.: User-oriented Active Management of Scientific Data with myLEAD. IEEE Internet Computing 9, 27–34 (2005)CrossRefGoogle Scholar
  26. 26.
    Berners-Lee, T., Hendler, J., Lassila, O.: The Semantic Web Scientific American (2001)Google Scholar
  27. 27.
    Roure, D.D., Jennings, N.R., Shadbolt, N.R.: The Semantic Grid: Past, Present and Future. Proceedings of the IEEE 93, 669–681 (2005)CrossRefGoogle Scholar
  28. 28.
    ORACLE. RFID and Sensor-Based Services (2005),
  29. 29.
    Fox, G., Pallickara, S.: The Narada Event Brokering System: Overview and Extensions. Presented at International Conference on Parallel and Distributed Processing Techniques and Applications (2002)Google Scholar
  30. 30.
    Bacon, J., Bates, J., Hayton, R., Moody, K.: Using Events to Build Distributed Applications. Presented at 2nd International Workshop on Services in Distributed and Networked Environments (1995)Google Scholar
  31. 31.
    Microsoft, WinFS (2005),

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Paul Watson
    • 1
  1. 1.School of Computing ScienceUniversity of NewcastleNewcastle-upon-TyneUK

Personalised recommendations