Abstract
Next-generation Grid applications will be highly heterogeneous in nature, will run on many types of computer and device, will operate within and across many heterogeneous network types, and must be explicitly configurable and runtime reconfigurable. We refer to this future Grid environment as the “divergent Grid”. In this paper, we propose a “deep middleware” approach to meeting key requirements of the divergent Grid. Deep middleware reaches down into the network to provide highly flexible network support that underpins a rich, extensible and reconfigurable set of application-level “interaction paradigms” (such as publish-subscribe, multicast, tuple spaces etc.). In our Gridkit middleware platform, these facilities are encapsulated in two key component frameworks: the interaction framework and the overlay framework, which are the subject of this paper. The paper also evaluates the two frameworks in terms of their configurability (e.g. ability to be profiled for different device types) and reconfigurability (e.g. to self-optimise as the environment changes).
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Andersen, A., Blair, G., Goebel, V., Karlsen, R., Stabell-Kulø, T., Yu, W.: Arctic Beans: Configurable and Reconfigurable Enterprise Component Architectures. IEEE Distributed Systems Online 2(7) (November 2001)
Andersen, D., Balakrishnan, H., Kaashoek, M., Morris, R.: The Case for Resilient Overlay Networks. In: Proceedings of the 8th Workshop on Hot Topics in Operating Systems, Elmau, Germany, May 2001, pp. 152–157 (2001)
Blair, G., Coulson, G., Andersen, A., Blair, L., Clarke, M., Costa, F., Duran-Limon, H., Fitzpatrick, T., Johnston, L., Moreira, R., Parlavantzas, N., Saikoski, K.: The design and implementation of Open ORB 2. IEEE Distributed Systems Online 2(6) (September 2001)
Blair, G., Coulson, G., Grace, P.: Research Directions in Reflective Middleware: the Lancaster Experience. In: Proceedings of the 3rd Workshop on Reflective and Adaptive Middleware (RM 2004), Toronto, Canada, October 2004, pp. 262–267 (2004)
Capra, L., Emmerich, W., Mascolo, C.: CARISMA: Context-Aware Reflective mIddleware System for Mobile Applications. IEEE Transactions on Software Engineering 29(10), 929–945 (2003)
Castro, M., Druschel, P., Kermarrec, A., Rowstron, A.: SCRIBE: A large-scale and decentralized application-level multicast infrastructure. IEEE Journal on Selected Areas in communications (JSAC) 20(8), 1489–1499 (2002)
Chin, J., Coveney, P.V.: Towards Tractable Toolkits for the Grid: a Plea for Lightweight, Usable Middleware. RealityGrid NeSC Tech Report UKeS-2004-01 (February 2004)
Coulson, G., Blair, G., Grace, P., Joolia, A., Lee, K., Ueyama, J.: A Component Model for Building Systems Software. In: Proceedings of the IASTED Conference on Software Engineering and Applications (SEA 2004), Cambridge, MA, USA (November 2004)
Coulson, G., Blair, G., Hutchison, D., Joolia, A., Lee, K., Ueyama, J., Gomes, A.T., Ye, Y.: NETKIT: A Software Component-Based Approach to Programmable Networking. ACM SIGCOMM Computer Communications Review (CCR) 33(5), 55–66 (2003)
Dabek, F., Zhao, B., Druschel, P., Kubiatowicz, J., Stoica, I.: Towards a Common API for Structured P2P Overlays. In: Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS), Berkeley, CA, USA, February 2003, pp. 33–44 (2003)
Davies, N., Friday, A., Storz, O.: Exploring the Grid’s Potential for Ubiquitous Computing. IEEE Pervasive Computing 3(2), 74–75 (2004), see also: http://ubigrid.lancs.ac.uk
Doval, D., O’Mahony, D.: Overlay Networks: A Scalable Alternative for P2P. IEEE Internet Computing 7(4), 79–82 (2003)
Furmento, N., Mayer, A., McGough, S., Newhouse, S., Field, T., Darlington, J.: ICENI: Optimisation of Component Applications within a Grid Environment. Parallel Computing 28(12), 1753–1772 (2002)
Gnutella Protocol Specification v0.6, http://rfc-gnutella.sourceforge.net
Grace, P., Coulson, G., Blair, G., Mathy, L., Yeung, W.K., Cai, W., Duce, D., Cooper, C.: GRIDKIT: Pluggable Overlay Networks for Grid Computing. In: Proceedings of the International Symposium on Distributed Objects and Applications (DOA 2004), Cyprus, October 2004, pp. 1463–1481 (2004)
Hiltunen, M., Schlichting, R.: A Configurable Membership Service. IEEE Transactions on Computers 47(5), 573–586 (1998)
Hughes, D., Warren, I., Coulson, G.: AGnuS: The Altruistic Gnutella Server. In: Proceedings of the 3rd International Conference on Peer-to-Peer Computing (P2P 2003), Linkoping, Sweden, September 2003, pp. 202–203 (2003)
Hutchinson, N., Peterson, L.: The x-kernel: An Architecture for Implementing Network Protocols. IEEE Transactions on Software Engineering 17(1), 64–76 (1991)
Kon, F., Roman, M., Liu, P., Mao, J., Yamane, T., Magalhaes, L., Campbell, R.: Monitoring, Security, and Dynamic Configuration with the dynamicTAO Reflective ORB. In: Proceedings of the 2nd ACM/IFIP International Conference on Middleware, New York, April 2000, pp. 121–143 (2000)
Li, B., Guo, J., Wang, M.: iOverlays: A Lightweight Middleware Infrastructure for Overlay Application Implementations. In: Proceedings of the 5th ACM/IFIP/USENIX International Conference on Middleware, Toronto, Canada, November 2004, pp. 135–154 (2004)
Mathy, L., Canonico, R., Hutchinson, D.: An Overlay Tree Building Control Protocol. In: Proceedings of the 3rd International COST264 Workshop on Networked Group Communication, London, UK, November 2001, pp. 76–87 (2001)
Miranda, H., Rodrigues, L.: Communication Support for Multiple QoS Requirements. In: Proceedings of the 3rd European Research Seminar on Advances in Distributed Systems (ERSADS 1999), Madeira Island, Portugal (April 1999)
ISO Reference Model for Open Distributed Processing, http://www.dstc.edu.au/Research/Projects/ODP/standards.html
Parlavantzas, N., Coulson, G., Blair, G.: An Extensible Binding Framework for Component-Based Middleware. In: Proceedings of the 7th IEEE International Enterprise Distributed Object Computing Conference (EDOC 2003), Brisbane, Australia, September 2003, pp. 252–263 (2003)
Roman, M., Islam, N.: Dynamically Programmable and Reconfigurable Middleware Services. In: Proceedings of the 5th ACM/IFIP/USENIX International Conference on Middleware, Toronto, Canada, November 2004, pp. 372–396 (2004)
Roman, M., Kon, F., Campbell, R.: Reflective Middleware: From Your Desk to Your Hand. IEEE Distributed Systems Online 2(5) (August 2001)
Sadjadi, S., McKinley, P., Kasten, E.: Architecture and Operation of an Adaptable Communication Substrate. In: Proceedings of the 9th IEEE International Workshop on Future Trends of Distributed Computing Systems (FTDCS 2003), San Juan, Puerto Rico, May 2003, pp. 46–55 (2003)
Stoica, I., Morris, R., Karger, D., Kaashoek, M., Balakrishnan, H.: Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications. In: Proceedings of the ACM SIGCOMM 2001 Conference, San Diego, CA, USA, August 2001, pp. 149–160 (2001)
van Renesse, R., Birman, K., Hayden, M., Vaysburd, A., Karr, D.: Adaptive Systems Using Ensemble. Software Practice and Experience 28(9), 963–979 (1998)
van Renesse, R., Birman, K., Maffeis, S.: Horus, a Flexible Group Communication System. Communications of the ACM 39(4), 76–83 (1996)
van Renesse, R., Minsky, Y., Hayden, M.: A Gossip-Based Failure Detection Service. In: Proceedings of the 1st IFIP International Conference on Middleware, Lake District, UK, September 1998, pp. 55–70 (1998)
Wojciechowski, P., Rutti, O., Schiper, A.: SAMOA: A Framework for a Synchronisation-Augmented Microprotocol Approach. In: Proceedings of the 18th IEEE Parallel and Distributed Processing Symposium, Santa Fe, New Mexico (April 2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 IFIP International Federation for Information Processing
About this paper
Cite this paper
Grace, P., Coulson, G., Blair, G.S., Porter, B. (2005). Deep Middleware for the Divergent Grid. In: Alonso, G. (eds) Middleware 2005. Middleware 2005. Lecture Notes in Computer Science, vol 3790. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11587552_17
Download citation
DOI: https://doi.org/10.1007/11587552_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30323-7
Online ISBN: 978-3-540-32269-6
eBook Packages: Computer ScienceComputer Science (R0)