Data Integration Using Web Services

  • Mark Hansen
  • Stuart Madnick
  • Michael Siegel
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2590)


In this paper we examine the opportunities for data integration in the context of the emerging Web Services systems development paradigm. The paper introduces the programming standards associated with Web Services and provides an example of how Web Services can be used to unlock heterogeneous business systems to extract and integrate business data. We provide an introduction to the problems and research issues encountered when applying Web Services to data integration. We provide a formal definition of aggregation (as a type of data integration) and discuss the impact of Web Services on aggregation. We show that Web Services will make the development of systems for aggregation both faster and less expensive to develop. A system architecture for Web Services based aggregation is presented that is representative of products available from software vendors today. Finally, we highlight some of the challenges facing Web Services that are not currently being addressed by standards bodies or software vendors. These include context mediation, trusted intermediaries, quality and source selection, licensing and payment mechanisms, and systems development tools. We suggest some research directions for each of these challenges.


Business Process Data Integration Electronic Data Interchange Enterprise Application Integration UDDI Registry 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Madnick, S (1999). “Metadata Jones and the Tower of Babel: The Challenge of Large-Scale Semantic Heterogeneity”, Proc. IEEE Meta-Data Conf., April 1999.Google Scholar
  2. [2]
    Madnick, S. (2001). “The Misguided Silver Bullet: What XML will and will NOT do to help Information Integration”, Proceedings of the Third International Conference on Information Integration and Web-based Applications and Services (IIWAS2001), September 2001.Madnick, S., Siegel, M. Frontini, M., Khemka, S., Chan, S., and Pan, H., “Surviving and Thriving in the New World of Web Aggregators”, MIT Sloan Working Paper #4138, October 2000 [CISL #00-07].Google Scholar
  3. [3]
    Bressan, S., Goh, C., Levina, S., Madnick, S., Shah, A., and Siegel, M., “Context Knowledge Representation and Reasoning in the Context Interchange System”, Applied Intelligence (13:2), Sept. 2000, pp. 165–179.CrossRefGoogle Scholar
  4. [4]
    Hackathorn, R (1999). Web Farming for the Data Warehouse, Morgan Kaufmann Publishers.Google Scholar
  5. [5]
    Goh, C. (1996). Representing and Reasoning about Semantic Conflicts in Heterogeneous Information Systems, PhD Thesis, MIT, June 1996.Google Scholar
  6. [6]
    Tomasic A., Raschid L., and Valduriez P., “Scaling Access to Heterogeneous Databases with DISCO,” in IEEE Transactions on Knowledge and Data Engineering, 10(5), 1998.Google Scholar
  7. [7]
    Goh, C., Bressan, S., Madnick, S., and Siegel, M. (1999). “Context Interchange: New Features and Formalisms for the Intelligent Integration of Information,” ACM Transactions on Office Information Systems, July 1999.Google Scholar
  8. [8]
    Goh, C., Bressan, S., Levina, S., Madnick, S., Shah, A., and Siegel, M. (2000). “Context Knowledge Representation and Reasoning in the Context of Applied Intelligence,” The International Journal of Artificial Intelligence, Neural Networks, and Complete Problem-Solving Technologies, Volume 12, Number 2, Sept. 2000, pp. 165–179.Google Scholar
  9. [9]
    Goh, C., Madnick, S., and Siegel, M. (1994). “Context Interchange: Overcoming the Challenges of Large-Scale Interoperable Database Systems in a Dynamic Environment,” Proceedings of the Third International Conference on Information and Knowledge Management, pages 337–346, Gaithersburgh MD.Google Scholar
  10. [10]
    Siegel, M. and Madnick, S. (1991) “Context Interchange: Sharing the Meaning of Data,” SIGMOD RECORD, Vol. 20, No. 4, December pp. 77–78.CrossRefGoogle Scholar
  11. [11]
    Siegel, M. and Madnick, S. (1991) “A Metadata Approach to Solving Semantic Conflicts,” Proceedings of the 17th International Conference on Very Large Data Bases, pages 133–145.Google Scholar
  12. [12]
    Hansen, M., “Changing Terrain: Open middleware standards are redefining EAI and B2B integration”, Intelligent Enterprise, August 10, 2001.Google Scholar
  13. [13]
    Moulton, A., Bressan, S., Madnick, S. and Siegel, M., “An Active Conceptual Model for Fixed Income Securities Analysis for Multiple Financial Institutions,” Proc. ER 1998, pp. 407–420.Google Scholar
  14. [14]
    Grosof, B. and Labrou, Y., “An Approach to using XML and a Rule-based Content Language with an Agent Communication Language”. In Frank Dignum and Mark Greaves, editors, Issues in Agent Communication. Springer-Verlag, 2000.Google Scholar
  15. [15]
    Grosof, B., “Standardizing XML Rules: Preliminary Outline of Invited Talk”, Proceedings of the IJCAI-01 Workshop on E-business and the Intelligent Web, edited by Alun Preece, August 5, 2001.Google Scholar
  16. [16]
    Chen, X., Funk, J., Madnick, S., and Wang, R., “Corporate Household Data: Research Directions”, Proceedings of the Americans Conference on Information Systems (AMCIS, Boston), August 2001 [SWP #4166, CISL WP#01-03, TDQM WP#2001-08].Google Scholar
  17. [17]
    Madnick, S., Wang, R., Dravis, F., and Chen, X., “Improving the Quality of Corporate Household Data: Current Practices and Research Directions”, Proceedings of the Sixth International Conference on Information Quality (IQ2001, Cambridge), November 2001, pp. 92–104 [CISL #01-10].Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Mark Hansen
    • 1
  • Stuart Madnick
    • 2
  • Michael Siegel
    • 2
  1. 1.MIT Sloan School of ManagementCambridge
  2. 2.MIT Sloan School of ManagementCambridge

Personalised recommendations