Skip to main content

Scientific Computation and Data Management Using Microsoft Windows Azure

  • Chapter
  • First Online:
  • 1133 Accesses

Abstract

Cloud computing is the next stage in the evolution of computational and data handling infrastructure, establishing scale out from clients, to clusters to clouds. With the use of a case study, Microsoft Windows Azure has been applied to Space Situational Awareness (SSA) creating a system that is robust and scalable, demonstrating how to harness the capabilities of cloud computing. The generic aspects of cloud computing are discussed throughout.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Abbott, M.L., Fisher, M.T.: The art of scalability: Scalable web architecture, processes, and organizations for the modern enterprise, 1st edn. Addison-Wesley, MA (2009)

    Google Scholar 

  2. Acheson, A., Bendixen, M., Blakeley, J.A., Carlin, P., Ersan, E., Fang, J., Jiang, X.,  Kleinerman, C., Rathakrishnan, B., Schaller, G., et al.: Hosting the.NET Runtime in Microsoft SQL server. In: Proceedings of the 2004 ACM SIGMOD international conference on Management of data, p. 865. ACM, NY (2004)

    Google Scholar 

  3. Amazon. Amazon web services, 2010. http://aws.amazon.com Accessed 23 Aug 2010

  4. Amazon. Amazon EC2 Spot Instances, 2010. http://aws.amazon.com/ec2/spot-instances Accessed 23 Aug 2010

  5. Amazon. Amazon Virtual Private Cloud AmazonVPC, 2010. http://aws.amazon.com/vpc Accessed 23 Aug 2010

  6. Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G.,  Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: Above the clouds: A Berkeley view of cloud computing. Technical report, February 2009. UCB/EECS-2009-28

    Google Scholar 

  7. Bailey, N.J., Swinerd, G.G., Lewis, H.G., Crowther, R.: Global vulnerability to near-earth object impact. Risk Manag., 12, 31–53 (2010). http://eprints.soton.ac.uk/68976/

  8. Benioff, M.: Behind the Cloud: The Untold Story of How salesforce.com Went from Idea to Billion-Dollar Company and Revolutionized an Industry. Jossey Bass, October 2009

    Google Scholar 

  9. Bustamante, M.: Learning WCF: A Hands-on Guide, 1st edn. O’Reilly Media, Cambridge (2007)

    Google Scholar 

  10. Butenhof, D.R.: Programming with POSIX threads. Addison-Wesley, MA (1997)

    Google Scholar 

  11. Buyya, R., Yeo, C.S., Venugopal, S.: Market-oriented cloud computing: Vision, hype, and reality for delivering it services as computing utilities. In: 10th IEEE International Conference on High Performance Computing and Communications, 2008. HPCC ’08, pp. 5–13, 25–27 Sept 2008. doi: 10.1109/HPCC.2008.172

    Google Scholar 

  12. Calder, B., Edwards, A.: Windows azure drive. Windows Azure Platform: Whitepapers, February 2010. microsoft.com/windowsazure/whitepapers Accessed 23 Aug 2010

    Google Scholar 

  13. Cerebrata. Cloud storage studio, 2010. www.cerebrata.com/products/cloudstoragestudio Accessed 23 Aug 2010

  14. Chaganti, P., Helms, R.: Amazon SimpleDB Developer Guide, 1st edn. Packt Publishing (2010)

    Google Scholar 

  15. Chang, F., Jeffrey, D., Ghemawat, S., Hsieh, W., Wallach, D., Burrows, M.,  Chandra, T., Fikes, A., Gruber, R.: Bigtable: A distributed storage system for structured data. ACM Trans. Comput. Syst. 26(2), 1–26 (2008). ISSN 0734-2071. doi: doi.acm.org/10.1145/1365815.1365816

    Google Scholar 

  16. Chappell, D.: Introducing Windows Azure, 2009. David Chappell and Associates. www.davidchappell.com

  17. CodeFutures. Database sharding white paper: Cost-effective database scalability using database sharding. CodeFutures Corporation, July 2008. www.codefutures.com/database-sharding Accessed 23 Aug 2010

  18. Cox, S., Chen, L., Campobasso, S., Duta, M.C., Eres, M.H., Giles, M.B., Goble, C., Jiao, Z.,  Keane, A.J., Pound, G.E., Roberts, A., Shadbolt, N.R., Tao, F., Wason, J.L., Xu, F.: Grid Enabled Optimisation and Design Search (GEODISE). e-Science All Hands, Sheffield (2002)

    Google Scholar 

  19. Date, C.J.: An Introduction to Database Systems, chapter Further Normalisation I:1NF, 2NF, 3NF, BCNF, pp. 348–379, 7th edn. Addison-Wesley, MA (2000)

    Google Scholar 

  20. Deelman, E., Singh, G., Livny, M., Berriman, B., Good, J.: The cost of doing science on the cloud: The montage example. In: SC ’08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, pp. 1–12, Piscataway, NJ, USA, 2008. IEEE, NY. ISBN 978-1-4244-2835-9

    Google Scholar 

  21. DMTF: interoperable clouds: a white paper from the open cloud standards incubator, 2009. DSP-ISO101

    Google Scholar 

  22. Elson, J., Howell, J.: Handling flash crowds from your garage. Proceedings of the 2008 USENIX Annual Technical Conference, February 2008. Microsoft Research

    Google Scholar 

  23. Eres, M.H., Pound, G.E., Jiao, Z., Wason, J.L., Xu, F., Keane, A.J., Cox, S.J.: Implementation and utilisation of a grid-enabled problem solving environment in Matlab. Future Generat. Comp. Syst. 21(6), 920–929 (2005). URL http://eprints.soton.ac.uk/35492/

  24. Evangelinos, C., Hill, C.N.: Cloud Computing for parallel Scientific HPC Applications: Feasibility of running Coupled Atmosphere-Ocean Climate Models on Amazons EC2. Ratio 2(2.40), 2–34 (2008)

    Google Scholar 

  25. Fenn, J., Raskino, M.: Mastering the Hype Cycle: How to Choose the Right Innovation at the Right Time. Harvard Business School Press, Harvard (2008)

    Google Scholar 

  26. Google: Google app engine, 2010. code.google.com/appengine Accessed 23 Aug 2010

    Google Scholar 

  27. Greenberg, A., Hamilton, J., Maltz, D., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39(1), 68–73 (2009). ISSN 0146-4833. doi: http://doi.acm.org/10.1145/1496091.1496103

  28. Hay, C., Prince, B.: Azure in Action. Manning Publications, Greenwich (2010)

    Google Scholar 

  29. Held, G.: A Practical Guide to Content Delivery Networks. Auerbach Publications (2005)

    Google Scholar 

  30. Hinchcliffe, D.: An executive guide to mashups in the enterprise. Executive white paper, July 2008. jackbe.com. Accessed 23 Aug 2010

    Google Scholar 

  31. Huang, H.Y., Wang, B., Liu, X.X., Xu, J.M.: Identity federation broker for service cloud. In: 2010 International Conference on Service Sciences, pp. 115–120. IEEE, NY (2010)

    Google Scholar 

  32. Intergen and TicketDirect: Ticket seller finds ideal business solution in hosted computing platform. Microsoft Case Studies, November 2009. http://www.microsoft.com/casestudies. Accessed 23 Aug 2010

  33. JBoss: Hibernate shards. hibernate.org/subprojects/shards/docs.html. Accessed 23 Aug 2010

    Google Scholar 

  34. Johnston, S., Takeda, K., Lewis, H., Cox, S., Swinerd, G.: Cloud computing for planetary defense. Microsoft eScience Workshop, Pittsburgh, USA, 15–17 Oct 2009

    Google Scholar 

  35. Johnston, S.J., Fangohr, H., Cox, S.J.: Managing large volumes of distributed scientific data. Lect. Note. Comput. Sci. 1(5103), 339–348 (2008)

    Article  Google Scholar 

  36. Josefsberg, A., Belady, C., Bhandarkar, D., Costello, D., Ekram, J.: Microsofts Top 10 Business Practices for Environmentally Sustainable Data Centers, 2010. www.microsoft.com/environment. Accessed 23 Aug 2010

  37. Krishnan, S.: Programming Windows Azure: Programming the Microsoft Cloud, 1st edn. O’Reilly Media (2010)

    Google Scholar 

  38. Lewis, H.G., Newland, R.J., Swinerd, G.G., Saunders, A.: A new analysis of debris mitigation and removal using networks. In: 59th International Astronautical Congress, September 2008. http://eprints.soton.ac.uk/68974/

  39. Lewis, H.G., Swinerd, G.G., Newland, R.J.: The space debris environment: future evolution. In: CEAS 2009 European Air and Space Conference. Royal Aeronautical Society, October 2009

    Google Scholar 

  40. Lin, G., Fu, D., Zhu, J., Dasmalchi, G.: Cloud computing: It as a service. IT Professional 11(2), 10 –13 (2009). ISSN 1520-9202. doi: 10.1109/MITP.2009.22

    Article  Google Scholar 

  41. Mendoza, A.: Guide to Utility Computing Strategies and Technologies. Artech House, March 2007

    Google Scholar 

  42. Microsoft: Windows Azure platform, 2010. www.microsoft.com/windowsazure. Accessed 23 Aug 2010

  43. Microsoft: Windows Azure Platform Appliance, 2010. www.microsoft.com/windowsazure/appliance. Accessed 23 Aug 2010

  44. Microsoft: Pinpoint homepage, 2010c. pinpoint.microsoft.com. Accessed 23 Aug 2010

    Google Scholar 

  45. Moore, G.: Cramming more components onto integrated circuits. Electronics 38(8), 114–117 (1965)

    Google Scholar 

  46. Murty, J.: Programming Amazon Web Services: S3, EC2, SQS, FPS, and SimpleDB, 1st edn. O’Reilly Media, Cambridge (2008)

    Google Scholar 

  47. Needham, R.: Denial of service. In: CCS ’93: Proceedings of the 1st ACM conference on Computer and communications security, pp. 151–153, NY, USA, 1993. ACM, NY. ISBN 0-89791-629-8. doi: http://doi.acm.org/10.1145/168588.168607

  48. Nethi, D.: Scaling out with SQL Azure. Windows Azure Platform: Whitepapers, June 2010. microsoft.com/windowsazure/whitepapers. Accessed 23 Aug 2010

    Google Scholar 

  49. Ng, M., Johnston, S., Wu, B., Murdock, S., Tai, K., Fangohr, H., Cox, S.J., Essex, J.W., Sansom, M.S.P., Jeffreys, P.: BioSimGrid: Grid-enabled biomolecular simulation data storage and analysis. Future Generat. Comp. Syst. 22, 657–664 (2006)

    Article  Google Scholar 

  50. Paluska, J., Saff, D., Yeh, T., K. Chen, K.: Footloose: A case for physical eventual consistency and selective conflict resolution. IEEE Workshop on Mobile Computing Systems and Applications, p. 170, 2003. ISBN 0-7695-1995-4

    Google Scholar 

  51. Peenikal, S.: Mashups and the enterprise. Strategic white paper, Sept 2009. Mphasis white paper

    Google Scholar 

  52. Peirce, B.: Linear Associative Algebra. D. Van Nostrand, Princeton (1882)

    MATH  Google Scholar 

  53. Price, A.R., Xue, G., Yool, A., Lunt, D.J., Valdes, P.J., Lenton, T.M., Wason, J.L., Pound, G.E., Cox, S.J., The GENIE team: Optimisation of integrated earth system model components using grid-enabled data management and computation. Concurrency Comput. Pract. Ex. 19(2), 153–165 (2007). URL http://eprints.soton.ac.uk/23514/

  54. Redkar, T.: Windows Azure Platform, 1st edn, p. 193. Apress, New York (2010)

    Google Scholar 

  55. Salesforce: Salesforce homepage, 2010. www.salesforce.com. Accessed 23 Aug 2010

  56. SQL Server: New T-SQL Features. Pro T-SQL 2008 Programmers Guide, pp. 525–551 (2008)

    Google Scholar 

  57. Smith, J.E., Nair, R.: The architecture of virtual machines. Computer 38(5), 32–38 (2005). ISSN 0018-9162. 10.1109/MC.2005.173

    Article  Google Scholar 

  58. SpaceTrack: The Source For Space Surveillance. www.space-track.org. Accessed 23 Aug 2010

  59. Stantchev, V., Schröpfer, C.: Negotiating and enforcing QoS and SLAs in Grid and Cloud computing. In: Advances in Grid and Pervasive Computing, vol. 5529 of Lecture Notes in Computer Science, pp. 25–35. Springer, Heidelberg (2009). 10.1007/978-3-642-01671-4_3

  60. Suchi: S3Fox organizer, 2010. www.s3fox.net. Accessed 23 Aug 2010

  61. Vogels, W.: Eventually consistent. Commun. ACM 52(1), 40–44 (2009)

    Article  Google Scholar 

Download references

Acknowledgements

Much of this work has been made possible because of contributions from Hugh Lewis and Graham Swinerd at the University of Southampton. We gratefully acknowledge support from Microsoft and Microsoft Research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Steven Johnston .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Johnston, S., Cox, S., Takeda, K. (2011). Scientific Computation and Data Management Using Microsoft Windows Azure. In: Fiore, S., Aloisio, G. (eds) Grid and Cloud Database Management. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20045-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20045-8_9

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20044-1

  • Online ISBN: 978-3-642-20045-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics