Skip to main content

Using Map-Reduce for Image Analysis in Cloud Environment

  • Conference paper
  • First Online:
Proceedings of International Conference on Cognition and Recognition

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 14))

Abstract

With the quick development of online networking, the quantity of pictures being transferred to the web is blasting. Gigantic amounts of pictures are shared through multi-stage administrations, for example, Instagram, Facebook and WhatsApp. Most present picture handling applications, intended for little scale, nearby calculation, have scalability issues even though there is a necessity for high computation requirement. With the help of hadoop handling such computational issues has become a little easier then traditional methods using MapReduce [1] stage addresses the issue of giving a framework to computationally serious information preparing along with appropriated capacity. In any case, to take in the specialized complexities of creating helpful technologies integrating with hadoop demands experienced Engineer. Accordingly, pool of scientists and software engineers with the shifted abilities to create applications that can utilize extensive arrangements of pictures is restricted. So, we have built up the Image Processing Framework in hadoop, giving a Hadoop library to bolster huge size picture handling in cloud environment. This paper gives a far reaching methodical audit and examination of picture preparing and picture taking care of difficulties and prerequisites in a distributed computing environment by utilizing the MapReduce system and its open-source execution Hadoop. We characterized necessities for MapReduce frameworks to perform picture handling. We likewise proposed the MapReduce algorithm and one execution of this system on Cloud Environment. This paper outlines one of the best strategies to process extensive pictures is MapReduce, it likewise can help designers to do parallel and disseminated calculation in a cloud domain, by which we can obtain the details needed for geo-referencing, in terms of data obtained from images needed for scientific applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gerogiannis D, Orphanoudakis SC (1993) Load balancing requirements in parallel implementations of image feature extraction tasks. Parallel Distrib Syst IEEE Trans 4(9):994–1013

    Article  Google Scholar 

  2. Rimal BP, Choi E, Lumb I (2009) A taxonomy and survey of cloud computing systems. In: Fifth international joint conference on INC, IMS and IDC, Aug 2009, pp 44–51

    Google Scholar 

  3. Calheiros RN, Ranjan R, Beloglazov A, De Rose CAF, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw: Pract Exp 41(1):23–50

    Google Scholar 

  4. Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM—50th Anniv Issue 51:107–113

    Google Scholar 

  5. White T (2010) Hadoop: the definitive guide. O’Reilly Media, Inc.

    Google Scholar 

  6. Lee K-H, Lee Y-J, Choi H, Chung YD, Moon B (2011) Parallel data processing with MapReduce: a survey. ACM SIGMOD Record 40(4):11–20

    Article  Google Scholar 

  7. Loebman S, Nunley D, Kwon Y-C, Howe B, Balazinska M, Gardner JP (2009) Analyzing massive astrophysical datasets: Can Pig/Hadoop or a relational DBMS help? In: IEEE international conference on cluster computing and workshops, Aug 2009, pp 1–10

    Google Scholar 

  8. StoneBraker M, Abadi D, DeWitt DJ, Madden S, Paulson E, Pavlo A, Rasin A (2010) MapReduce and parallel DBMSs: friends or foes? Commun ACM 53(1):64–71

    Article  Google Scholar 

  9. Ghemawat S, Gobioff H, Leung S-T (2003) The google file system. SIGOPS Oper. Syst. Rev. 37(5):29–43

    Article  Google Scholar 

  10. Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th symposium on mass storage systems and technologies (MSST), MSST’10, Washington, DC, USA, 2010, IEEE Computer Society, pp 1–10

    Google Scholar 

  11. Hadoop Powered By (2011) http://wiki.apache.org/hadoop/PoweredBy/. Online: as of 29 Aug 2015

  12. Hadoop Documentation (2012) http://hadoop.apache.org/common/docs/stable/. Online: as of 29 Aug 2014

  13. Hadoop Wikipedia (2012) http://en.wikipedia.org/wiki/ApacheHadoop/. Online: as of 29 Aug 2014

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S. Supreeth .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Supreeth, S., Raja Rajeshwari, M.M. (2018). Using Map-Reduce for Image Analysis in Cloud Environment. In: Guru, D., Vasudev, T., Chethan, H., Kumar, Y. (eds) Proceedings of International Conference on Cognition and Recognition . Lecture Notes in Networks and Systems, vol 14. Springer, Singapore. https://doi.org/10.1007/978-981-10-5146-3_11

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-5146-3_11

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-5145-6

  • Online ISBN: 978-981-10-5146-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics