Abstract
This chapter gives the information regarding Big Data, MapReduce Framework, and Stragglers in MapReduce Network, their current situation, their impact, and scope in today’s reality. Paper proceeds with information about MapReduce strategy for Big Data handling and the vicinity of stragglers in MapReduce Network. Further, the significance of mitigating straggler is talked about, alongside their effects. This paper also introduces the mobile agent technology for processing Big Data utilizing MapReduce system and its implementation results.
11th International Conference on Wirtschaftsinformatik, 27th February–01st March 2013, Leipzig, Germany.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kumar, U., Kumar, J.: A comprehensive review of straggler handling algorithms for MapReduce framework. Int. J. Grid Distrib. Comput. 7(4), 139–148 (2014). ISSN: 2005-4262
Wilber, L., Mills, S., Perlowitz, B.: Demystifying Big Data. Notices of TA Foundation (2009)
Olofson, C.W., Perry, R.: IDC analyze the future. White Paper 104, 36–41 (2011)
Guimerà, R., Sales-Pardo, M., Amaral, L.A.N.: Search engine architectures from conventional to P2P. Phys. Rev. E 70, 025101 (2012)
Dean, J., Ghemawat, Sanjay: MapReduce: simplified data processing on large clusters. Commun. ACM 51, 107–113 (2004)
Farkas, I., Abel, D., Palla, G., Vicsek, T.: Map reduce execution framework. New J. Phys. 9(6), 180 (2010)
Kumpula, J.M., Kivela, M.: Sequential algorithm for fast straggler detection. Phys. Rev. E 78(2), 026109, (2007)
Freeman, L.C.: Finding stragglers in parallel computation. ACM 1, 215–239 (2009)
Zaharia, M., Konwinski, A., Joseph, A.D., Katz, R., Stoica, I.: Improving MapReduce performance in heterogeneous environment. In: OSDI’08 Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation, pp. 29–42 (2008)
Ananthanarayan, G., Ghodsi, A., Shenker, S., Stoica, I.: Effective straggler mitigation: attack of the clones. In: Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation, pp. 185–198 (2013)
Gandhi, R., Sabne, A.: Finding stragglers in Hadoop. In: European Conference on Computer Systems (2012)
Ananthanarayanan, G., Kandula, S., Berg, A.G., Stoica, I., Harris, E., Shaha, B.: Reining in the outliers in MapReduce clusters using Mantri. In: 9th USENIX Symposium on Networked Systems Design and Implementation (2010)
Wu, Z., Lin, Y., Wan, H., Tian, S.: A fast and reasonable method for straggler detection and mitigation. In: ISKE Conference, 376–379 (2010)
Franklin, S., Graesser, A.: Is it an agent, or just a program?: A taxonomy for autonomous agents, vol. 1193. Springer, Berlin, Heidelberg, pp. 21–35 (1997)
Stonebraker, M., Abadi, D., DeWitt, D.J., Madden, S., Paulson, E., Pavlo, A., Rasin, A.: MapReduce and parallel DBMSs: friends or foes? Commun. ACM 53(1), 64–71 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Kumar, U., Gambhir, S. (2018). Mobile Agent Based MapReduce Framework for Big Data Processing. In: Aggarwal, V., Bhatnagar, V., Mishra, D. (eds) Big Data Analytics. Advances in Intelligent Systems and Computing, vol 654. Springer, Singapore. https://doi.org/10.1007/978-981-10-6620-7_37
Download citation
DOI: https://doi.org/10.1007/978-981-10-6620-7_37
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-6619-1
Online ISBN: 978-981-10-6620-7
eBook Packages: EngineeringEngineering (R0)