Abstract
Modern day systems are facing an avalanche of data, and they are being forced to handle more and more data intensive use cases. These data comes in many forms and shapes: Sensors (RFID, Near Field Communication, Weather Sensors), transaction logs, Web, social networks etc. As an example, weather sensors across the world generate a large amount of data throughout the year. Handling these and similar data require scalable, efficient, reliable and very large storages with support for efficient metadata based searching. This paper present Mahasen, a highly scalable storage for high volume data intensive applications built on top of a peer-to-peer layer. In addition to scalable storage, Mahasen also supports efficient searching, built on top of the Distributed Hash table (DHT)
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Szalay, A.S., Kunszt, P., Thakar, A., Gray, J., Slutz, D., Brunner, R.J.: Designing and Mining Multi-Terabyte Astronomy Archives: The Sloan Digital Sky Survey. In: SIGMOD 2000 Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data (2000)
Baru, C., Moore, R., Rajasekar, A., Wan, M.: The SDSC Storage Resource Broker (1998)
Moore, R.W.: Managing Large Distributed Data Sets using the Storage Resource Broker (2010)
DeCandia, G., Hastorun, D., Jampani, M.: Dynamo.: Amazon’s Highly Available Key-value Store (2010)
Ghemawat, S., Leun, S.-T., Gobioff, H.: The Google File System
Nuno Santos, B.K.: Distributed Metadata with the AMGA Metadata Catalog
Nirvana Storage - Home of the Storage Resource Broker (SRB®) (2011), http://www.nirvanastorage.com/index.php?module=htmlpages&func=display&pid=1
XML Metadata Concept Catalog (XMC Cat), Data to Insight Center, Indiana University Pervasive Technology Institute, http://d2i.indiana.edu/xmccat
Nirvana Performance, http://www.nirvanastorage.com/index.php?module=htmlpages&func=display&pid=54
ApacheTM OODT (2011), http://oodt.apache.org/
WSO2 Governance Registry - lean.enterprise.middleware - open source SOA | WSO2 (2011), http://wso2.com/products/governance-registry/
Apache Lucene - Overview, http://lucene.apache.org/java/docs/index.html
HDFS Architecture Guide (2011), http://hadoop.apache.org/docs/r1.0.4/hdfs_design.html
Pastry - A scalable, decentralized, self-organizing and fault-tolerant substrate for peer-to-peer applications, http://www.freepastry.org/
Druschel, P., Rowstron, A.: PAST: A large-scale, persistent peer-to-peer storage utility. In: HotOS VIII, Schoss Elmau, Germany (2001)
TreeMap (Java 2 Platform SE 5.0) (2011), http://download.oracle.com/javase/1.5.0/docs/api/java/util/TreeMap.html
HttpClient - HttpComponents HttpClient Overview (2011), http://hc.apache.org/httpcomponents-client-ga/
Beltrán, A.G., Sage, P., Milligan, P.: Skip Tree Graph: a Distributed and Balanced Search Tree for Peer-to-Peer Networks
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Perera, K.D.A.K.S., Kishanthan, T., Perera, H.A.S., Madola, D.T.H.V., Walpola, M., Perera, S. (2013). Mahasen: Distributed Storage Resource Broker. In: Hsu, CH., Li, X., Shi, X., Zheng, R. (eds) Network and Parallel Computing. NPC 2013. Lecture Notes in Computer Science, vol 8147. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40820-5_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-40820-5_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40819-9
Online ISBN: 978-3-642-40820-5
eBook Packages: Computer ScienceComputer Science (R0)