Abstract
In this paper, we propose HybridStore, a novel efficient resource-aware data management system for flash-based sensor devices to store and query sensor data streams. HybridStore has three key features. Firstly, it takes advantage of the on-board random-accessible NOR flash in current sensor platforms to guarantee that all NAND pages used by it are fully occupied and written in a purely sequential fashion, and expensive in-place updates and out-of-place writes to an existing NAND page are completely avoided. Thus, both raw NAND flash chips and FTL-equipped (Flash Translation Layer) flash packages can be supported efficiently. Secondly, HybridStore can process typical joint queries involving both time windows and key value ranges as selection predicate extremely efficiently, even on large-scale datasets. It organizes a data stream into segments and exploits a novel index structure that consists of the inter-segment skip list, and the in-segment β-Tree and Bloom filter of each segment. Finally, HybridStore can trivially support time-based data aging without any extra overhead because no garbage collection mechanism is needed. Our implementation and evaluation with a large-scale real-world dataset in TinyOS reveals that HybridStore can achieve remarkable performance at a small cost of constructing the index.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Agrawal, D., Ganesan, D., Sitaraman, R., Diao, Y., Singh, S.: Lazy-adaptive tree: an optimized index structure for flash devices. In: ACM VLDB, pp. 361–372 (2009)
Agrawal, D., Li, B., Cao, Z., Ganesan, D., Diao, Y., Shenoy, P.: Exploiting the interplay between memory and flash storage in embedded sensor devices. In: 16th IEEE Intl. Conf. on Embedded and Real-Time Computing Systems and Applications, pp. 227–236 (2010)
Atmel Inc.: AT45DB041B, http://www.atmel.com/Images/doc3443.pdf
Bloom, B.H.: Space/time trade-offs in hash coding with allowable errors. Communications of the ACM 13(7), 422–426 (1970)
Kang, D., Jung, D., Kang, J.U., Kim, J.S.: μ-tree: an ordered index structure for NAND flash memory. In: ACM EMSOFT, pp. 144–153 (2007)
Li, H., Liang, D., Xie, L., Zhang, G., Ramamritham, K.: TL-Tree: flash-optimized storage for time-series sensing data on sensor platforms. In: ACM SAC, pp. 1565–1572 (2012)
Lin, S., Zeinalipour-Yazti, D., Kalogeraki, V., Gunopulos, D.: Efficient indexing data structures for flash-based sensor devices. ACM Trans. on Storage 2(4), 468–503 (2006)
Madden, S.R., Franklin, M.J., Hellerstein, J.M., Hong, W.: TinyDB: an acquisitional query processing system for sensor networks. ACM TODS 30(1), 122–173 (2005)
Mathur, G., Desnoyers, P., Ganesan, D., Shenoy, P.: Capsule: an energy-optimized object storage system for memory-constrained sensor devices. In: ACM SenSys, pp. 195–208 (2006)
Mathur, G., Desnoyers, P., Ganesan, D., Shenoy, P.: Ultra-low power data storage for sensor networks. In: ACM/IEEE IPSN, pp. 374–381 (2006)
Mottola, L.: Programming storage-centric sensor networks with squirrel. In: ACM IPSN, pp. 1–12 (2010)
Nath, S.: Energy efficient sensor data logging with amnesic flash storage. In: ACM/IEEE IPSN, pp. 157–168 (2009)
Nath, S., Gibbons, P.B.: Online maintenance of very large random samples on flash storage. In: ACM VLDB, pp. 970–983 (2008)
Nath, S., Kansal, A.: FlashDB: dynamic self-tuning database for NAND flash. In: ACM/IEEE IPSN, pp. 410–419 (2007)
Perla, E., Catháin, A.O., Carbajo, R.S., Huggard, M., Mc Goldrick, C.: PowerTOSSIMz: realistic energy modelling for wireless sensor network environments. In: Proc. of the 3rd ACM workshop on Performance monitoring and measurement of heterogeneous wireless and wired networks, pp. 35–42 (2008)
Pugh, W.: Skip lists: a probabilistic alternative to balanced trees. Communications of the ACM 33(6), 668–676 (1990)
Tsiftes, N., Dunkels, A.: A database in every sensor. In: ACM SenSys, pp. 316–332 (2011)
Yin, S., Pucheral, P., Meng, X.: A sequential indexing scheme for flash-based embedded systems. In: ACM EDBT, pp. 588–599 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, B., Baras, J.S. (2013). HybridStore: An Efficient Data Management System for Hybrid Flash-Based Sensor Devices. In: Demeester, P., Moerman, I., Terzis, A. (eds) Wireless Sensor Networks. EWSN 2013. Lecture Notes in Computer Science, vol 7772. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36672-7_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-36672-7_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36671-0
Online ISBN: 978-3-642-36672-7
eBook Packages: Computer ScienceComputer Science (R0)