Abstract
Duplicates in RFID data stream must be filtered before sent to applications. Existing methods only considered detecting the duplicates in the server side, thus wasting lots of bandwidth to transfer the duplicate data from the reader to the server. This paper first identifies the two sources of duplicates, namely local duplicates and global duplicates. Then we propose a two-layer approach to filter those duplicates. In the reader side, we devise a method based on Bloom Filters to filter local duplicates. This greatly reduces the bandwidth requirement to transfer those duplicates. In the server side, we devise Distributed Time Bloom Filters to filter global duplicates. Experimental results show that our approach greatly reduced the network bandwidth required to transfer the data and had linear scalalablity in processing rate. Our approach are most suitable to applications which generate lots of local duplicates and the bandwidth is a scarce resouce.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Martinez-Sala, A.S., Egea-Lopez, E., Garcia-Sanchez, F., Garcia-Haro, J.: Tracking of Returnable Packaging and Transport Units with Active RFID in the Grocery Supply Chain. Computers in Industry 60(3), 161–171 (2009)
Harrop, P.: RFID in the Postal Service. More RFID (2005)
Derakhshan, R., Orlowska, M., Li, X.: RFID Data Management: Challenges and Opportunities. In: IEEE International Conference on RFID, pp. 175–182 (2007)
Bloom, B.H.: Space/Time Tradeoffs in Hash Coding with Allowable Errors. Communications of ACM 13(7), 422–426 (1970)
Metwally, A., Agrawal, D., Abbadi, A.E.: Duplicate Detection in Click Streams. In: 14th International Conference on World Wide Web, pp. 12–21 (2005)
Deng, F., Rafiei, D.: Approximately Detecting Duplicates for Streaming Data Using Stable Bloom Filters. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, pp. 25–36 (2006)
Wang, X., Zhang, Q., Jia, Y.: Efficiently Filtering Duplicates over Distributed Data Streams. In: International Conference on Computer Science and Software Engineering (CSSE), pp. 631–634 (2008)
Lee, C.H., Chung, C.W.: An Approximate Duplicate Elimination in RFID Data Streams. Data & Knowledge Engineering 70(12), 1070–1087 (2011)
Bai, Y., Wang, F., Liu, P.: Efficiently Filtering RFID Data Streams. In: VLDB Workshop on Clean Databases (2006)
Broder, A., Mitzenmacher, M.: Network Applications of Bloom Filters: a Survey. Internet Mathematics, 485–509 (2002)
Jeffery, S.R., Garofalakis, M., Franklin, M.J.: Adaptive Cleaning for RFID Data Streams. In: 32th International Conference on Very Large Data Bases, VLDB, pp. 163–174 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, W., Wang, Y., Zhang, G. (2012). A Two-Layer Duplicate Filtering Approach for RFID Data Streams. In: Wang, Y., Zhang, X. (eds) Internet of Things. Communications in Computer and Information Science, vol 312. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32427-7_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-32427-7_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32426-0
Online ISBN: 978-3-642-32427-7
eBook Packages: Computer ScienceComputer Science (R0)