Abstract
Pairwise similarity is an essential operation in multidisciplinary fields of study. However, its operation is expensive due to its complexity as well as the evolution of big data. Besides, similarity scores without semantics leads to neither accurate nor practical results. In this paper, we study the problem of pairwise similarity in terms of semantics, efficiency, and increment. More concretely, we build our own synonym database and organize it in a reflexive synonym index to support us in semantic-aware pairwise similarity. In addition, we employ cache to perform incremental similarity computing in the process of pair-by-pair similarity search. Moreover, we design our feature-based hierarchy to eliminate irrelevant candidate objects before doing pairwise similarity. Furthermore, we analyze a practical case and apply our method into such social network-based applications in order to demonstrate its feasibility and efficiency in reality.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Amiri, H., Resnik, P., Boyd-Graber, J., Daume III, H.: Learning text pair similarity with context-sensitive autoencoders. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany, pp. 1882–1892 (2016)
Fellbaum, C. (ed.): WordNet: An Electronic Lexical Database. MIT Press, Cambridge (1998)
Gantz, J., Reinsel, D.: The digital universe in 2020: big data, bigger digital shadows, and biggest growth in the far east. In: IDC IVIEW White Paper (2012)
Gautam, B., Jain, V., Jain, S., Annappa B.: Profile matching of online social network with aadhaar unique identification number. In: Proceedings of 2016 IEEE International Conference on Cloud Computing in Emerging Markets, pp. 168–169 (2016)
Gray, K.R., Aljabar, P., Heckemann, R.A., Hammers, A., Rueckert, D.: Random forest-based similarity measures for multi-modal classification of Alzheimer-s disease. Neuro Image 65, 167–175 (2013)
Kang, L., Li, Y., Doermann, D.: Orientation robust text line detection in natural images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4034–4041 (2014)
Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)
Phan, T.N., Dang, T.K.: A lightweight indexing approach for efficient batch similarity processing with MapReduce. SN Comput. Sci. 1(1), 1–16 (2019)
Princeton University: About WordNet. WordNet, Princeton University (2010)
Xia, R., Pan, Y., Lai, H., Liu, C., Yan, S.: Supervised hashing for image retrieval via image representation learning. In: Proceedings of the AAAI Conference on Artificial Intellignece, pp. 2156–2162 (2014)
Xie, K., Wang, X., Li, W., Zhe, Z.: Bloom-filter-based profile matching for proximity-based mobile social networking. In: Proceedings of the 13th Annual IEEE International Conference on Sensing, Communication, and Networking (2016)
Yang, T., Jin, R.: Extracting certainty from uncertainty: transductive pairwise classification from pairwise similarities. Adv. Neural Inf. Process. Syst. 27, 262–270 (2014)
Yang, Y., Wang, Z., Yang, J., Wang, J., Chang, S., Huang, T.S.: Data clustering by laplacian regularized L1-graph. In: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence (2014)
Yi, J., Zhang, L., Jin, R., Qian, Q., Jain, A.: Semi-supervised clustering by input pattern assisted pairwise similarity matrix completion. In: Proceedings of the 30th International Conference on Machine Learning (2013)
Zaki, N., Lazarova-Molnar, S., El-Hajj, W., Campbell, P.: Protein-protein interaction based on pairwise similarity. BMC Bioinform. 10(150), 12 (2009)
Zezula, P.: Future trends in similarity searching. In: Navarro, G., Pestov, V. (eds.) SISAP 2012. LNCS, vol. 7404, pp. 8–24. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-32153-5_2
Zezula, P., Amato, G., Dohnal, V., Batko, M.: Similarity search - the metric space approach. In: Series: Advances in Database Systems, vol. 32, XVIII, 220 p. (2006). ISBN: 0-387-29146-6
Acknowledgment
This research is funded by Ho Chi Minh City University of Technology-VNU-HCM, under the grant number T-KHMT-2018-26. We also give our thanks to Vu Tuan Minh and Tran Ngoc Thai Minh, HCMC University of Technology, for their support in our work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Phan, T.N. (2019). Efficiently Semantic-Aware Pairwise Similarity: an Applicable Use-Case. In: Dang, T., Küng, J., Takizawa, M., Bui, S. (eds) Future Data and Security Engineering. FDSE 2019. Lecture Notes in Computer Science(), vol 11814. Springer, Cham. https://doi.org/10.1007/978-3-030-35653-8_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-35653-8_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-35652-1
Online ISBN: 978-3-030-35653-8
eBook Packages: Computer ScienceComputer Science (R0)