Abstract
Nowadays text classification is dealing with unstructured and high-dimensionality text document. These textual data can be easily retrieved from social media platforms. However, this textual data is hard to manage and process for classification purposes. Pre-processing activities and feature selection are two methods to process the text documents. Therefore, this paper is presented to evaluate the effect of pre-processing and feature selection on the text classification performance. A tweet dataset is utilized and pre-processed using several combinations of pre-processing activities (tokenization, removing stop-words and stemming). Later, two feature selection techniques (Bag-of-Words and Term Frequency-Inverse Document Frequency) are applied on the pre-processed text. Finally, Support Vector Machine classifier is used to test the classification performances. The experimental results reveal that the combination of pre-processing technique and TF-IDF approach achieved greater classification performances compared to BoW approach. Better classification performances hit when the number of features is decreased. However, it is depending on the number of features obtained from the pre-processing activities and feature selection technique chosen.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Singh V, Saini B (2014) An effective pre-processing algorithm for information retrieval systems. Int J Database Manag Syst (IJDMS) 6(6):249–257
Syafiqah N, Nafis M, Awang S (2018) Challenges and issues in unstructured big data: a systematic literature review. Adv Sci Lett 24(10):7716–7722
Ceska Z, Fox C (2009) The influence of text pre-processing on plagiarism detection. In: RANLP, pp 55–59
Goncalves CA, Goncalves CT, Camacho R, Oliveira EC (2010) The impact of pre-processing on the classification of MEDLINE documents. In: Pattern recognition in information systems, proceedings of the 10th international workshop on pattern recognition in information systems, PRIS 2010, in conjunction with ICEIS 2010, p 10
Shinde AA, Chougule DG (2012) Text pre-processing and text segmentation for OCR. IJCSET 2(1):810–812
Jianqiang Z, Xiaolin GUI (2017) Comparison research on text pre-processing methods on Twitter sentiment analysis. IEEE Access 5:2870–2879
Al-Saffar A, Awang S, Tao H, Omar N, Al-Saiagh W, Al-bared M (2018) Malay sentiment analysis based on combined classification approaches and Senti-lexicon algorithm. PLoS ONE 13(4):1–18
Islam MS, Md Jubayer FE, Ahmed SI (2017) A support vector machine mixed with TF-IDF algorithm to categorize Bengali document. In: ECCE 2017—International Conference on Electrical, Computer and Communication Engineering, pp 191–196
Buckley C (1985) Implementation of the SMART information retrieval system, no. TR85-686, p 37
Porter MF (1980) An algorithm for suffix stripping
Bhaskar V (2017) Mining crisis information: a strategic approach for detection of people at risk through social media analysis. Int J Disaster Risk Reduct
Javed K, Maruf S, Babri HA (2015) A two-stage Markov blanket based feature selection algorithm for text classification. Neurocomputing 157:91–104
Acknowledgements
We would like to show our gratitude to Universiti Malaysia Pahang grant (RDU vote number RDU180380) for supporting this research.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Nafis, N.S.M., Awang, S. (2020). The Impact of Pre-processing and Feature Selection on Text Classification. In: Zakaria, Z., Ahmad, R. (eds) Advances in Electronics Engineering. Lecture Notes in Electrical Engineering, vol 619. Springer, Singapore. https://doi.org/10.1007/978-981-15-1289-6_25
Download citation
DOI: https://doi.org/10.1007/978-981-15-1289-6_25
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-1288-9
Online ISBN: 978-981-15-1289-6
eBook Packages: EngineeringEngineering (R0)