Skip to main content

Feature Selection Using Semi Discrete Decomposition and Singular Value Decompositions

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 450))

Abstract

Nowadays, a large amount of digital data is available due to new technologies and different sources of data such as social networks, sensors, etc. There is a challenge to deal with this high dimensional data because query performance degrades as dimensionality increases. However, most of this data are redundant. Hence, it can be reduced to the smaller number of attributes without significant loss of information. The dimensionality reduction and feature selection techniques can be applied for that. In this paper, we compare two techniques Semi-Discrete Decomposition (SDD) and Singular Value Decomposition (SVD) to select significant features from Hepatitis dataset. We found that SVD is more appropriate than SDD in terms of accuracy and acceptable training time.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Hamid, O.H., Alaiwy, F.H., Hussien, I.O.: Uncovering cognitive influences on individualized learning using a hidden Markov models framework. In: 2015 Global Summit on Computer and Information Technology (GSCIT). IEEE (2015)

    Google Scholar 

  2. Sorzano, C.O.S., Vargas, J., Pascual Montano, A.: A survey of dimensionality reduction techniques. arXiv preprint arXiv:1403.2877 (2014)

  3. Li, M., et al.: Large-scale Nyström kernel matrix approximation using randomized SVD. IEEE Trans. Neural Netw. Learn. Syst. 26(1), 152–164 (2015)

    Google Scholar 

  4. Ivancevic, V.G., Ivancevic, T.T.: Quantum Neural Computation, vol. 40. Springer Science & Business Media (2010)

    Google Scholar 

  5. Hamid, O.H., Wendemuth, A., Braun, J.: Temporal context and conditional associative learning. BMC Neurosci. 11, 45 (2010)

    Article  Google Scholar 

  6. Vervliet, N., et al.: Breaking the curse of dimensionality using decompositions of incomplete tensors: tensor-based scientific computing in big data analysis. IEEE Signal Process. Mag. 31(5), 71–79, (2014)

    Google Scholar 

  7. Moravec, P., Snásel, V.: Dimension reduction methods for Iris recognition. DATESO (2009)

    Google Scholar 

  8. Kumar, A.C.: Analysis of unsupervised dimensionality reduction techniques. Comput. Sci. Inf. Syst. 6(2), 217–227 (2009)

    Google Scholar 

  9. Lin, P., Zhang, J., An, R.: Data dimensionality reduction approach to improve feature selection performance using sparsified SVD. In: 2014 International Joint Conference on Neural Networks (IJCNN). IEEE (2014)

    Google Scholar 

  10. Aravindan, S., Ekbal, A.: Feature extraction and opinion mining in online product reviews. In: 2014 International Conference on Information Technology (ICIT). IEEE (2014)

    Google Scholar 

  11. Rodríguez-González, A.Y., et al.: Mining frequent patterns and association rules using similarities. Expert Syst. Appl. 40(17), 6823–6836 (2013)

    Google Scholar 

  12. Wajid, S.K., Hussain, A.: Local energy-based shape histogram feature extraction technique for breast cancer diagnosis. Expert Syst. Appl. (2015)

    Google Scholar 

  13. Ba-Alwi, F.M., Hintaya, H.M.: Comparative study for analysis the prognostic in hepatitis data: data mining approach. Spinal Cord 11, 12 (2013)

    Google Scholar 

  14. Gao, J., Zhang, J.: Sparsification strategies in latent semantic indexing. In: Proceedings of the 2003 Text Mining Workshop (2003)

    Google Scholar 

  15. Ng, A.Y.: Feature selection, L1 vs. L2 regularization, and rotational invariance. In: Proceedings of the Twenty-First International Conference on Machine Learning. ACM (2004)

    Google Scholar 

  16. Kolda, T.G., O’leary, D.P.: A semidiscrete matrix decomposition for latent semantic indexing information retrieval. ACM Trans. Inf. Syst. (TOIS) 16(4), 322–346 (1998)

    Google Scholar 

  17. UCI Machine Learning Repository, https://archive.ics.uci.edu/ml/datasets/Hepatitis

Download references

Acknowledgement

This work is partially supported by Grant of SGS No. SP2016/97, VŠB—Technical University of Ostrava, Czech Republic and Arab Open University, Kuwait Branch.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nour E. Oweis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Hussien, I., Omer, S., Oweis, N.E., Snášel, V. (2016). Feature Selection Using Semi Discrete Decomposition and Singular Value Decompositions. In: Abraham, A., Kovalev, S., Tarassov, V., Snášel, V. (eds) Proceedings of the First International Scientific Conference “Intelligent Information Technologies for Industry” (IITI’16). Advances in Intelligent Systems and Computing, vol 450. Springer, Cham. https://doi.org/10.1007/978-3-319-33609-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-33609-1_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33608-4

  • Online ISBN: 978-3-319-33609-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics