Skip to main content

Incremental Real Time Support Vector Machines

  • Conference paper
  • First Online:
Intelligent Systems Design and Applications (ISDA 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 736))

Abstract

This paper investigates the problem of handling large data stream and adding new attributes over time. We propose a new approach that employs the dynamic learning when classifying dynamic datasets. Our proposal consists of the incremental real time support vector machines (I-RTSVM) which is an improved version of the support vector machines (SVM) and LASVM. On one hand, the I-RTSVM handles large databases and uses the model produced by the LASVM to train data. It updates this model to be appropriate to new observations in test phase without re-training. On the other hand, the I-RTSVM presents a dynamic approach that adds attributes over time. It uses the final model of classification and updates it with new attributes without re-training from the beginning. Experiments are illustrated using real-world UCI databases and by applying different evaluation criteria. Results of comparison between the I-RTSVM and other approaches mainly the SVM and LASVM shows the efficiency of our proposal.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Anqi, B., Shitong, W.: Incremental enhanced \(\alpha \)-expansion move for large data: a probability regularization perspective. Int. J. Mach. Learn. Cybernet. 8, 1615–1631 (2017)

    Article  Google Scholar 

  2. Ben Rejab, F., Nouira, K., Trabelsi, A.: Support vector machines versus multi-layer perceptrons for reducing false alarms in intensive care units. Int. J. Comput. Appl. Found. Comput. Sci. 49, 41–47 (2012)

    Google Scholar 

  3. Ben Rejab, F., Nouira, K., Trabelsi, A.: On the use of the incremental support vector machines for monitoring systems in intensive care unit. In: TAEECE 2013, pp. 266–270 (2013)

    Google Scholar 

  4. Ben Rejab, F., Nouira, K., Trabelsi, A.: Health monitoring systems using machine learning techniques. In: Intelligent Systems for Science and Information, pp. 423–440 (2014)

    Google Scholar 

  5. Bordes, A., Bottou, L.: The Huller: a simple and efficient online SVM. In: Machine Learning: ECML 2005. Lecture Notes in Artificial Intelligence, LNAI, vol. 3720, pp. 505–512. Springer (2005)

    Google Scholar 

  6. Bordes, A., Ertekin, S., Weston, J., Bottou, J.: Fast kernel classifiers with online and active learning. J. Mach. Learn. Res. 6, 1579–1619 (2005)

    MathSciNet  MATH  Google Scholar 

  7. Bottou, L., Curtis, Frank E., Nocedal, J.: Optimization methods for large-scale machine learning. International Archives of the Photogrammetry, ArXiv e-prints (2016)

    Google Scholar 

  8. Cauwenberghs, G., Poggio, T.: Incremental and decremental support vector machine learning. In: Advances in Neural Information Processing Systems (NIPS*2000), vol. 13, pp. 409–415 (2000)

    Google Scholar 

  9. Cortes, C., Vapnik, V.: Support vector networks. Mach. Learn. 20, 273–297 (1995)

    MATH  Google Scholar 

  10. Chang, E.Y.: PSVM: parallelizing support vector machines on distributed computers, pp. 213–230 (2011)

    Google Scholar 

  11. Frasconi, P., Passerini, A.: Predicting the geometry of metal binding sites from protein sequence, vol. 9, pp. 203–213 (2012)

    Google Scholar 

  12. Ghaemi, Z., Farnaghi, M., Alimohammadi, A.: Hadoop-based distribution system for online prediction of air pollution based on support vector machine. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XL-1/W5, pp. 215–219 (2015)

    Google Scholar 

  13. Graf, H.P., Cosatto, E., Bottou, L., Durdanovic, I., Vapnik, V.: Parallel support vector machines: the cascade SVM. In: NIPS, pp. 521–528 (2005)

    Google Scholar 

  14. Lichman, M.: UCI Machine Learning Repository. University of California, School of Information and Computer Science, Irvine, CA (2013). http://archive.ics.uci.edu/ml

  15. Liu, X., Zhang, G., Zhan, Y., Zhu, E.: An incremental feature learning algorithm based on least square support vector machine. Front. Algorithmics 5059, 330–338 (2008)

    Article  MATH  Google Scholar 

  16. Vapnik, V.: Statistical Learning Theory, pp. 1–736. Wiley, New York (1998)

    MATH  Google Scholar 

  17. Wang, Z., Vucetic, S.: Online training on a budget of support vector machines using twin prototypes. Stat. Anal. Data Min. 3, 149–169 (2010)

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fahmi Ben Rejab .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ben Rejab, F., Nouira, K. (2018). Incremental Real Time Support Vector Machines. In: Abraham, A., Muhuri, P., Muda, A., Gandhi, N. (eds) Intelligent Systems Design and Applications. ISDA 2017. Advances in Intelligent Systems and Computing, vol 736. Springer, Cham. https://doi.org/10.1007/978-3-319-76348-4_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-76348-4_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-76347-7

  • Online ISBN: 978-3-319-76348-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics