Embedding Relevance Vector Machine in Fuzzy Inference System for Energy Consumption Forecasting

  • Hamid Aghaie Moghanjooghi
  • Babak Nadjar Araabi
  • Majid Nili Ahmadabadi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7664)


This paper introduces a Bayesian framework to gain sparse solutions in forecasting tasks. In this study, a local identification method based on the Takagi-Sugeno relevance vector machine (TS-RVM) for nonlinear time series forecasting is introduced. The core idea is applying a set of nonlinear models, i.e. local RVM models, as the consequent part of the fuzzy rules. In this method, at first, the fuzzy rules are created based on clustering techniques and the parameters of the rules’ premise are tuned. Then, the parameters of each local RVM model are determined in a learning process in a Bayesian framework.

It is shown that by utilizing a probabilistic Bayesian learning framework, we can achieve very accurate prediction models. One of the benefits of this model is that it typically uses fewer basis functions in comparison with support and relevance vector machines. Also, it includes automatic estimation of nuisance parameters, and the ability to use arbitrary basis functions (e.g. non mercer kernels). Second, in comparison with global RVM, proposed model have better result in terms of prediction error. Third, it adds in the benefits of probabilistic predictions, providing a probability distribution for predictions, while other function approximators like SVM and ANN are just point estimators.


Relevance Vector Machine Sparse Bayesian Learning Fuzzy Inference System Time Series Forecasting 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Zhang, X.D., Chen, F., Gao, J., Fang, T.J.: Sparse Bayesian and Its Application to Time Series Forecasting. Control and Decision 21, 585–588 (2006)zbMATHGoogle Scholar
  2. 2.
    Kim, J., Suga, Y., Won, S.: A New Approach to Fuzzy Modeling of Nonlinear Dynamic Systems with Noise: Relevance Vector Learning Mechanism. IEEE Transaction on Fuzzy Systems 14 (2006)Google Scholar
  3. 3.
    Takagi, T., Sugeno, M.: Fuzzy Identification of Systems and Its Applications for Modeling and Control. IEEE Trans. Syst., Man. Cy. 15, 116–132 (1985)zbMATHCrossRefGoogle Scholar
  4. 4.
    Tzikas, D., Likas, A., Galatsanos, N.: Local Feature Selection for the Relevance Vector Machine Using Adaptive Kernel Learning. In: Alippi, C., Polycarpou, M., Panayiotou, C., Ellinas, G. (eds.) ICANN 2009, Part I. LNCS, vol. 5768, pp. 50–59. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  5. 5.
    Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer (1995)Google Scholar
  6. 6.
    Komijani, M., Lucas, C., Araabi, B.N., Kalhor, A.: Introducing Evolving Takagi–Sugeno Method Based on Local Least Squares Support Vector Machine Models. Evolving Systems 3, 81–93 (2012)CrossRefGoogle Scholar
  7. 7.
    Tipping, M.E.: Sparse Bayesian Learning and the Relevance Vector Machine. J. Mach. Learn. Res. 1, 211–244 (2001)MathSciNetzbMATHGoogle Scholar
  8. 8.
    Tipping, M.E., Faul, A.: Fast Marginal Likelihood Maximisation for Sparse Bayesian Models. In: Proceedings of the 9th Int. Workshop on Social Intelligence Statistics (2003)Google Scholar
  9. 9.
    Yang, B., Zhang, Z.K., Sun, Z.S.: Robust Relevance Vector Regression With Trimmed Likelihood Function. IEEE Signal Processing Letters 14, 746–749 (2007)CrossRefGoogle Scholar
  10. 10.
    Carl, E.R., Joaquin, Q.C.: Healing the Relevance Vector Machine Through Augmentation. In: Proceedings of the 22nd International Conference on Machine Learning (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Hamid Aghaie Moghanjooghi
    • 1
  • Babak Nadjar Araabi
    • 1
  • Majid Nili Ahmadabadi
    • 1
  1. 1.School of ECE, College of EngineeringUniversity of TehranIran

Personalised recommendations