Multi-objective Artificial Bee Colony Algorithm with Information Learning for Model Optimization of Extreme Learning Machine

Abstract

As an important branch of neural networks, extreme learning machine with single-hiddenlayer feedforward have been a effective tool for regression and classification applications. However, it is difficult for ELMs to strike a balance between testing accuracy and generalization due to the random input weights and hidden biases. In this paper, a novel multi-objective optimization method of ELM based on swarm intelligence behavior is proposed to obtain good generalization ability and high testing accuracy simultaneously. The multi-objective optimization algorithm is used to select optimal input weights by minimizing this testing error and the norm of output weight. In order to improve optimal performance, an information learning method is introduced to multi-objective artificial bee colony algorithm. Experiments on four UCI data sets are conducted, and original ELM, ELM with nondominated sorting genetic algorithm and the proposed algorithm are compared. The results show that the proposed algorithm can generally obtain better generalization performance and higher accuracy with more compact network than original ELM and ELM with nondominated sorting genetic algorithm simultaneously.