Abstract

Extreme Learning Machine (ELM) has recently emerged as a fast classifier giving good performance. Circular–Complex extreme learning machine (CC-ELM) is recently proposed complex variant of ELM which has fully complex activation function. It has been shown that CC-ELM outperforms real valued and other complex valued classifiers. In both CCELM & ELM parameters between input and hidden layer are initialized randomly and the weights between hidden and output layer are obtained analytically. Due to this randomization, the performance of both ELM & CC-ELM fluctuates. In this paper, performance fluctuation due to random parameter of CC-ELM and the circular transformation function have been analyzed first, then by using an Ensemble approach namely Bagging, a variants Bagging. C1 is proposed to bring the stability in the performance of CC-ELM. In Bagging. C1 various data samples are generated by using random parameters of circular transformation function. Performance of proposed classifier ensemble is evaluated using a set of benchmark real-valued classification problems from the University of California, Irvine machine learning repository.

References

• G. B. Huang, Q. Y. Zhu, C. K. Siew, Extreme learning machine: theory and applications, Neurocomputing 70 (1–3) (2006) 489–501. 2.
• H. -X. Tian, Z. -Z. Mao, An ensemble ELM based on modified Adaboost. RT algorithm for predicting the temperature of molten steel in ladle furnace, IEEE Trans. Autom. Sci. Eng. 7 (1) (2010) 73–80.
• D. Wang, M. Alhamdoosh, Evolutionary extreme learning machine ensembles with size control, Neurocomputing 102 (2013) 98–110.
• J. C. Bregains, F. Ares, Analysis, synthesis, and diagnostics of antenna arrays through complex-value neural networks, Microwave Opt. Technol. Lett. 48 (8) (2006) 1512–1515.
• R. Savitha, S. Vigneshwaran, S. Suresh, N. Sundararajan, Adaptive beamform-ing using complex-valued radial basis function neural networks, in: Proceed-ings of the TENCON'09, IEEE Region 10 Annual International Conference, Singapore, November 23–26, 2009, pp. 1–6.
• N. Sinha, M. Saranathan, K. R. Ramakrishna, S. Suresh, Parallel magnetic resonance imaging using neural networks, Proceedings of ICIP'07 IEEE International Conference on Image Processing, vol. 3, 2007, pp. 149–152.
• R. Savitha S. Suresh, N. Sundararajan, Fast learning Circular Complex-valued Extreme Learning Machine(CC-ELM) for real-valued classification problems, Information Sciences, Vol. 187 (2012) pp. 277–290.
• G. B. Huang, N, Liang, H. Rong, P. Saratchandran and N. Sundararajan, "On-line sequential Extreme Learning Machine", IASTED International Conference on Computational Intelligence (CI 2005), Calgary, Canada, July 4-6, 2005.
• G. Huang, L. Chen, "Convex incremental extreme learning machine", Neurocomputing, Lttr. Vol. 70, pp. 3056-3062.
• W. Zong, G. Huang and Y. Chen, "Weighted extreme learning machine for imbalance learning", Neurocomputing, Vol. 101, pp. 229-242.
• M. Li, G Huang, P. Saratchandran and N. Sundararajan, "Fully complex extreme learning machine", Neurocomputing, Letters, Vol. 68, 2005, pp. 306-314.
• J Zhai, H Xu and X Wang, "Dynamic ensemble extreme learning machine based on sample entropy", Softcomputing, vol. 16, 2012, pp. 1493—1502.
• L. K. Hansen and P. Salmon, "Neural network ensembles", IEEE Transactions on Pattern analysis and machine intelligence, Vol. 12, no. 10, October 1990
• M. P. Perrone, L. N. Cooper, When Networks Disagree: Ensemble Methods for Hybrid Neural Networks, Technical Report A121062, Brown University, Institute for Brain and Neural Systems, January 1993
• Y. Liu, X. Xu, C. Wang , "Simple Ensemble of Extreme Learning Machine", 2009.
• J Cao, Z Lin and G Huang and N Liu, "Voting based extreme learning machine", Information Sciences Vol. 185 (2012) pp. 66–77.
• L. Breiman, "Bagging predictors," Mach. Learn. , vol. 24, pp. 123–140, 1996.
• R. E. Schapire, "The strength of weak learnability," Mach. Learn. ,vol. 5, pp. 197–227, 1990.
• H. Chen, H. Chen, X. Nian, P. Liu, Ensembling extreme learning machines, in: Advances in Neural Networks, Lecture Notes in Computer Science, vol. 4491, Springer, Berlin, Heidelberg, 2007, pp. 1069–1076.
• N. Liu, H. Wang, Ensemble based extreme learning machine, IEEE Signal Process. Lett. 17 (8) (2010) 754–757.
• M. Heeswijk, Y. Miche, T. Lindh-Knuutila, P. A. Hilbers, T. Honkela, E. Oja, A. Lendasse, Adaptive ensemble models of extreme learning machines for time series prediction, in: Proceedings of the 19th International Conference on Artificial Neural Networks, Springer-Verlag, 2009, pp. 305–314.
• Y Lan, Y C Soh and G. Huang, "Ensemble of online sequential extreme learning machine", Neurocomputing Vol. 72 (2009) 3391–3395.
• G Wang and P Li, "Dynamic Adaboost Ensemble Extreme Learning Machine", 2010 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE).
• Machine learning repository http://archive. ics. uci. edu/ml/.