Abstract

The Neural network ensembles are the most effective approach to improve the neural network system. The combination of neural networks can provide more accurate result than a single network. The simple averaging, weighted averaging, majority voting and ranking are commonly used combination strategies, and from these strategies each method has its limitations like for which application area particular is suited . This paper present a survey on different ensemble combination schemes as invented in literature.

References

• M. B. Eisen, P. O. Brown, DNA Arrays For Analysis Of Gene Expression, Methods Enzymol. 303 (1999) 179–205.
• C. A. Harrington, C. Rosenow, J. Retief, Monitoring Gene Expression Using DNA Microarrays, Curr. Opin. Microbiol. 3 (2000) 285–291.
• A. Ben-Dor, L. Bruhn, N. Friedman, I. Nachman, M. Schummer, N. Yakhini. 2000. Tissue Classification With Gene Expression Profiles, J. Comput. Biol. 7 pp. 559–584.
• S. Dudoit, J. Fridlyand, T. P. Speed. 2000 Comparison Of Discrimination Methods For The Classification Of Tumors Using Gene Expression Data, Technical Report 576, Department Of Statistics, University Of California, Berkeley.
• Shuang Yang, Antony Browne, And Philip D. Picton 2002. Multistage Neural Network Ensembles. LNCS 2364, pp. 91–97, Springer-Verlag Berlin Heidelberg.
• Krogh, A. , & Vedelsby, J. 1995. Neural Network Ensembles Cross Validation And Active Learning. In G. Tesauro, D. Touretzky, & T. Leen (Eds. ), Advances In Neural Information Processing Systems (Pp. 231–238). Cambridge, MA: MIT Press.
• Breiman, L. 1996. Bagging Predictors. Machine Learning, Vol. 24, pp. 123-140.
• Freund, Y. ,Schapire, R. E. 1997. A Decision-Theoretic Generalization Of On-Line Learning And An Application To Boosting. Journal Of Computer And System Sciences, Vol. 55, pp. 119-139.
• Zeng, X. , Martinez, T. R. 2000. Using A Neural Network To Approximate An Ensemble Of Classifiers. Neural Processing Letters, 12, pp. 225-237.
• Lean Yu, Shouyang Wang, Kin Keung Lai. 2008 Credit Risk Assessment with a Multistage Neural Network Ensemble Learning Approach, Expert Systems With Applications 34 pp. 1434–1444, Elsevier.
• Lee, D. S. , Srihari, S. N. 1993 Handprinted Digit Recognition: A Comparison Of Algorithms. Pre-Proc. 3RD International Workshop On Frontiers In Handwriting Recognition, Buffalo, USA, pp. 153-162.
• Wolpert, D. H. 1992 Stacked Generalization. Neural Networks, 5, pp. 241-259.
• Partridge, D. , Griffith, N. 1995 Strategies For Improving Neural Net Generalisation. Neural Computing And Applications, 3, 27-37.
• Kittler, J. 1998 Combining Classifiers: A Theoretical Framework. Pattern Analysis And Applications, 1, pp. 18-27.
• Breiman, L. 1996. Bagging Predictors. Machine Learning, 26, 123–140. Chen, M. C. , & Huang, S. H. (2003). Credit Scoring And Rejected Instances Reassigning Through Evolutionary Computation Techniques. Expert Systems With Applications, 24, pp. 433–441.
• Sharkey, A. J. C. 1996. On Combining Artificial Neural Nets. Connection Science, 8, 299–314.
• Yang, S. , & Browne, A. 2004. Neural Network Ensembles: Combining Multiple Models For Enhanced Performance Using A Multistage Approach. Expert Systems, 21, pp. 279–288.
• Raviv, Y. , & Intrator, N. 1996. Bootstrapping With Noise: An Effective Regularization Technique. Connection Science, 8, pp. 355–372.
• Tumer, K. , & Ghosh, J. 1996. Error Correlations And Error Reduction In Ensemble Classifiers. Connection Science, 8, pp. 385–404.
• Hornik, K. , Stinchocombe, M. , & White, H. 1989. Multilayer Feedforward Networks Are Universal Approximators. Neural Networks, 2, pp. 359–366.
• White, H. 1990. Connectionist Nonparametric Regression: Multilayer Feedforward Networks Can Learn Arbitrary Mappings. Neural Networks, 3, pp. 535–549.
• Yu, L. , Wang, S. Y. , & Lai, K. K. 2005. A Novel Nonlinear Ensemble Forecasting Model Incorporating GLAR And ANN For Foreign Exchange Rates. Computers And Operations Research, 32, pp. 2523–2541.
• Lai, K. K. , Yu, L. , Wang, S. Y. , & Zhou, L. G. 2006. Credit Risk Analysis Using A Reliability-Based Neural Network Ensemble Model. Lecture Notes In Computer Science, 4132, pp. 682–690. Huijuan Lu, Jinxiang Zhang, And Lei Zhang. 2006. Tissue Classification Using Gene Expression Data And Artificial Neural Network Ensembles, Pp. 792 – 800, Springer-Verlag Berlin Heidelberg. LNBI 4115.
• Schapire, R. E. 1990. The Strength Of Weak Learnability. Machine Learning, Vol. 5, pp. 197–227
• Larranaga, P. , Lozano, J. A. 2001 Estimation Of Distribution Algorithms: A New Tool For Evolutionary Computation. Kluwer Academic Publishers.
• Lars Kai Hansen, Peter Salamon. 1990. Neural Network Ensembles , IEEE Transactions On Pattern Analysis And Machine Intelligence, VOL. 12, NO. IO, Pp 993-1001.
• Kyung-Joong Kim, Sung-Bae Cho. 2006. Ensemble Classifiers Based On Correlation Analysis for DNA Microarray Classification, Elsevier. Neurocomputing 70 pp. 187–199.