Abstract

This work proposes proposed a technique inspired by memetic algorithm (MA) to improve the convergence of iterative methods for solving systems of equations. In the first phase the system of equations is transformed into an optimization problem. In this first phase, a memetics technique -ie a double optimization, local and global- is used to determine an initial vector favorable to a rapid convergence. In the second phase the system of equations is solved using an iterative method with the initial vector obtained in the previous phase. One can say that it is a hybrid method of solving systems of equations, both linear and nonlinear. The experimental results obtained with conjugate gradient, preconditioned conjugate gradient, Newton, Chebyshev and Broyden methods, serial and parallel versions, recommend the proposed method.

References

• F. Neri, C. Cotta, P. Moscato (Eds. ), Handbook of Memetic Algorithms, Studies in Computational Intelligence, 2012 Springer-Verlag Berlin Heidelberg, ISBN 978-3-642-23246-6, 2012
• J. Brownlee, Clever Algorithms: Nature-Inspired Programming Recipes, 2011, ISBN:978-1-4467-8506-5, 2011
• M. Gendreanu, J. Y. Potvin, Handbook of Metaheuristics, Springer 2010, ISBN 978-1-4419-1663-1, 2010
• T. F. Gonzales, Handbook of Approximation Algorithms and Metaheuristics, Chapman&Hall/CRC 2007
• N. Krasnogor, Studies in the Theory and Design Space of Memetic Algorithms, PhD thesis, Univ. of the West of England, 2002
• W. E. Hart, N. Krasnogor,J. E. Smith, Recent Advances in Memetic Algorithms, Springer-Verlag Berlin Heidelberg, ISBN 3-540-22904-3, 2005
• L. O. Mafteiu-Scai, Solving Linear Systems of Equations using a Memetic Algorithm, , International Journal of Computer Applications (0975-8887), volume 58-No. 13 November 2012
• Ya-Zhong Luo , Guo-Jin Tang, Li-Ni Zhou, Hybrid approach for solving systems of nonlinear equations using chaos optimization and quasi-Newton method, Elsevier, Applied Soft Computing, Volume 8 Issue 2, pp: 1068-1073 March, 2008
• M. R. Hestenes, E. Stiefel, Methods of Conjugate Gradients for Solving Liniar Systems, Journal of Research of the National Bureau of Standards, Vol. 49, No. 6, December 1952
• J. O. Omolehin, M. K. A Abdulrahman, K. Rauf, Conjugate gradient method for non-positive definite matrix operator, African Journal of Mathematics and Computer Science Research Vol. 1(2), pp: 028-031, October, 2008
• R. Fletcher, Conjugate gradient methods for indefinite sistems, Springer, Numerical Analysis Lecture Notes in Mathematics Volume 506, pp: 73-89, 1976
• Michele Benzi, Preconditioning Techniques for Large Linear Systems: A Survey, Journal of Computational Physics 182, pp: 418–477, 2002
• A. Galantai, The theory of Newton's method, Journal of Computational and Applied Mathematics 124 (2000) pp 25-44, Elsevier, 2000
• Yixun Shi, Modified Quasi-Newton Methods for Solving Systems of Linear Equations, Int. J. Contemp. Math. Sci. , Vol. 2, 2007, no. 15, pp: 737 – 744, 2007
• C. G. Broyden, A Class of Methods for Solving Nonlinear Simultaneous Equations, JSTOR vol. 19 no. 92 pp: 577–593, 1965, Mathematics of Computation, publ. By American Mathematical Society, 1965
• D. M. Gay, Some convergence properties of Broyden's method, SIAM Journal of Numerical Analysis (SIAM) vol. 16 no. 4, pp: 623–630, 1979
• Gene H. Golub, Michael L. Overton, The convergence of inexact Chebyshev and Richardson iterative methods for solving linear systems, Numerische Mathematik 1988, Vol. 53, Issue 5, pp 571-593, Springer 1988
• T. A. Manteuffel, The Tchebyshev iteration for nonsymmetric linear systems, Numerische Mathematik 1977, vol 28, 307–327 ,1977
• H. Wo?niakowski Numerical stability of the Chebyshev method for the solution of large linear systems, Numerische Mathematik 1977, vol 28, 191–209 (1977)
• Al Dahoud Ali, Ibrahiem M. M. Emary, Mona M. Abd El-Kareem, Application of Genetic Algorithm in Solving Linear Equation Systems, MASAUM Journal of Basic and Applied Science, Vol. 1, No. 2 Sept. 2009
• Ikotun Abiodun M. , Lawal Olawale N. , Adelokun Adebowale P. The Effectiveness of Genetic Algorithm in Solving Simultaneous Equations, International Journal of Computer Applications (0975 – 8887) Volume 14– No. 8, February 2011
• Crina Grosan, Ajith Abraham, Multiple Solutions for a System of Nonlinear Equations, International Journal of Innovative Computing, Information and Control ICIC International , 2008 ISSN 1349-4198,2008
• Ibrahiem M. M. El-Emary,Mona M. Abd El-Kareem, Towards Using Genetic Algorithm for Solving Nonlinear Equation Systems, World Applied Sciences Journal 5 (3): pp. 282-289, 2008, ISSN 1818-4952, 2008
• Crina Grosan, Ajith Abraham, A New Approach for Solving Nonlinear Equations Systems, IEEE Transaction on Systems, Man and Cybernetics-part A: Systems and Humans, vol. 38, no. 3, May 2008
• Yong Zhou, Huajuan Huang, Junli Zhang, Hybrid Artificial Fish Swarm algorithm for Solving Ill-Conditioned Linear Systems of Equations, ICICIS 2011 Proceedings, Part 1, Springer 2011, pp. 656-662, 2011
• Selim G. AkM, The Design of Parallel and Analysis Algorithms, ISBN 0-13-200056-3, Prentice-Hall, Inc. , 1989
• S. Maruster, V. Negru, L. O. Mafteiu-Scai, Experimental study on parallel methods for solving systems of equations, IEEE CPS, Proc. of 14th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, 2011
• T. J. Dekker, W. Hoffmann, K. Potma, „Parallel algorithms for solving large linear systems", Journal of Comput. and Applied Mathematics 50 (1994) 221-232, Elsevier, 1994
• Tsu-Chien Cheu, C. Philip Johnson, Roy R. Craig Jr, Computer algorithms for calculating efficient initial vectors for subspace iteration method, Int. Journal for Numerical Methods in Engineering Vol. 24, - 10, pp: 1841–1848, October 1987
• C. T. Kelley, Iterative Methods for Linear and Nonlinear Equations, SIAM 1995, ISBN:0-89871-352-8, 1995
• B. I. Epureanu, H. S. Greenside, Fractal basins of attraction associated with a damped Newton's method, SIAM Rev 1998, 40:102-109, 1998
• M. Scott, B. Neta, C. Chun, Basin attractors for various methods, Elsevier, Applied Mathematics and Computation 218 (2011) 2584–2599, 2011
• O. Cira, Numerical experiments on attraction basin, AMO Advanced modeling and optimization, vol. 2 no. 3, 2000