Total views : 322

Global Convergence Analysis of a Nonlinear Conjugate Gradient Method for Unconstrained Optimization Problems

Affiliations

  • Department of Mathematical Sciences, Universiti Teknologi Malaysia (UTM), 81310 Johor Bahru, Johor, Malaysia
  • Department of Mathematics, Federal University Dutse (FUD), P.M.B 7156 Dutse JIgawa State, Nigeria

Abstract


Background/Objectives: The Conjugate Gradient (CG) methods are the well-known iterative methods use for finding solutions to nonlinear system equations. There is need to address the jamming phenomenal facing the current class of this methods. Methods/Statistical Analysis: In order to address the shortcomings, we work on the denominator of the Yao et al., CG method which is known to generate descent direction for objective functions by proposing an entire different CG coefficient which can easily switch in case jamming occurs by imposing some parameters thereby guarantee global convergence. Findings: The proposed CG formula performs better than classical methods as well as Yao et al. Under Wolfe line search condition, the convergence analysis of the proposed CG formula was established. Some benchmark problems from cute collections are used as basis of strength comparisons of the proposed formula against some other CG formulas. Effectiveness and efficiency of the obtained results for the proposed formula is clearly shown by adopting the performance profile of Dolan and More’ which is one of most acceptable techniques of strength comparisons among methods. Application: Mathematicians and Engineers who are interested in finding solutions to large scale nonlinear equations can apply the method leading to global optimization dealing with best possible solutions ever for given problems.

Keywords

Conjugate Gradient, Descent Algorithm, Global Convergence, Line Search, Unconstrained Optimization.

Full Text:

 |  (PDF views: 304)

References


  • Hestenes MR, Stiefel E. Methods of conjugate gradients for solving linear systems. Journal of Research of the National Bureau of Standards. 1952; 49:409–36.
  • Fletcher R, Reeves CM. Function minimization by conjugate gradients. The computer Journal. 1964; 7(2):149–54.
  • Fletcher R. Practical methods of optimization. John Wiley and Sons; 2013.
  • Dai YH, Yuan Y. A nonlinear conjugate gradient method with a strong global convergence property. SIAM Journal on Optimization. 1999; 10(1):177–82.
  • Polyak BT. The conjugate gradient method in extremal problems. USSR Computational Mathematics and Mathematical Physics. 1969; 9(4):94–112.
  • Hu Y, Storey C. Global convergence result for conjugate gradient methods. Journal of Optimization Theory and Applications. 1991; 71(2):399–405.
  • Hager WW, Zhang H. A survey of nonlinear conjugate gradient method. Pacific Journal of Optimization. 2006; 2(1):35–58.
  • Powell MJD. Restart procedures for the conjugate gradient method mathematical programming. Springer. 1977; 12(1):241–54.
  • Powell MJD. Nonconvex minimization calculations and the conjugate gradient method. Lecture Notes in Mathematics, Numerical Analysis, Springer. 1984; 1066:122–41.
  • Hager WW, Zhang H. A new conjugate gradient method with guaranteed descent and an efficient line search. JSIAM Journal on Optimization. 2005; 16(1):170–92.
  • Liu J, Feng Y. Global convergence of a modified ls nonlinear conjugate gradient method. Procedia Engineering. 2011; 15:4357–61.
  • Wei Z, Li G, Qi L. New nonlinear conjugate gradient formulas for large-scale unconstrained optimization problems. Applied Mathematics and Computation. 2006; 179(2):407–30.
  • Polyak BT. The conjugate gradient method in extremal problems. USSR Computational Mathematics and Mathematical Physics. 1969; 9(4):94–112.
  • Ibrahim A, Rohanin A. Convergence analysis of a new conjugate gradient method for unconstrained optimization. Applied Mathematical Sciences. 2015; 9(140):6969–84.
  • Zhang Y, Zheng H, Zhang C. Global convergence of a modified PRP conjugate gradient method. Procedia Engineering. 2012; 31:986–95.
  • Du X, Liu J. Global convergence of a spectral hs conjugate gradient method. Procedia Engineering. 2011; 15:1487–92.
  • Mohd R, Abdelrhaman A, Mustafa M, Ismail M. The convergence properties of a new type of conjugate gradient methods. Applied Mathematical Sciences. 2015; 9(54):2671–82.
  • Zhifeng D, Fenghua W. Another improved Wei–Yao–Liu nonlinear conjugate gradient method with sufficient descent property. Applied Mathematics and Computation. 2014; 1(8):33–44.
  • Dai Y. A nonmonotone conjugate gradient algorithm for unconstrained optimization. Journal of Systems Science and Complexity. 2002; 2(15):139–45.
  • Xian-zhen J, Jin-bao J. A sufficient descent Dai–Yuan type nonlinear conjugate gradient method for unconstrained optimization problems. Nonlinear Dynamics. 2013; 72(1):101–12.
  • Yao S, Zengxin W, Hai H. A note about WYLs conjugate gradient method and its applications. Applied Mathematics and Computation. 2007; 2(191):381–8.
  • Zengxin W, Shengwei Y, Liying L. The convergence properties of some new conjugate gradient methods. Applied Mathematics and Computation. 2006; 2(183):1341–50.
  • Vaithiyanathan V, Lakshmi KD, Sundar JAK, Ahmed MI, Sangeetha V, Sivagami R. Evaluation of distance functions for the comparison of gradient orientation histograms. Indian Journal of Science and Technology. 2015 Dec; 8(35). DOI: 10.17485/ijst/2015/v8i35/86808.
  • Khairani AZ, Abd Razak N. Modeling a multiple choice mathematics test with the rasch model. Indian Journal of Science and Technology. 2015 Jun; 8(12). DOI: 10.17485/ijst/2015/v8i12/70650.
  • Jeong-Phil H, In-Ae K, Seung-Soo S. A case study of applying learning analytics in general mathematics class. Indian Journal of Science and Technology. 2015 Sep; 8(21). DOI: 10.17485/ijst/2015/v8i21/78382.
  • Chakravarthi MK, Pannem KV, NithyaV. Design and Simulation of internal model controller for a real time nonlinear process. Indian Journal of Science and Technology. 2015 Aug; 8(18). DOI0: 10.17485/ijst/2015/v8i19/76699.
  • Venkatesh SG, Ayyaswamy SK, Balachandar SR, Kannan K. Wavelet solution for class of nonlinear integro-differential equations. Indian Journal of Science and Technology. 2013 Jun; 6(6). DOI: 10.17485/ijst/2013/v6i6/33919.
  • Elizabeth DD, Jorge JM. Benchmarking optimization software with performance profiles. Mathematical Programming. 2002; 91(2):201–13.
  • Zoutendijk G. Nonlinear programming. Integer and Nonlinear Programming. 1970; 143(1):37–86.
  • Yuhong D, Jiye H, Guanghui L, Defeng S, Hongxia Y, Ya-Xiang Y. Convergence properties of nonlinear conjugate gradient methods. SIAM Journal on Optimization. 2000; 10(2):345–58.
  • Andrei N. An unconstrained optimization test functions collection. Adv Model Optim. 2008; 10(1):147–61.
  • Andrei N. Test functions for unconstrained optimization. Research Institute for informatics. Center for Advanced Modeling and Optimization; 2004. p. 1–10.

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.