Globalization of Barzilai and Borwein Method for Unconstrained Optimization

Farid, Mahboubeh (2009) Globalization of Barzilai and Borwein Method for Unconstrained Optimization. PhD thesis, Universiti Putra Malaysia.

[img] PDF
531Kb

Abstract

The focus of this thesis is on finding the unconstrained minimizer of a function. Specifically, we will focus on the Barzilai and Borwein (BB) method that is a famous two-point stepsize gradient method. First we briefly give some mathematical background. Then we discuss the (BB) method that is important in the area of optimization. A review of the minimization methods currently available that can be used to solve unconstrained optimization is also given. Due to BB method’s simplicity, low storage and numerical efficiency, the Barzilai and Borwein method has received a good deal of attention in the optimization community but despite all these advances, stepsize of BB method is computed by means of simple approximation of Hessian in the form of scalar multiple of identity and especially the BB method is not monotone, and it is not easy to generalize the method to general nonlinear functions. Due to the presence of these deficiencies, we introduce new gradient-type methods in the frame of BB method including a new gradient method via weak secant equation (quasi-Cauchy relation), improved Hessian approximation and scaling the diagonal updating. The proposed methods are a kind of fixed step gradient method like that of Barzilai and Borwein method. In contrast with the Barzilai and Borwein approach’s in which stepsize is computed by means of simple approximation of the Hessian in the form of scalar multiple of identity, the proposed methods consider approximation of Hessian in diagonal matrix. Incorporate with monotone strategies, the resulting algorithms belong to the class of monotone gradient methods with globally convergence. Numerical results suggest that for non-quadratic minimization problem, the new methods clearly outperform the Barzilai- Borwein method. Finally we comment on some achievement in our researches. Possible extensions are also given to conclude this thesis.

Item Type:Thesis (PhD)
Subject:Algorithms
Subject:Mathematical optimization
Subject:Convergence
Chairman Supervisor:Professor Malik Hj. Abu Hassan, PhD
Call Number:IPM 2009 10
Faculty or Institute:Institute for Mathematical Research
ID Code:10387
Deposited By: Mohd Nezeri Mohamad
Deposited On:31 Mar 2011 08:18
Last Modified:27 May 2013 07:45

Repository Staff Only: Edit item detail

Document Download Statistics

This item has been downloaded for since 31 Mar 2011 08:18.

View statistics for "Globalization of Barzilai and Borwein Method for Unconstrained Optimization"


Universiti Putra Malaysia Institutional Repository

Universiti Putra Malaysia Institutional Repository is an on-line digital archive that serves as a central collection and storage of scientific information and research at the Universiti Putra Malaysia.

Currently, the collections deposited in the IR consists of Master and PhD theses, Master and PhD Project Report, Journal Articles, Journal Bulletins, Conference Papers, UPM News, Newspaper Cuttings, Patents and Inaugural Lectures.

As the policy of the university does not permit users to view thesis in full text, access is only given to the first 24 pages only.