UPM Institutional Repository

Preconditioning on subspace quasi-Newton method for large scale unconstrained optimization


Citation

Sim, Hong Seng and Leong, Wah June and Ismail, Fudziah (2013) Preconditioning on subspace quasi-Newton method for large scale unconstrained optimization. In: Statistics and Operational Research International Conference (SORIC 2013), 3–5 Dec. 2013, Sarawak, Malaysia. (pp. 297-305).

Abstract

Recently, subspace quasi-Newton (SQN) method has been widely used in solving large scale unconstrained optimization. Besides constructing sub-problems in low dimensions so that the storage requirement as well as computational cost can be reduced, it can also be implemented extremely fast when the objective function is a combination of computationally cheap non-linear functions. However, the main deficiency of SQN method is that it can be very slow on certain type of non-linear problem. Hence, a preconditioner which is computationally cheap and is a good approximation to the actual Hessian is constructed to speed up the convergence of the quasi-Newton methods since the evaluation of the actual Hessian is considered as impractical and costly. For this purpose, a diagonal updating matrix has been derived to replace the identity matrix in approximating the initial inverse Hessian. The numerical results show that the preconditioned SQN method performs better than the standard SQN method that without preconditioning.


Download File

[img]
Preview
PDF (Abstract)
Preconditioning on subspace quasi-Newton method for large scale unconstrained optimization.pdf

Download (36kB) | Preview

Additional Metadata

Item Type: Conference or Workshop Item (Paper)
Divisions: Faculty of Science
DOI Number: https://doi.org/10.1063/1.4894354
Publisher: AIP Publishing LLC
Keywords: Preconditioned; Subspace method; Quasi-Newton method; Large scale; Unconstrained optimization
Depositing User: Nabilah Mustapa
Date Deposited: 26 Sep 2017 04:09
Last Modified: 26 Sep 2017 04:09
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.1063/1.4894354
URI: http://psasir.upm.edu.my/id/eprint/57355
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item