Optimization plays an important role in solving unconstrained optimization problems that arise in various scientific and engineering applications. Among the available optimization techniques, the conjugate gradient (CG) method is widely used due to its low memory requirement and computational efficiency. The performance of the CG method is highly influenced by the selection of the conjugate gradient coefficient and the line search strategy. This study aims to implement selected classical CG methods, namely Hestenes–Stiefel (HS), Polak–Ribière–Polyak (PRP), and Belloufi–Rahali–Benzine (BRB). These methods use the Armijo inexact line search for solving unconstrained optimization problems. The methods were implemented and tested on a collection of 20 benchmark optimization problems with different dimensions and initial points. Their performance was evaluated based on the number of iteration and CPU time. The numerical results were analysed using performance profiles to compare the efficiency of the three methods. The findings indicate that the HS method consistently outperformed the PRP and BRB methods by solving a larger proportion of test problems with fewer iterations and shorter times. Hence, the HS method is considered the most efficient and reliable among the selected methods under the Armijo inexact line search. This study demonstrates the effectiveness of classical CG methods in unconstrained optimization and provides a useful reference for future research on optimization algorithms.
| Item Type: | Article |
|---|---|
| Creators: | Creators Email / ID Num. Hasbullah, Siti Nur’Ain snrainnz@gmail.com Abdul Ghani, Nur Hamizah hamizahghani@uitm.edu.my Wan Sulaiman, Wan Khadijah wankhadijah@uitm.edu.my |
| Subjects: | Q Science > QA Mathematics Q Science > QA Mathematics > Algebra |
| Divisions: | Universiti Teknologi MARA, Shah Alam > Faculty of Computer and Mathematical Sciences |
| Journal or Publication Title: | Mathematics Letters |
| UiTM Journal Collections: | Other UiTM Journals > Mathematics Letters |
| ISSN: | eISSN: 2948-3735 |
| Volume: | 5 |
| Number: | 2 |
| Page Range: | pp. 97-109 |
| Keywords: | Armijo inexact line search, Classical conjugate gradient method, Hestenes-stiefel method |
| Date: | 31 October 2026 |
| URI: | https://ir.uitm.edu.my/id/eprint/149389 |
149389.pdf
