Hybrid portfolio optimization with pca, clustering, and the barzilai-borwein method

Kai, Shin Chiew and Wei, Yeing Pan and Hong, Seng Sim and Jia, Hou Chin and Yap, Jia Lee (2026) Hybrid portfolio optimization with pca, clustering, and the barzilai-borwein method. Malaysian Journal of Computing (MJoC), 11 (1): 5. pp. 2391-2406. ISSN 2600-8238
Identification Number (DOI): 10.24191/mjoc.vo11i1.9078
Abstract

Portfolio optimization aims to balance risk and return by identifying an effective mix of assets. In this study, we integrate principal component analysis (PCA) and hierarchical clustering for stock selection with the Barzilai–Borwein (BB) gradient method for portfolio optimization. Forty-eight U.S. stocks from the Kaggle fundamental stock dataset were initially collected, and 42 stocks were retained after preprocessing. Financial ratios from 2006 and adjusted closing prices from 2016–2017 were analysed, with one representative stock from each cluster selected using the Sharpe ratio. The BB method was then applied to determine optimal weights, ensuring full capital allocation without short selling. Among the tested approaches, the Barzilai–Borwein gradient method 1 (BB1) step size achieved strong performance, producing an annual return of 25.6% while maintaining relatively low volatility. The portfolio also generated a Jensen’s alpha of 1.55, confirming the presence of positive abnormal returns beyond market expectations. These results suggest that combining PCA-based clustering with the BB optimization method offers a practical and efficient way to construct diversified portfolios. The study highlights the BB algorithm’s potential as a lightweight yet effective alternative to more complex optimization techniques in financial decision-making.

Item Details
Edit Item
Edit Item
Downloads & Files
[thumbnail of 136301.pdf]
Text
136301.pdf
Download (624kB)
Indexing & Metrics