Mitigating imbalanced classification problems in academic performance with resampling methods / A’zraa Afhzan Ab Rahim and Norlida Buniyamin

Ab Rahim, A’zraa Afhzan and Buniyamin, Norlida (2023) Mitigating imbalanced classification problems in academic performance with resampling methods / A’zraa Afhzan Ab Rahim and Norlida Buniyamin. Journal of Electrical and Electronic Systems Research (JEESR), 23 (1): 6. pp. 45-56. ISSN 1985-5389

Abstract

The imbalanced dataset is a common problem in the educational performance environment, where the number of students with poor performance is much less than those who perform well. This can create problems when predicting academic performance using machine learning algorithms, which assume that the datasets have a balanced distribution across all classes. We compared three resampling methods: SMOTE, Borderline SMOTE, and ADASYN, and used five different classifiers (Logistic Regression, Support Vector Machine, Naïve Bayes, KNearest Neighbor, and Decision Tree) on three imbalanced educational datasets. We used five-fold cross-validation to assess two performance indicators: accuracy and recall. Although accuracy indicates the overall performance, we focus more on recall values because it is more incumbent to identify poorperforming students so that necessary interventions can be executed promptly. Our results showed that when resampling improved recall values, ADASYN outperforms SMOTE and Borderline SMOTE consistently, better classifying the poorperforming students. Overall, our results suggest that resampling methods can be effective in addressing the problem of imbalanced classification in academic performance. However, the choice of resampling method should be carefully considered, as the performance of different methods can vary depending on the classifier used.

Metadata

Item Type: Article
Creators:
Creators
Email / ID Num.
Ab Rahim, A’zraa Afhzan
azraa@uitm.edu.m
Buniyamin, Norlida
nbuniyamin@uitm.edu.my
Subjects: Q Science > Q Science (General) > Machine learning
Q Science > QA Mathematics > Evolutionary programming (Computer science). Genetic algorithms
Divisions: Universiti Teknologi MARA, Shah Alam > College of Engineering
Journal or Publication Title: Journal of Electrical and Electronic Systems Research (JEESR)
UiTM Journal Collections: UiTM Journal > Journal of Electrical and Electronic Systems Research (JEESR)
ISSN: 1985-5389
Volume: 23
Number: 1
Page Range: pp. 45-56
Keywords: Academic performance, imbalanced classification, machine learning, resampling algorithms
Date: October 2023
URI: https://ir.uitm.edu.my/id/eprint/86029
Edit Item
Edit Item

Download

[thumbnail of 86029.pdf] Text
86029.pdf

Download (733kB)

ID Number

86029

Indexing

Statistic

Statistic details