Beyond Cronbach's alpha: rethinking reliability analysis in the age of digital learning

Libasin, Zuraira and Ahmad, Nurhafizah and Umar, Norazah (2025) Beyond Cronbach's alpha: rethinking reliability analysis in the age of digital learning. The New Frontiers Of E-Learning : Shaping The Future Of Education, 10. pp. 88-101. ISSN 978-629-98755-7-4

Official URL: https://appspenang.uitm.edu.my/sigcs/

Abstract

Cronbach’s alpha has been widely used to measure internal consistency in educational research due to its simplicity and ease of interpretation. However, its assumptions, such as tau equivalence, unidimensionality, and equal item contribution, are often violated in modern digital learning environments. This paper examines the limitations of Cronbach’s alpha and presents alternative approaches that better suit technology enhanced assessments, namely McDonald’s omega, Generalizability Theory, and Item Response Theory. A practical framework is proposed to guide the selection of reliability methods based on assessment characteristics. Examples from quizzes, reflective writing, and gamified simulations illustrate how these methods address specific psychometric challenges in digital contexts. The study shows that aligning reliability techniques with assessment design improves measurement accuracy, supports adaptive feedback, and enhances transparency in reporting. It concludes that adopting modern reliability approaches and investing in methodological training are essential for creating fair and valid digital assessment practices in education.

Metadata

Item Type: Article
Creators:
Creators
Email / ID Num.
Libasin, Zuraira
zuraira946@uitm.edu.my
Ahmad, Nurhafizah
nurha9129@uitm.edu.my
Umar, Norazah
norazah191@uitm.edu.my
Contributors:
Contribution
Name
Email / ID Num.
Advisor
Abd Rahman, Nor Hanim
UNSPECIFIED
Chief Editor
Othman, Jamal
UNSPECIFIED
Subjects: Q Science > QA Mathematics > Instruments and machines > Electronic Computers. Computer Science > Communication of computer science information
Divisions: Universiti Teknologi MARA, Pulau Pinang > Permatang Pauh Campus
Journal or Publication Title: The New Frontiers Of E-Learning : Shaping The Future Of Education
ISSN: 978-629-98755-7-4
Volume: 10
Page Range: pp. 88-101
Keywords: Cronbach’s alpha, McDonald’s omega, Generalizability theory
Date: September 2025
URI: https://ir.uitm.edu.my/id/eprint/132179
Edit Item
Edit Item

Download

[thumbnail of 132179.pdf] Text
132179.pdf

Download (779kB)

ID Number

132179

Indexing

Statistic

Statistic details