How ready are students to use ChatGPT? A study on instrument validity and reliability

Mohd Noh, Muhammad Naim and Mustafa, A’dillah and Baharuddin, Kasmarini (2025) How ready are students to use ChatGPT? A study on instrument validity and reliability. Journal of Information and Knowledge Management (JIKM), 15 (2): 11. pp. 134-161. ISSN ISSN:2231-8836 ; E-ISSN:2289-5337

Official URL: https://journal.uitm.edu.my/ojs/index.php/JIKM

Identification Number (DOI): 10.24191/jikm.v15i2.9051

Abstract

This study reports the construct validity and reliability of an instrument designed to measure students’ behavioural intention to use ChatGPT. The instrument is developed based on the Unified Theory of Acceptance and Use of Technology (UTAUT) model. Data were collected from 65 undergraduate students of the Faculty of Information Management at UiTM Puncak Perdana using proportionate stratified sampling. Analyses conducted with SPSS and Smart PLS confirmed that the instrument demonstrated acceptable construct validity and moderate reliability. Internal consistency values included Cronbach’s alpha (0.810–0.929), composite reliability (0.70–0.90), and average variance extracted above 0.50. Model accuracy and relevance (R² and Q²) were within acceptable and moderate ranges, with no collinearity issues detected. Content validity was further established using CVI, S-CVI, and S-CVI/Ave, which exceeded 0.80, indicating strong agreement. Overall, the instrument achieved robust validity and reliability, offering a useful inventory for future research on ChatGPT adoption in education.

Metadata

Item Type: Article
Creators:
Creators
Email / ID Num.
Mohd Noh, Muhammad Naim
UNSPECIFIED
Mustafa, A’dillah
adillah973@uitm.edu.my
Baharuddin, Kasmarini
UNSPECIFIED
Subjects: L Education > LB Theory and practice of education > Teaching (Principles and practice) > Instructional systems > Computers in education. Electronic data processing > Computer assisted instruction. Programmed instruction > Malaysia
L Education > LB Theory and practice of education > Teaching (Principles and practice) > Computer network resources. Internet in education. Web-based instruction
Divisions: Universiti Teknologi MARA, Selangor > Puncak Perdana Campus > Faculty of Information Management
Journal or Publication Title: Journal of Information and Knowledge Management (JIKM)
UiTM Journal Collections: UiTM Journals > International Journal of Information and Knowledge Management (JIKM)
ISSN: ISSN:2231-8836 ; E-ISSN:2289-5337
Volume: 15
Number: 2
Page Range: pp. 134-161
Keywords: ChatGPT adoption, Behavioral intention, UTAUT model, Instrument validity, Instrument reliability
Date: October 2025
URI: https://ir.uitm.edu.my/id/eprint/128260
Edit Item
Edit Item

Download

[thumbnail of 128260.pdf] Text
128260.pdf

Download (728kB)

ID Number

128260

Indexing

Altmetric
PlumX
Dimensions

Statistic

Statistic details