Inventing new item analysis techniques for effective item bank system / Chan Yuen Fook … [et al.]

With the suggestion of abolition of centralised public examinations like the primary six UPSR in 2012 and the lower secondary three PMR in 2015 and a global trend towards decentralizing summative assessment, there is increased attention given to formative school and classroom based assessment. Therefore, to fulfil this need, this study aimed at developing and evaluating a user-friendly electronic item analysis and item banking software with the name of SuperSeTIA. At the same time, this study also sought to identify the relationships between teachers' competency (knowledge and skills), perceived usefulness, perceived ease of use, attitude and the intention to use the proposed system (SuperSeTIA) among the targeted teachers through a three stage evaluation process. In line with these objectives, a mixedmethod descriptive-correlational research design was chosen to describe the variables studied as well as the relationships between the variables of interest. Therefore, instruments such as questionnaires, semi-structured interview questions and checklists were employed to gather data pertinent to the study. The findings from this study revealed that respondents with acquired basic computer skills are ready to use a computer-based item analysis software to assist them in their tasks although their knowledge relating to the different types of item analysis software in the market are limited. The findings also suggested that there is a tendency among the respondents towards using technology when they believe that it can enhance their job performance. The final two stages of evaluation showed that SuperSETIA managed to fulfil the ease of use criteria although in the initial evaluation stage the respondents did indicate that it was difficult to use. Overall findings from three stages of evaluation indicated that even though SuperSeTIA is a new technology, the respondents held positive perception towards SuperSeTIA with moderate intention to use it. With regards to the relationships between the variables, the results suggested that perceived usefulness but not perceived ease of use, and attitude towards computer use were the most determinant factors in the intention to use technology. The perceived ease of use and intention to use SuperSeTIA were also identified at the moderate level even though there was no significant relationship identified between perceived ease of use and intention to use SuperSeTIA. These findings highlighted the positive impact of the software and respondents' positive attitude towards the software. In addition to that, this study also demonstrated that SuperSeTIA has fulfilled the basic criteria of technology acceptance model (TAM). In relation to the usefulness of SuperSeTIA, it was indicated that generally respondents were satisfied with the effectiveness criteria of the software, and the program content of the software. Majority of the respondents also agreed that the software is able to prepare teachers for real-world item analysis and teaching enhancement. Additionally, this study has helped the researchers identify some key issues related to the user interface, audience appeal, navigation and presentation of the software which proposes an enhancement to the user interface and navigation in the program. Last but not least, it is believed that with further exposure and training, SuperSETIA can be widely accepted and used among the target audience. Therefore, it is crucial for the ministry, state education departments and district education offices to work hand in hand towards promoting item analysis and ICT skills among the teachers because this on the long run, will benefit all the stakeholders and help the nation achieve its aspirations for the education sector.