Analyzing the quality of artificial intelligence final examination questions according to bloom's taxonomy and syllabus contents / Syazatul Nor Azah Mohamed Mahtar

As the technology of Artificial Intelligence (AI) expanded widely, AI has been used in many fields. It has become one of the most critical courses in the area of Computer Science and thus being offered in many universities worldwide. To ensure Al knowledge is mastered well by students, their understanding on this course should be measured efficiently. To achieve this, the preparations of the examination questions should follow certain guidelines or requirements for example the syllabus contents and the Bloom's Taxonomy model. The main objective of this project is to develop a system that acts as an analyzer to analyze the quality of the final examination question papers according to the Bloom's Taxonomy and syllabus contents. In UiTM, the process of analyzing the final examination question papers is currently done manually by the Examination Unit staff. Problems can occur because there are many sets of final examination questions at one time and obviously a manual check will not give a 100% accurate results. Therefore, there is a need of a system that can analyze the quality of the final examination questions according to the syllabus contents and Bloom's Taxonomy model. The methods used in this proposed project are the Fuzzy Logic and Keyword Matching Technique. Fuzzy Logic is used to classify the keywords to six different levels in Bloom's Taxonomy model and different topics in the Fundamentals of Artificial Intelligence course (UiTM Computer Science Degree Programme). The Keyword Matching Technique is used to find the matching keyword in the proposed final examination questions. The keyword found in the final examination questions were compared with the keyword of Bloom's Taxonomy and syllabus contents that were stored in the database. After that, the compliance percentage of the final examination questions based on the Bloom's Taxonomy model and syllabus contents were generated. High quality final examination question papers will follow closely the Bloom's Taxonomy and have a fair distribution of questions based on the syllabus contents. In this project, it was observed that Bloom's Taxonomy conformity percentage results for the analyzed examination questions papers did not obtain high percentages. As for the syllabus contents result, not any of the proposed examination papers have a fair distribution of questions based on syllabus contents.