EVALUATING THE USE OF MCQ AS AN ASSESSMENT METHOD IN A MEDICAL SCHOOL FOR ASSESSING MEDICAL STUDENTS IN THE COMPETENCE-BASED CURRICULUM

Mitayani Purwoko; Trisnawati Mundijo

doi:10.22146/jpki.35544

EVALUATING THE USE OF MCQ AS AN ASSESSMENT METHOD IN A MEDICAL SCHOOL FOR ASSESSING MEDICAL STUDENTS IN THE COMPETENCE-BASED CURRICULUM

https://doi.org/10.22146/jpki.35544

Mitayani Purwoko^(1*), Trisnawati Mundijo⁽²⁾

(1) Fakultas Kedokteran Universitas Muhammadiyah Palembang, Palembang - INDONESIA
(2) Fakultas Kedokteran Universitas Muhammadiyah Palembang, Palembang - INDONESIA
(*) Corresponding Author

Abstract

Background: Student’s cognitive ability could be assessed using MCQ. The aim of this study was to evaluate the quality of MCQ as an assessment method in Medical Faculty of Muhammadiyah University Palembang.

Method: This study was designed as a cross sectional descriptive observational study. Sample was MCQ assessment in Genetics and Molecular Biology Module for academic year 2013/2014 until 2015/2016 for total 299 questions. Item analysis was done manually.

Results: The item analysis showed that 61.2% questions were recall-type question. This situation showed that the construction of the question was not good and only testing the lower cognitive area. There was 45.2% ideal question with 30-70% difficulty index and 23.1% questions whom distractor efficiency was 100%. Half of the questions (56.2%) should be revised. This revision-needed questions distributed equally into easy, ideal, and hard level of difficulty. Revision-needed questions had lower distractor efficiency mean compared to good questions.

Conclusion: MCQ as an assessment method do not reach maximum target yet because there were many questions that should be revised. Faculty should enhance the development of the lecturer in writing the good MCQs.

Keywords

MCQ, Cognitive assessment, Item analysis

Full Text:

PDF

References

Amin Z, Eng KH. Basics in medical education. Singapore: World Scientific Publishing Co. Pte. Ltd. 2003.
Kim MK, Patel RA, Uchizono JA, Beck L. Incorporation of Bloom’s taxonomy into multiple-choice examination question for a pharmacotherapeutics course. American Journal of Pharmaceutical Education. 2012: 76(6): 1-8.
Palmer EJ dan Devitt PG. Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper. BMC Medical Education. 2007;7(49):1-7.
Baig M, Ali SK, Ali S, Huda N. Evaluation of multiple choice and short essay question items in basic medical sciences. Pak J Med Sci. 2014:30(1):3-6.
Zafar-Khan M, Aljarallah BM. Evaluation of Modified Essay Question (MEQ) and Multiple Choice Question (MCQ) as a tool for assessing the cognitive skills of undergraduate medical students. IJHS. 2011:5(1):39-43.
Gajjar S, Sharma R, Kumar P, dan Rana M. Item and test analysis to identify quality Multiple Choice Questions (MCQs) from an assessment of Medical students of ahmedabad, Gujarat. Indian J Community Med. 2014 Jan-Mar; 39(1):17-20. doi: 10.4103/0970-0218.126347
Sim SM dan Rasiah RI. Relationship Between Item Difficulty and Discrimination Indices in True/False-Type Multiple Choice Questions of a Para-clinical Multidisciplinary Paper. Ann Acad Med Singapore. 2006;35:67-71.
Abdulghani HM, Ahmad F, Irshad M, Khalil MS, Al-Shaikh GK, Syed A, et al. Faculty development programs improve the quality of Multiple Choice Questions items’ writing. Scientific Reports. 2015:5:9556. doi:10.1038/srep09556
Kilgour JM, Tayyaba S. An investigation into the optimal number of distractors in single-best answer exams. Adv Health Sci Educ Theory Pract. 2016:21;571-85.
Collins J. Writing multiple-choice questions for continuing medical education activities and self-assessment modules. RadioGraphics. 2006:26(2):543-51. doi: http://dx.doi.org/10.1148/rg.262055145