Study Concurrent Validity Antara script Consordance Test (SCT dan Multiple Choice Questions (MCQ) dalam Menilai Penalaran Klinik Mahasiswa Kedokteran

Yeny Dyah Cahyaningrum; Gandes Retno Rahayu; Efrayim Suryadi

doi:10.22146/jpki.25376

Study Concurrent Validity Antara script Consordance Test (SCT dan Multiple Choice Questions (MCQ) dalam Menilai Penalaran Klinik Mahasiswa Kedokteran

https://doi.org/10.22146/jpki.25376

Yeny Dyah Cahyaningrum^(1*), Gandes Retno Rahayu⁽²⁾, Efrayim Suryadi⁽³⁾

(1) Fakultas Kedokteran Universitas Islam Indonesia
(2) Departemen Pendidikan Kedokteran, Fakultas Kedokteran Universitas Gadjah Mada
(3) Departemen Pendidikan Kedokteran, Fakultas Kedokteran Universitas Gadjah Mada
(*) Corresponding Author

Abstract

Background: In the teaching process at medical faculty, there are many measuring devices have been used to evaluate the clinical reasoning ability. Each measuring device has the advantage and disadvantage. MCQ and SCT are the clinical reasoning measuring device. In the previous study, both methods have been validated. SCT is a more recent method to measure clinical reasoning compared to MCQ. This study aims to evaluate the concurrent validity between MCQ and SCT.

Method: Forty-three students who had already passed the Paediatric clinical rotation were asked to complete 100 items of MCQ. The next day, they did 100 items of SCT. The concurrent validity is measured using correlation analysis.

Results: Concurrent validity between MCQ and SCT did not show strong correlation (coefficient of rank spearman correlation= 0.291 with the probability = 0.058).

Conclusion: Concurrent validity between MCQ and SCT do not have strong correlation in evaluating the clinical reasoning. SCT is used as complement to evaluation of clinical reasoning in order to be more specific and close to real setting.

Keywords

Concurrent validity, script concordance test, multiple choice question, clinical reasoning

Full Text:

PDF

References

Higgs J, Jones M. Clinical Reasoning in the medical profession. Butterworth Heinemann: Elsevier; 2000.
Rahayu GR, McAleer. Clinical reasoning of Indonesian medical students as measured by diagnostic thinking inventory. South East Asian Journal of Medical Education, 2008;2(1):42-7.
Lee A, Joynt GM, Lee AKT, Groves M, Vlantis AC, Ronald CW, Colman SC, Cindy ST. Using illness script to teach clinical reasoning skill to medical students, Fam Med; 2010;42(4):255-61.
Vleuten C, Charlin B, Roy L, Brailovsky C, Goulet F. The script concordance test: a tool to assess the reflective clinician. Teaching and Learning in Medicine, 2000;12(4):189-95.
Sibert L, Darmoni SJ, Dahamna B, Weber J, Charlin B. Online clinical reasoning assessment with the Script Concordance test: a feasibility study. BMC Medical Informatics and Decision Making, 2005;5:18.
Sibert L, Giorgi R, Dahamna B, Doucet J, Charlin B, Darmoni SJ. Is a web-based concordance test feasible to assess therapeutic decision-making skills in a French context? Medical Teacher, 2009;31(4):e162-8.
Miller D, Linn RL, Gronlund NE. Measurement and assessment in teaching. Pearson education Internasional; 2009.
Elstein AS. Beyond multiple choice question and essay: the need for a new Gossway to assess clinical competence, Academic Medicine, 1993;68(4):244-9.
Sibert L, Charlin B, Corcos J, Gagnon R, Grisse P, Vleuten CVD. Stability of clinical reasoning assessment result with the script concordance test across two different linguistic, cultural, and learning environments. Medical Teacher, 2002;24(5):522-7.
Hernandez SZ, Rodriguez MC, Lopez VO, Montero RE, Cordoba AR. Validation of the script concordance test as an instrument to assess clinical reasoning of residents in pediatric emergency medicine in mexico. Bol Med Hosp Infant Mex, 2011;68(5):369-73.
Duggan P. Development of script concordance test using an electronic voting system. Ergo, 2007;1:35-41.
Charlin B, Roy L, Brailovsky C, Goulet F. The Script concordance test: A tool to assess the reflective clinician. Teaching and Learning in Medicine, 2000;12(4):189-95.
Duggan P, Charlin B. Summative assessment of 5th year medical students’ clinical reasoning by script concordance test:requirement and challenges. BMC Medical Education, 2012;12(29).
Lubarsky S, Charlin B, Cook DA, Chalk C. Sript concordance testing: a review of published validity evidence. Medical Education, 2011;45:329-38.
Ayre C, Scally AJ. Critical values for lawshe content validity ratio: Revisiting the original methods of calculation. Measurement and Evaluation in Counseling Development, 2014;47(1):79-86.
Lambert D, Lines D. Understanding Assessment, Purpose, Perceptions, Practice. Routledge Falmer; 2000.
Cohen AS, Wollack JA. Helpful tips for creating reliabel and valid classroom test: getting started—The test blueprint. The Learning Link, 2003;3(4):1-2.
Considine J, Botti M, Thomas S. Design, format, validity and reliability of multiple choice questions for use in nursing research and education. Collegian, 2005;12(1):19-24.
Lubarsky S, Dory VR, Duggan P, Gagnon R, Charlin B. Script concordance testing: from theory to practise: AMEE guide no 75. Medical Teacher, 2013;35:184-93.
Coderrre SP, Harasym P, Mandin H, Fick G. The impact of two multiple choice-question formats on the problem solving strategies used by novices and expert. BMC Medical Education, 2004;4:23.
Kelly WF, Durning S, Denton GD. Comparing a Script Concordance Examination to a Multiple-Choice Examination on a Core Internal Medicine Clerkship. Teaching and Learning in Medicine, 2008;24(3):187-93.
Charlin B, Brailovsky C, Leduc C, Blouin D. The diagnosis script questionnaire: A new tool to assess a spesific dimension of clinical competence. Advances in Health Science Education, 1998;3:51-8.
Kania RE, Verrilaud B, Tran H, Gagnon R, Kazitani D, Huy PTB, Herman P, Charlin B. Online script concordance test for clinical reasoning assessment in otorhinolaryngology: the association between performance and clinical experience. Arch Otorhinolaryngology Head Neck Surg, 2011;137(8):751-5.