THE POTENTIAL OF SITUATIONAL JUDGEMENT TEST AS AN INSTRUMENT OF ETHICAL COMPETENCE ASSESSMENT: A LITERATURE REVIEW

https://doi.org/10.22146/jpki.53735

Hikmah Muktamiroh(1*), Herqutanto Herqutanto(2), Diantha Soemantri(3), Agus Purwadianto(4)

(1) Universitas Pembangunan Nasional Veteran Jakarta
(2) Faculty of Medicine, Universitas Indonesia, Jakarta - INDONESIA
(3) Faculty of Medicine, Universitas Indonesia, Jakarta - INDONESIA
(4) Faculty of Medicine, Universitas Indonesia, Jakarta - INDONESIA
(*) Corresponding Author

Abstract


Background: Agreement on the importance of teaching and assessing ethical competence as part of professionalism in medical education continues to grow. The assessments of ethical competence at the “does” level in preclinical students or a large group of resident candidates are considered less efficient and expensive. It is necessary to find an alternative form of ethical competence assessment instrument as a complementary test at the level “knows how” before being tested at the level “does.” This research proposed investigating the Situational Judgement Test (SJT) potential and obtaining evidence of the SJT as an instrument of ethical competence assessment.Methods: This study was a literature review of 39 journal articles relating to SJT, obtained through PubMed data-based and google scholar search engine.Results: There was evidence of the use of SJT to assess ethical competence. Ethical competence can be evaluated by ethical decisions making ability. SJT containing procedural skills in ethical decisions making. SJT having good values as deliberation in ethical dilemmas and idealistic ethical ideology (conative test) also exists. These findings support the evidence of potential SJT to assess ethical competence.Conclusion: SJT can be used to assess ethical competence at the level “knows how” before being tested at the level “does” based on the following reasons: SJT can contain content questions that are conative, SJT can assess the ability of ethical decision making based on an assessment of procedural knowledge related to ethical deliberation of ethical decision making in ethical dilemmas.

Keywords


situational judgement test, ethical competence, assessment

Full Text:

PDF


References

1.Pengurus Besar Ikatan Dokter Indonesia. Kode Etik Kedokteran Indonesia. 2012. ISBN:978-602-18831-3-6

2.Indonesia Konsil Kedokteran. Standar Kompetensi Dokter Indonesia. 2012. p 5-6. ISBN: 979-15546-4-1

3.Amin Z, Seng CY, Eng KH. Practical guide to medical student assessment. National University of Singapore. World Scientific Publishing Co. Pte. Ltd. 2006; ISBN. 981-256-808-5

4.Schubert S, Ortwein H, Dumitsch A, Schwantes U, Wilhelm O, Kiessling C.A situational judgement test of professional behaviour : development and validation. Med Teach. 2008; 30(5):528–33

5.urwadianto A. Segi Kontekstual Pemilihan Prima Facie Kasus Dilema Etik dan Penyelesaian Kasus Konkrit Etik. In: Prosiding Pertemuan Nasional III Bioetika dan Humaniora Kesehatan Indonesia, FKUI, Jakarta, 30 Nopember-2 Desember 2004.

6.Kaldjian LC, Weir RF, Duffy TP. A clinician’s approach to clinical ethical reasoning. J Gen Intern Med. 2005;20(3):306–11.

7.Siegler Josen. Josen Siegler [Internet]. New York: Mc Graw – Hill; 2010. Available from: https://accessmedicine.mhmedical.com/book.aspx?bookID=1521

8.Patterson F, Knight A, Dowell J, Nicholson S, Cousans F, Cleland J. How effective are selection methods in medical education? A systematic review. Med Educ. 2016;50(1):36–60.

9.Affleck P, Bowman M, Wardman M, Sinclair S, Adams R. Can we improve on situational judgement tests ? British Dental Journal 2016;220(1):9–10. Available from: http://dx.doi.org/10.1038/sj.bdj.2016.17

10.Cabrera MAM, Nguyen NT. Situational Judgment Tests: A Review of Practice and Constructs Assessed. Int J Sel Assess. 2001;9(1&2):103–13.

11.Christian MS, Edwards BD, Bradley JC. Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities. Pers Psychol. [internet] 2010;63(1):83–117. [cited 2019 Dec 3]. Available from: http://www.journals.plos.org

12. Stagl K. The Construct Validity Of A Situational Judgment Test In A Maximum Performance Context. Doctoral Dissertation (Open Access). University of Central Florida. 2006.

13. Patterson F, Zibarras L, Ashworth V. Situational judgement tests in medical education and training : Research , theory and practice : AMEE Guide No . 100. 2016;(100):3–17.

14. Weekley JA, Jones C. Video-based situational testing. Pers Psychol.[internet] 1997; 50 (1):25-49 [cited 2019 Dec 3]. Available from: http://www.onlinelibrary.wiley.com.

15. Patterson F, Cousans F, Edwards H, Rosselli A, Nicholson S, Wright B. The Predictive Validity of a Text-Based Situational Judgment Test in Undergraduate Medical and Dental School Admissions. Acad Med. [internet] 2017;92(9):1250–3. [cited 2019 Dec 3]. Available from: http://www.onlinelibrary.wiley.com

16. Schreurs S, Cleutjens K, Collares CF, Cleland J, oude Egbrink MGA. Opening the black box of selection. Adv Heal Sci Educ [Internet]. 2019; Available from: https://doi.org/10.1007/s10459-019-09925-1

17. Sharma N, Nagle YK. Development of pictorial situational judgement test of affect. Scientific Research Publishing Psychology. 2015;6 (4):400–8. Available from: http://www.tandfonline.com.

18. Corstjens J, Lievens F, Krumm S. Situational judgement tests for selection in Handbook of the Psychology of Recruitment, Selection and Employee Retention, Wiley Blackwell Pub. First Ed. [internet] 2017;(May). [cited 2019 Dec 3]. Available from: https://www.researchgate.net/publication/319234343

19. Colbert-Getz JM, Pippitt K, Chan B. Developing a situational judgment test blueprint for assessing the non-cognitive skills of applicants to the University of Utah School of Medicine, the United States. J Educ Eval Health Prof. 2015 Oct 31;12:51.

20. De Leng WE, Stegers-Jager KM, Born MP, Themmen APN. Influence of response instructions and response format on applicant perceptions of a situational judgement test for medical school selection. BMC Med Educ. 2018;18(1):1–10.

21. Bledow R, Frese M.. A Situational judgement test of personal initiative and its relationship to performance. Personnel Psychology. [internet] 2009; 62(2):229–58. [cited 2019 Dec 3]. Available from: http://www.tandfonline.com.

22. Lievens F. Adjusting medical school admission: Assessing interpersonal skills using situational judgement tests. Med Educ. [internet] 2013 Feb: 47(2):182-89. [cited 2019 Dec 3]. Available from: http://www.tandfonline.com.

23. Patterson F, Ashworth V, Zibarras L, Coan P, Kerrin M, Neill PO. Evaluations of situational judgement tests to assess non-academic attributes in selection. Med Ed. [internet] 2012 Sep;46(9):850-68. [cited 2019 Dec 3]. Available from: http://www.tandfonline.com.

24. Passi V, Doug M, Peill Ed, Thistlethwaite J, Johnson N. Developing medical professionalism in future doctors: a systematic review. Int. J. Medical Education. 2010; 1:19-29. ISSN: 2042-6372 DOI: 10.5116/ijme.4bda.ca2a

25. Burgess A, Roberts C, Clark T, Mossman K. The social validity of a national assessment centre for selection into general practice training. BMC Med Educ. [internet] 2014;9:261. [cited 2019 Dec 3]. Available from: http://www.dovepress.com.

26. Wolcott MD, Lupton-Smith C, Cox WC, McLaughlin JE. A 5-Minute Situational Judgment Test to Assess Empathy in First Year Student Pharmacists. Am J Pharm Educ. [internet] 2018;83(6):ajpe6960. [cited 2019 Dec 3]. Available from: http://www.hexaco.org.

27. Koczwara A, Patterson F, Zibarras L, Kerrin M, Irish B, Wilkinson M. Evaluating cognitive ability , knowledge tests and situational judgement tests for postgraduate selection. Med Educ 2012 Apr;46(4):399-408

28. Cousans F, Patterson F, Edwards H, Walker K, McLachlan JC, Good D. Evaluating the complementary roles of an SJT and academic assessment for entry into clinical practice. Adv Heal Sci Educ. 2017;22(2):1–13.

29. Patterson F, Ashworth V, Zibarras L, Coan P, Kerrin M, Neill PO. Evaluations of situational judgement tests to assess non-academic attributes in selection. Med Ed. 2012 Sep;46(9):850-68

30. Patterson F, Rowett E, Hale R, Grant M, Roberts C, Cousans F, et al. The predictive validity of a situational judgement test and multiple-mini interview for entry into postgraduate training in Australia. BMC Med Educ. 2016;1–8.

31. Roberts C, Clark T, Burgess A, Frommer M, Grant M, Mossman K. The validity of a behavioural multiple-mini-interview within an assessment centre for selection into specialty training. BMC Med Educ. 2014;14:1–11.

32. Ismail J, Patel AB. Is the Situational Judgement Test a fair way for assesing candidates applying to the United Kingdom Foundation Programme? Adv Med Educ Pract. 2015;12(1):42–5.

33. Husbands A, Rodgerson MJ, Dowell J, Patterson F. Evaluating the validity of an integrity-based situational judgement test for medical school admissions. BMC Med Educ [Internet]. 2015;15(1):0–9. Available from: http://dx.doi.org/10.1186/s12909-015-0424-0

34. De Leng WE, Stegers-Jager KM, Husbands A, Dowell JS, Born MP, Themmen APN. Scoring method of a Situational Judgment Test: influence on internal consistency reliability, adverse impact and correlation with personality? Adv Heal Sci Educ. 2017;22(2):243–65.

35. Lievens F, Sackett PR. The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance. J Appl Psychol. 2012;97(2):460–8.

36. Motowidlo SJ, Beier ME. Differentiating Specific Job Knowledge From Implicit Trait Policies in Procedural Knowledge Measured by a Situational Judgment Test. J Appl Psychol 2010 Mar;95(2):321-33. doi: 10.1037/a0017975.

37. Motowidlo SJ, Ghosh K, Mendoza AM, Buchanan AE, Lerma MN. A context-independent situational judgment test to measure prosocial implicit trait policy. Hum Perform. 2016;29(4):331–46.

38. Gartmeier M, Baumgartner M, Burgkart R, Heiniger S, Berberat PO. Why hand hygiene is not sufficient: Modeling hygiene competence of clinical staff as a basis for its development and assessment. GMS J Med Educ. 2019;36(4):1–21.

39. Olaru G, Burrus J, MacCann C, Zaromb FM, Wilhelm O, Roberts RD. Situational judgment tests as a method for measuring personality: Development and validity evidence for a test of dependability. PLoS One. 2019;14(2):1–19.

40. de Leng WE, Stegers-Jager KM, Born MP, Themmen APN. Integrity situational judgement test for medical school selection: judging ‘what to do’ versus ‘what not to do.’ Med Educ. [internet] 2018;52(4):427–37. [cited 2019 Dec 3]. Available from: http:// http://www.onlinelibrary.wiley.com

41. Catano VM, Brochu A, Lamerson CD. Assessing the Reliability of Situational Judgment Tests Used in High-Stakes Situations. Int J Sel Assess. [internet] 2006;20(3). [cited 2019 Dec 3]. Available from: http://www.tandfonline.com.

42. McDaniel MA, Hartman NS, Whetzel DL GW. Situational judgement test, response instruction , and validity : A meta-analysis. Pers Psychol. 2007 Feb;60 (1):63–91.

43. Patterson F, Lievens F, Munro N, Irish B. The predictive validity of selection for entry into postgraduate training in general practice : evidence from three longitudinal studies. Br J Gen Pract. [internet] 2013;(November):734–41. [cited 2019 Dec 3]. Available from: http://www.onlinelibrary.wiley.com

44. Buyse T, Lievens F. Situational Judgment Tests as a New Tool for Dental Student Selection. J Dent Educ. [internet] 2011;75(June):743–9. [cited 2019 Dec 3]. Available from: http://www.onlinelibrary.wiley.com

45. Lievens F, Peeters H, Schollaert E, Lievens F, Peeters H, Schollaert E. Situational judgment tests : A review of recent research. Pers Rev. 2008;37(4):426–41.

46. Cullen MJ, Sackett PR, Lievens F. Threats to the operational use of situational judgment tests in the college admission process. Int J Sel Assess. 2006;14(2):142–55.

47. University College London Careers service. Preparation for Practice. Situational Judgement Test Workshop. 4 th August 2014.

48. Suseno FM. Etika Dasar. Jakarta: Kanisius; 1987.

49. Bahrudin M. Relativisme Etika dalam Dunia Profesional. Researchgate. 2018;(August).



DOI: https://doi.org/10.22146/jpki.53735

Article Metrics

Abstract views : 5005 | views : 3881

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Hikmah Muktamiroh, Herqutanto, Diantha Soemantri, Agus Purwadianto

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Jurnal Pendidikan Kedokteran Indonesia (The Indonesian Journal of Medical Education) indexed by:

  

 JPKI Stats