Development and Validity and Reliability Tests of Professionalism Assessment Instrument in Psychiatry Residents

Budi Santoso(1*), Carla Raymondalexas Marchira(2), P. Sumarni(3)

(1) Department of Psychiatry, Faculty of Medicine, Universitas Gadjah Mada - Indonesia
(2) Department of Psychiatry, Faculty of Medicine, Universitas Gadjah Mada - Indonesia
(3) Department of Psychiatry, Faculty of Medicine, Universitas Gadjah Mada - Indonesia
(*) Corresponding Author


Background: The main objective of specialist training program is professionalism and competence. In modern era, the medical professions have to face legal issues. This problem can be overcome by improving professionalism education and routine evaluation of professionalism during specialist training. Psychiatric specialist training in particular is different from other specialist training due to several unique aspects during the course of the training. Therefore, an instrument to assess professionalism of psychiatric residents is required. The objective of this study was to develop an instrument to assess professionalism for psychiatric residents adapted from ACGME (Accreditation Council for Graduate Medical Education).

Method: This study was a quantitative non-experimental study consisted of 3 stages (literature review, peer review, and validity and reliability testing). The subjects were residents on training at the Department of Psychiatry, Medical Faculty, Gadjah Mada University. The construct validity testing was conducted with Confimatory Factor Analysis (CFA) and content validity with Pearson’s product moment. Reliability testing was conducted with Cronbach’s alpha.

Results: Statistical analyses results showed that instrument was valid (Pearson’s product moment r = 0.302 – 0.797; p = 0.001 – 0.052) and reliable (Cronbach’s alpha = 0.943). Analyses on the subjects score revealed that professionalism was associated with the stage of training. The t-test results showed that subjects in the post-stasis stage showed higher professionalism score except for the 4th domain (professional behavior).

Conclusion: The instrument that developed was valid and reliable to be use as a mean to assess professionalism for resident in training at the Department of Psychiatry, Medical Faculty, Gadjah Mada University.


Instrument, professionalism, resident, validity, reliability

Full Text:



  1. Konsil Kedokteran Indonesia. Peraturan Konsil Kedokteran Indonesia No 11 Tahun 2011 Tentang Standar Kompetensi Dokter Indonesia. Jakarta; 2012.
  2. Lapid M, Moutier C, Dunn L, Hammond KG, Roberts LW. Professionalism and Ethics Education on Relationships and Boundaries: Psychiatric Residents’ Training Preferences. Acad. Psychiatry, 2009;33:461-9. doi:10.1176/appi.ap.33.6.461
  3. Nelson WA. Handbook for rural health care ethics: A practical guide for professionals. University Press of New England; 2009.
  4. Passi V, Doug M, Peile E, Thistlethwaite J, Johnson N. Developing medical professionalism in future doctors: a systematic review. Int. J. Med. Educ., 2010;1:19–29. doi:10.5116/ijme.4bda.ca2a
  5. The Accreditation Council for Graduate Medical Education And The American Board of Psychiatry and Neurology. The Psychiatry Milestone Project. A Joint Initiative; 2015.
  6. Azwar S. Dasar-Dasar Psikometri. Pustaka Pelajar. Yogyakarta; 2005.
  7. Brown JD. The Cronbach alpha reliability estimate. Shiken JALT Test. Eval. SIG Newsl., 2002;6:17–19.
  8. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int. J. Med. Educ., 2011;2:53-5. doi:10.5116/ijme.4dfb.8dfd
  9. Muchlas M. Perilaku Organisasi. Yogyakarta: Gadjah Mada University Press; 2008.


Article Metrics

Abstract views : 3836 | views : 8101


  • There are currently no refbacks.

Copyright (c) 2017 Budi Santoso, Carla Raymondalexas Marchira, P. Sumarni

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Jurnal Pendidikan Kedokteran Indonesia (The Indonesian Journal of Medical Education) indexed by:

JPKI Stats