Validity and Reliability od Postgraduate Hospital Educational Environment Measure - Bahasa Indonesia Version

Natalia Widiasih Raharjanti(1*), Adhitya Sigit Ramadianto(2)

(1) Department of Psychiatry, Faculty of Medicine Universitas Indonesia
(2) Department of Psychiatry, Faculty of Medicine Universitas Indonesia
(*) Corresponding Author


Background: Educational environment is an essential factor influencing performance of medical residents, and unsupportive educational environment is associated with considerable harmful impacts. The Postgraduate Hospital Educational Environment Measure (PHEEM) is a self-administered questionnaire designed to measure residents’ perception of their educational environment. This study aims to establish the validity and reliability of PHEEM - Bahasa Indonesia version.

Methods: The original PHEEM is translated and modified through an expert panel discussion. Construct validity is measured by corrected item-total correlation. Internal consistency reliability is measured by Cronbach’s alpha. Sample was taken from neurology and radiology residents.

Results: The first validation trial was done on 44 neurology residents while the second trial was done in 35 radiology residents. Almost all item scores are correlated with the total score with r > 0,3. Cronbach’s alpha of PHEEM is 0,89 and 0,91 in the first and second trial, respectively.

Conclusion: This is the first PHEEM validation study in Indonesia; changes to the instrument were made to maintain face and content validity. While the sample size is small and not selected randomly, PHEEM - Bahasa Indonesia version has acceptable validity and reliability to be used in research and evaluation of residency programs.


Educational environment, PHEEM, validation

Full Text:



  1. Dunn LB, Iglewicz A, Moutier C. A conceptual model of medical student well-being: promoting resilience and preventing burnout. Academic Psychiatry. 2008; 32(1): 44-53.
  2. Lovato C, Wall D. Programme evaluation: improving practice, influencing policy and decision-making. In: Swanwick T. Understanding medical education: evidence, theory, and practice. 2nd ed. Wiley Blackwell, 2014.
  3. Dyrbye LN, Thomas MR, Shanafelt TD. Medical student distress: causes, consequences, and proposed solutions. Mayo Clin Proc. 2005; 80(12):1613-22.
  4. Llera J, Durante E. Correlation between the educational environment and burn-out syndrome in residency programs at a university hospital. Arch Argent Pediatr. 2014; 112(1):6-11
  5. Roff S, McAleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Medical Teacher. 2005;27(4):326-31.
  6. Cohen RJ, Swerdlik ME, Sturman ED. Psychological testing and assessment: an introduction to tests and measurement. 8th ed. New York: McGraw-Hill, 2013.
  7. Clapham M, Wall D, Batchelor A. Educational environment in intensive care medicine - use of Postgraduate Hospital Educational Environment Measure (PHEEM). Medical Teacher. 2007; 29: 184-191.
  8. Koutsogiannou P, Dimoliatis IDK, Mavridis D, Bellos S, Karathanos V, Jelastopulu E. Validation of the Postgraduate Hospital Educational Environment Measure (PHEEM) in a sample of 731 Greek residents. BMC Res Notes. 2015;8:734.
  9. Jalili M, Hejri SM, Ghalandari M, Moradi-Lakeh M, Mirzazadeh A, Roff S. Validating modified PHEEM questionnaire for measuring educational environment in academic emergency departments. Arch Iran Med. 2014; 17(5):372-377.
  10. Shokoohi S, Emami AH, Mohammadi A, Ahmadi S, Mojtahedzadeh R. Psychometric properties of the Postgraduate Hospital Educational Environment Measure in an Iranian hospital setting. Med Educ Online. 2014; 19:24546.
  11. Gooneratne IK, Munasinghe SR, Siriwardena C, Olupeliyawa AM, Karunathilake I. Assessment of psychometric properties of a modified PHEEM questionnaire. Ann Acad Med Singapore. 2008; 37:993-7.
  12. Cozby PC, Bates SC. Methods in behavioral research. 12th ed. New York: McGraw-Hill Education, 2015.
  13. Anthoine E, Moret L, Regnault A, Sbille V, Hardouin JB. Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health and Quality of Life Outcomes. 2014;12:176.


Article Metrics

Abstract views : 1728 | views : 2411


  • There are currently no refbacks.

Copyright (c) 2017 Natalia Widiasih Raharjanti, Adhitya Sigit Ramadianto

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Jurnal Pendidikan Kedokteran Indonesia (The Indonesian Journal of Medical Education) indexed by: