Evaluation of the Singapore Emergency Medical Team (SGEMT) Hybrid Training Course and Its Field Impact During the Mandalay Earthquake Relief Mission Using the Kirkpatrick Framework

Nurul Ain Binte  Rejap; John Low Zhong Heng; Alexa Zeng Jiayi; Ng Min Hui; Goh Ying Hong; Ahmad  Khairil Bin Mohamed Jamil; Quah Li Juan  Joy; Shu Fang Ho

doi:10.22146/ajdhm.v2i1.26478

Nurul Ain Binte Rejap Ministry of Health Holdings Pte Ltd, Singapore
John Low Zhong Heng Ministry of Health Holdings Pte Ltd, Singapore
Alexa Zeng Jiayi Ministry of Health, Singapore
Ng Min Hui Singapore Health Services, Singapore
Goh Ying Hong SingHealth Academy, Singapore
Ahmad Khairil Bin Mohamed Jamil Sengkang General Hospital, Singapore
Quah Li Juan Joy Singapore General Hospital, Singapore https://orcid.org/0000-0002-9520-7690
Shu Fang Ho Singapore General Hospital, Singapore https://orcid.org/0000-0002-8483-6424

DOI: https://doi.org/10.22146/ajdhm.v2i1.26478

Keywords: Singapore Emergency Medical Team, SGEMT Training Course, Mandalay Earthquake Deployment, Training Course Evaluation, Kirkpatrick Model of Evaluation

Abstract

Introduction: Effective pre-deployment training enables disaster relief medical teams to operate safely and efficiently in resource-limited environments. Objective: This study evaluates the effectiveness of the Singapore Emergency Medical Team (SGEMT) Hybrid Training Course in preparing personnel for WHO Type 1 (Fixed) EMT accreditation and subsequent deployment to Mandalay following a major earthquake. Methods: Training outcomes were assessed using the Kirkpatrick four-level evaluation model, which included post-training surveys, training completion records, thematic analysis of free-text responses, WHO EMT classification exercise, deployment operational metrics and post-deployment evaluation. Results: Participants reported high satisfaction and perceived role relevance (Kirkpatrick-Level-1) Thematic analysis revealed enhanced confidence and operational preparedness (Kirkpatrick-Level-2). After attaining WHO EMT accreditation, SGEMT underwent its first deployment, treating 1,803 patients over eight days, including 33 high-acuity cases with no adverse events (Kirkpatrick-Levels-3-and-4). Key program enablers were realistic scenarios conducted in a collaborative learning environment that reinforced technical and non-technical skills such as team collaboration, open communication, and psychological resilience. Conclusion: The SGEMT Hybrid Training Course helped foster individual and team competencies, which supported effective real-world disaster response. This study provides evidence supporting a multi-component, team-based training model grounded in adult learning principles and offers a practical framework for evaluating EMT training programs

References

1. Casey ST, Noste EE, Cook AT, Muscatello D, Heslop DJ. Emergency medical teams in WHO’s Western Pacific Region. 2023;14(6).
2. Quah LJJ, Ho SF, Tan D, Faisal FIM, Ng KC. SETTING UP THE WORLD HEALTH ORGANIZATION (WHO) - SINGAPORE EMERGENCY MEDICAL TEAM (SGEMT) FOR A TYPE 1 FIXED FACILITY DEPLOYMENT.
3. Ho SF, Quah JLJ, Tan D, Faisal FIM, Ng KC. Developing a Hybrid Training Curriculum for the Inaugural World Health Organization (WHO) Singapore Emergency Medical Team (SGEMT) Using Andragogical Principles for Adult Training. ASEAN Journal of Disaster Health Management (AJDHM). 2025 Jan 2;1[1):65–81.
4. Singapore contributes to regional health emergency readiness through achieving Emergency Medical Team classification [Internet]. [cited 2025 Oct 16]. Available from: https://www.who.int/malaysia/news/detail/12-09-2024-singapore-contributes-to-regional-health-emergency-readiness-through-achieving-emergency-medical-team-classification
5. IOM Flash Appeal Myanmar Earthquake Response (29 March 2025 - 30 June 2025) | United Nations in Myanmar [Internet]. [cited 2025 Nov 19]. Available from: https://myanmar.un.org/en/291948-iom-flash-appeal-myanmar-earthquake-response-29-march-2025-30-june-2025
6. Ministry of Health [Internet]. [cited 2025 Oct 16]. SINGAPORE EMERGENCY MEDICAL TEAM TO PROVIDE MEDICAL ASSISTANCE IN MYANMAR RELIEF EFFORTS. Available from: https://www.moh.gov.sg/newsroom/singapore-emergency-medical-team-to-provide-medical-assistance-in-myanmar-relief-efforts/
7. Rashid H, Alexakis LC, Pereira I. Disaster Medicine Education for Medical Students: A Scoping Review. Cureus [Internet]. 2024 Dec 3 [cited 2025 Sept 30]; Available from: https://www.cureus.com/articles/304492-disaster-medicine-education-for-medical-students-a-scoping-review
8. Olsson S, Kurland L, Taube F, Björås J, Robinson Y. Disaster medicine in Swedish undergraduate medical education: analysing current programs and future integration in the six-year curriculum. BMC Med Educ. 2025 May 20;25[1):731.
9. Voicescu GT, Lamine H, Loșonți AE, Lupan-Mureșan EM, Luka S, Ulerio JG, et al. Monitoring and evaluation in disaster management courses: a scoping review. BMC Med Educ. 2025 Feb 6;25:188.
10. Rouse D (Nick). Employing Kirkpatrick’s Evaluation Framework to Determine the Effectiveness of Health Information Management Courses and Programs. Perspect Health Inf Manag. 2011 Apr 1;8(Spring):1c.
11. Johnston S, Coyer FM, Nash R. Kirkpatrick’s Evaluation of Simulation and Debriefing in Health Care Education: A Systematic Review. Journal of Nursing Education. 2018 July;57(7):393–8.
12. Naeem M, Ozuem W, Howell K, Ranfagni S. A Step-by-Step Process of Thematic Analysis to Develop a Conceptual Model in Qualitative Research. International Journal of Qualitative Methods. 2023 Oct 1;22:16094069231205789.
13. World Health Organization. Classification and Minimum Standards for Emergency Medical Teams [Internet]. Geneva, Switzerland: World Health Organization; 2021. Available from: https://iris.who.int/server/api/core/bitstreams/f1a9750a-f68b-401c-87ea-c5157a3af6d9/content
14. Yamashita K, Nagatani A, Tasaki O. The education for DMAT. Japanese Journal of Reanimatology. 2013;32(2):88–90.
15. Anan H, Akasaka O, Kondo H, Nakayama S, Morino K, Homma M, et al. Experience from the Great East Japan Earthquake Response as the Basis for Revising the Japanese Disaster Medical Assistance Team (DMAT) Training Program | Disaster Medicine and Public Health Preparedness. Cambridge Core [Internet]. [cited 2025 Nov 21]; Available from: https://www.cambridge.org/core/journals/disaster-medicine-and-public-health-preparedness/article/experience-from-the-great-east-japan-earthquake-response-as-the-basis-for-revising-the-japanese-disaster-medical-assistance-team-dmat-training-program/9D310CC51EA973FF16E813DA5E860803
16. Bodas M, Peleg K, Adini B, Ragazzoni L. Training Package for Emergency Medical Teams Deployed to Disaster Stricken Areas: Has ‘TEAMS’ Achieved its Goals? Disaster Medicine and Public Health Preparedness. 2022 Apr;16(2):663–9.
17. Witheridge A, Ferns G, Scott-Smith W. Revisiting Miller’s pyramid in medical education: the gap between traditional assessment and diagnostic reasoning. Int J Med Educ. 2019 Oct 25;10:191–2.
18. Cooper S, Cant R, Connell C, Sims L, Porter JE, Symmons M, et al. Measuring teamwork performance: Validity testing of the Team Emergency Assessment Measure (TEAM) with clinical resuscitation teams. Resuscitation. 2016 Apr;101:97–101.
19. Amat Camacho N, Hughes A, Burkle FM, Ingrassia PL, Ragazzoni L, Redmond A, et al. Education and Training of Emergency Medical Teams: Recommendations for a Global Operational Learning Framework. PLoS Curr. 2016 Oct 21;8:ecurrents.dis.292033689209611ad5e4a7a3e61520d0.
20. Peller J, Schwartz B, Kitto S. Nonclinical core competencies and effects of interprofessional teamwork in disaster and emergency response training and practice: a pilot study. Disaster Med Public Health Prep. 2013 Aug;7(4):395–402.
21. Westman A, Kurland L, Hugelius K. Non-technical skills needed by medical disaster responders– a scoping review. Scand J Trauma Resusc Emerg Med. 2024 Apr 2;32:25.
22. Neubauer FB, Wagner FL, Lörwald A, Huwendiek S. Sharpening the lens to evaluate interprofessional education and interprofessional collaboration by improving the conceptual framework: a critical discussion. BMC Medical Education. 2024 June 4;24[1):615.