Introduction of a formative assessment tool in a post-graduate training program in India: a mixed methods evaluation

Authors

Katherine Douglass, Medical Faculty Associates, Department of Emergency Medicine, The George Washington University, 2120 L Street NW, Ste 450, Washington, DC, 20037, USA. kdouglass@mfa.gwu.edu.
Tania Ahluwalia, Children's National Hospital, Washington, DC, USA.
Brianna McKiernan, George Washington University School of Medicine & Health Sciences, Washington, DC, USA.
Heena Patel, George Washington University School of Medicine & Health Sciences, Washington, DC, USA.
Natasha Powell, Medical Faculty Associates, Department of Emergency Medicine, The George Washington University, 2120 L Street NW, Ste 450, Washington, DC, 20037, USA.
Jacob Keller, Medical Faculty Associates, Department of Emergency Medicine, The George Washington University, 2120 L Street NW, Ste 450, Washington, DC, 20037, USA.
Serkan Toy, Virginia Tech Carilion School of Medicine, Roanoke, VA, USA.

Document Type

Journal Article

Publication Date

3-1-2024

Journal

International journal of emergency medicine

Volume

17

Issue

1

DOI

10.1186/s12245-024-00604-6

Keywords

Accident and emergency medicine; India; Medical education & training

Abstract

BACKGROUND: Our institution has longstanding post-graduate education and training partnership programs in Emergency Medicine (EM) across India. A programmatic challenge has been the integration and uptake of evidence-based medicine and lifelong learning concepts. Formative assessment (FA) is intended to enable learners to monitor learning, identify strengths and weaknesses, and target areas of growth. As part of a program improvement initiative, we introduced an online FA tool to existing summative assessments. This study investigates how the FA tool was used and perceived by trainees. METHODS: 246 trainees across 19 sites were given access to the FA tool. Usage metrics were monitored over 12 months. Semi-structured interviews were conducted in person with trainees using a purposive sampling methodology. A hybrid thematic analysis approach was used to determine themes. Interviews were coded independently by two blinded researchers using NVivo software. The study was deemed exempt by our institutional review board. RESULTS: There was high variability in trainees' utilization of the FA tool. Trainees who used the FA tool more performed better on summative exams (r = 0.35, p < 0.001). Qualitative analysis revealed that trainees were motivated to learn for improved clinical knowledge and to be a good physician, not only passing exams. Benefits of the tool included the relationship to clinical practice and thorough explanation of answers, while disadvantages included topics unrelated to India. CONCLUSION: The integration of a FA tool has provided positive outcomes for trainees in EM education programs in India. Lessons learned may apply globally to other contexts and programs.

APA Citation

Douglass, Katherine; Ahluwalia, Tania; McKiernan, Brianna; Patel, Heena; Powell, Natasha; Keller, Jacob; and Toy, Serkan, "Introduction of a formative assessment tool in a post-graduate training program in India: a mixed methods evaluation" (2024). GW Authored Works. Paper 4586.
https://hsrc.himmelfarb.gwu.edu/gwhpubs/4586

Department

School of Medicine and Health Sciences Student Works