Video training to reduce cross campus variability in OSCE stations

Introduction: Many schools provide OSCE summative examinations at multiple sites, marked by many examiners. Traditional methods of examiner training and standardisation at one site are not possible across multiple sites. Video calibration has been shown to reduce examiner variability (1) in a research setting. University of Tasmania introduced this method as a mechanism of training our examiners for all our sites.

Methods: Video Calibration site created and populated. Qualitative feedback from role players, examiners and administrative staff on Video Calibration as a method of training. Quantitative data on use and outcomes of examiner calibrations

Results: All OSCE’s have trial run and can be modified if issues found More consistent performance with role players across sites Easier for consistent set up Quantitative data shows examiner calibration consistent ( hopefully) we can change this if its not true..

Conclusions: Feedback from administrative staff, role players and examiners also demonstrated that it played a quality assurance role in providing more consistent examiner marking, role player performances and room set up across the different sites

Take-home message: Using video calibration has benefits beyond examiner training in developing a quality assured process across multiple delivery sites