eCite Digital Repository

Development of a benchmarking tool for pharmacy students using threshold learning outcomes


Chalmers, L and Nash, RE and Holmes, SE and Bereznicki, LRE and Rasiah, Rohan and Cooper, J and Bellington, M and Heslop, I, Development of a benchmarking tool for pharmacy students using threshold learning outcomes, Teaching Matters 2014, 2-3 December, 2014, Hobart, Tasmania (2014) [Conference Extract]

PDF (Chalmers et al Teaching Matters poster)
Pending copyright assessment - Request a copy


Benchmarking is crucial for ensuring the quality of the learning experience offered by a curriculum. This project aimed to develop, refine and validate a tool based on the pharmacy threshold learning outcomes (TLOs) to facilitate benchmarking of students' performances in verbal 'capstone' assessments in Australian pharmacy programs. A pilot tool was developed and trialled by local and external examiners during the University of Tasmania (UTAS) 2013 Bachelor of Pharmacy Fourth Year verbal examinations. Usability and acceptability were assessed using a survey and the tool was evaluated for validity and inter- and intra-rater reliability using Pearson correlation coefficients (r). The tool was refined using these results, and a validation exercise is planned for late 2014. In the initial evaluation, agreement on TLO scoring was excellent between UTAS examiners (r values .73-.88; n=29 comparisons); and very good between the Tasmanian and external examiners for most TLOs (r=.59-.68; n=12). Agreement between allocated marks and TLO scores were also very good (r=.62-.85; n=29). Survey results recommended improving alignment of the TLOs with the assessment activity, simplifying the rating scales and providing training regarding the tool. Progress is underway towards the development of a relatively simple, flexible and validated benchmarking tool to facilitate high quality student outcomes across Australian pharmacy programs. Training in the use of the tool has been identified as a major enabler of its successful and consistent application, and a scenario-based training video is currently being produced. The tool and training video will be showcased in this poster presentation.

Item Details

Item Type:Conference Extract
Keywords:benchmarking, learning outcomes
Research Division:Education
Research Group:Curriculum and pedagogy
Research Field:Medicine, nursing and health curriculum and pedagogy
Objective Division:Education and Training
Objective Group:Teaching and curriculum
Objective Field:Assessment, development and evaluation of curriculum
UTAS Author:Chalmers, L (Dr Leanne Chalmers)
UTAS Author:Nash, RE (Dr Rosie Nash)
UTAS Author:Holmes, SE (Mrs Sandra Holmes)
UTAS Author:Bereznicki, LRE (Professor Luke Bereznicki)
UTAS Author:Rasiah, Rohan (Associate Professor Rohan Rasiah)
ID Code:97808
Year Published:2014
Deposited By:Pharmacy
Deposited On:2015-01-14
Last Modified:2015-02-17
Downloads:3 View Download Statistics

Repository Staff Only: item control page