eCite Digital Repository
Honour thesis assessment: the role of guidelines in achieving inter-rater agreement
Citation
Henderson, AD and Guijt, M and Breadmore, MC and Carew, ALJ and Guijt, RM, Honour thesis assessment: the role of guidelines in achieving inter-rater agreement, Proceedings of 20th Annual Conference for the Australasian Association for Engineering Education, 6-9 December 2009, The University of Adelaide, pp. 185-192. ISBN 1876346604 (2009) [Refereed Conference Paper]
 | PDF 306Kb |
Copyright Statement
Copyright 2009 The authors.
Official URL: http://aaee.com.au/conferences/AAEE2009/PDF/AUTHOR...
Abstract
Engineering honours projects are often self selected or negotiated by students
to be in areas of their own interest. While this encourages motivation and engagement in
a self directed research project, it also considerably increases the diversity of honours
project types. Such project diversity raises questions about the most suitable form of
guidelines to provide good inter-rater agreement. Project diversity can also result in
academics assessing projects outside their primary area of research specialisation. This
is particularly true of transdisciplinary projects that cross over conventional discipline
boundaries. To investigate these issues, a team of academics from two Schools at the
University of Tasmania assessed a collection of engineering theses using a variety of
different guidelines. All guidelines were found to produce poor inter-rater agreement,
however inter-rater agreement was improved when both assessors were of the same
discipline. An account of the academics’ comments on use of the guidelines reveals
conflicting opinions of good and bad features. Guidelines that were viewed as easy to use
and less subjective were found not to substantially improve inter-rater agreement. The
implications of these findings are discussed and suggestions made in relation to
improving assessment guidelines for honours theses.
Item Details
| Item Type: | Refereed Conference Paper |
|---|---|
| Research Division: | Education |
| Research Group: | Specialist Studies in Education |
| Research Field: | Education Assessment and Evaluation |
| Objective Division: | Education and Training |
| Objective Group: | Other Education and Training |
| Objective Field: | Education and Training Theory and Methodology |
| Author: | Henderson, AD (Dr Alan Henderson) |
| Author: | Guijt, M (Mr Marc Guijt) |
| Author: | Breadmore, MC (Professor Michael Breadmore) |
| Author: | Carew, ALJ (Dr Anna Carew) |
| Author: | Guijt, RM (Dr Rosanne Guijt) |
| ID Code: | 59954 |
| Year Published: | 2009 |
| Deposited By: | Austn Centre for Research in Separation Science |
| Deposited On: | 2009-12-23 |
| Last Modified: | 2014-12-21 |
| Downloads: | 511 View Download Statistics |
Repository Staff Only: item control page