eCite Digital Repository

On moving from structured oral assessments to computer-aided assessments for vocational training

Citation

Adair, D and Jaeger, M, On moving from structured oral assessments to computer-aided assessments for vocational training, Proceedings of the International Conference on Engineering Education 2012, 30 July - 3 August, Turku, Finland, pp. 28-35. ISBN 978-952-216-316-5 (2012) [Refereed Conference Paper]


Preview
PDF
Restricted - Request a copy
423Kb
  

Copyright Statement

Copyright 2012 International Conference on Engineering Education

Official URL: http://www.icee2012.fi/

Abstract

Included in methods commonly used for assessing knowledge and skills associated with vocational training are structured oral assessments (SOAs) since they can be used to assess knowledge and skills to a depth rarely achieved in other forms of testing. However, SOAs require considerable preparation by the assessors, they can be restricted by time and assessor allocation, it is difficult to cover the course and they can put stress on the examinees. Computer-aided tests have merits and problems. They are efficient and straightforward to run, and they give an assessment environment which is less stressful than SOAs, but, they have a disadvantage in that students will on occasions guess answers when multiple-choice questions (MCQs) are used. Two electronic assessment methods are developed here, one using a scoring method and the other using a set of pairs of MCQs with both designed to counteract examinee guessing. A comparison of the four assessment results follows for three cohorts of students, namely, the results from an SOA, the results of the electronic assessment method using the "scoring method", the results of the electronic assessment method using the "set-of-pairs" method and the results of an electronic assessment method using the traditional "positive-grades-only" scoring rules.

Item Details

Item Type:Refereed Conference Paper
Keywords:competency-based assessment, multiple-choice assessment, oral examinations, computer-aided assessment
Research Division:Education
Research Group:Specialist Studies in Education
Research Field:Education Assessment and Evaluation
Objective Division:Education and Training
Objective Group:Education and Training Systems
Objective Field:Education and Training Systems not elsewhere classified
Author:Jaeger, M (Dr Martin Jaeger)
ID Code:83995
Year Published:2012
Deposited By:Engineering
Deposited On:2013-04-08
Last Modified:2014-11-26
Downloads:0

Repository Staff Only: item control page