Fluck, AE, An international review of eExam technologies and impact, Computers and Education, 132 pp. 1-15. ISSN 0360-1315 (2019) [Refereed Article]
© 2018 Published by Elsevier Ltd.
This study looks at the growth of eExams in five countries. An eExam is defined as Ďa timed, supervised, summative assessment conducted using each candidate's own computer running a standardised operating systemí (eExam, 2017), but local interpretations varied significantly. The literature revealed five main areas for the study: the scale of eExam adoption; assessment integrity (student cheating/security/reliability); eExam accessibility for students with disabilities; eExam architecture and affordances for assessing higher order thinking; and inter-sectoral relationships between universities and schools concerning eExam assessment environments. The methodology was qualitative and interpretist, using the constant comparison method from grounded theory for analysis (Corbin & Strauss, 1990, p. 9). Data were collected through interviews with 17 key individuals and from observations at sites which were purposively identified from the literature as diverse in eExam experience. The results provided a thick and robust description of practical eExam implementation. Adoption scales varied from less than 1% to 40% of examinations. Assessment integrity shared common concerns with pen-on-paper exams, and had some additional features, but were overall no more or less secure. eExams offered access to students with disabilities. The relationship between eExam architectures, affordances and assessment of higher order thinking was complex and contested, closely linked with perceived barriers and enablers. The quality of inter-sectoral relationships with respect to eExams was found to be generally poor. Academic workload reduction was a major enabler of eExams, and the policy drivers for curriculum transformation through improved affordances poorly articulated. Hurdles included lack of prior student experience of eExams. A clear enabler was the national adoption of a pathway to replacing pen-on-paper exams with eExams.
|Item Type:||Refereed Article|
|Keywords:||eExam,Architectures for educational technology system, pedagogical issues, postsecondary education, secondary education|
|Research Group:||Specialist studies in education|
|Research Field:||Education assessment and evaluation|
|Objective Division:||Education and Training|
|Objective Group:||Teaching and curriculum|
|Objective Field:||Teaching and instruction technologies|
|UTAS Author:||Fluck, AE (Associate Professor Andrew Fluck)|
|Web of Science® Times Cited:||13|
Repository Staff Only: item control page