eCite Digital Repository

The online C-Test: evaluating a discipline-specific academic literacy competency assessment tool

Citation

Kebble, P and Cruickshank, V, The online C-Test: evaluating a discipline-specific academic literacy competency assessment tool, Journal of Academic Language & Learning, 13, (1) pp. A15-A27. ISSN 1835-5196 (2019) [Refereed Article]


Preview
PDF (Published version)
508Kb
  

Copyright Statement

© 2019 P. Kebble & V. Cruickshank

Official URL: http://journal.aall.org.au/index.php/jall/article/...

Abstract

This paper examines the use of an experimental online post-entry language assessment (PELA) tool during the first year of an undergraduate Information and Communication Technologies (ICT) course provided by an Australian university. The research was conducted in response to English language teaching staff, subject lecturers, and the Australian Universities Quality Agency (AUQA) expressing concern that students were engaging with the ICT course without appropriate English language proficiency. The response to these concerns was for the authors to implement an assessment of English language competency to establish the extent of the concerns, and to provide recommendations as how these issues could be addressed. Three forms of testing were employed, a reading/summarising exercise, a listening test, and the online discipline-specific literacy assessment tool. More specifically, this paper details the design and evaluation of the latter online assessment tool utilising the ‘CTest’ procedure. The outcomes of this research were twofold. First, it identified that as many as 39% of students were likely operating with a lower level of linguistic proficiency than was considered appropriate for successful engagement with the course, which then allowed the authors to provide a list of recommendations to help alleviate this issue. Second, while extensive research suggests the C-Test is a reliable tool to gauge linguistic competency, our research found only a weak correlation between students’ C-Test results and their results on a concurrent reading/writing (summarising) test. This result points to a need for more rigorous research into the concurrent validity of the C-Test and the way that it is implemented online as a measure of disciplinespecific linguistic competency.

Item Details

Item Type:Refereed Article
Keywords:C-Test, online application, assessment, English language teaching
Research Division:Education
Research Group:Curriculum and Pedagogy
Research Field:LOTE, ESL and TESOL Curriculum and Pedagogy (excl. Maori)
Objective Division:Education and Training
Objective Group:Curriculum
Objective Field:Syllabus and Curriculum Development
UTAS Author:Cruickshank, V (Dr Vaughan Cruickshank)
ID Code:135861
Year Published:2019
Deposited By:Education
Deposited On:2019-11-19
Last Modified:2019-12-12
Downloads:0

Repository Staff Only: item control page