eCite Digital Repository

Establishing the validity and reliability of course evaluation questionnaires


Kember, DR and Leung, DYP, Establishing the validity and reliability of course evaluation questionnaires, Assessment and Evaluation in Higher Education: An International Journal, 33, (4) pp. 341-353. ISSN 0260-2938 (2008) [Refereed Article]

Copyright Statement

Copyright 2008 Taylor and Francis

DOI: doi:10.1080/02602930701563070


This article uses the case of designing a new course questionnaire to discuss the issues of validity, reliability and diagnostic power in good questionnaire design. Validity is often not well addressed in course questionnaire design as there are no straightforward tests that can be applied to an individual instrument. The authors propose the technique of establishing validity by deriving constructs from naturalistic qualitative research-in this case by interviewing award-winning teachers about their principles and practices. Analysis of the interview transcripts led to nine principles of good teaching, which were developed into nine questionnaire scales. Reliability was tested with Cronbach's alpha and with confirmatory factor analysis, as the use of Cronbach's alpha alone can mask issues of multi-dimensionality in scales. The concept of diagnostic power as the ability of an instrument to distinguish between related constructs is introduced. This is important in course evaluation questionnaires, as it enables relative strengths and weaknesses to be identified, which makes it possible to advise on remedial action. © 2008 Taylor & Francis.

Item Details

Item Type:Refereed Article
Research Division:Education
Research Group:Education systems
Research Field:Higher education
Objective Division:Education and Training
Objective Group:Teaching and curriculum
Objective Field:Pedagogy
UTAS Author:Kember, DR (Professor David Kember)
ID Code:84507
Year Published:2008
Web of Science® Times Cited:51
Deposited By:Education
Deposited On:2013-05-15
Last Modified:2015-02-11

Repository Staff Only: item control page