eCite Digital Repository

Aggregating student peer assessment during capstone projects

Citation

Adair, D and Jaeger, M, Aggregating student peer assessment during capstone projects, International Journal of Engineering Education, 33, (1) pp. 216-224. ISSN 0949-149X (2017) [Refereed Article]


Preview
PDF (RODA)
Pending copyright assessment - Request a copy
4Mb
  

Abstract

Student assessment of other student's work has many potential benefits to learning for both the assessor and the assessed. However, sources of peer assessment provide, quite often, subjective evidence, which can be conflicting, uncertain and even ignorant. One of the key elements to providing an overall quality assessment of a student's work derived from the assessment by his/her peers is the use of an appropriate method of combining or fusing these heterogeneous evidence sources. Since the development of the belief theory introduced by Shafer in the 1970s, many combination rules have been proposed in the literature with two main methods selected here. The fi rst is an evidential reasoning (ER) approach, the kernel of which is an ER algorithm developed on the basis of the framework and the evidence combination rule of the Dempster-Shafer (DS) theory. It has been claimed also in the literature that Dempster's rule generates counter-intuitive and unacceptable results in practical situations, so an approach based on the Dezert-Smarandache (DSmT) theory of fusion will also be explored, in particular the PCR6 rule of proportional conflict redistribution. Results for peer assessment marks allocated by a student cohort, consisting of20 students, during their capstone projects, and, aggregated using each of these two approaches are compared with each other and with results obtained by the more traditional Averaging Rule (AR) approach. It is clear from the findings that when subjective evidence is aggregated then the simple AR approach as the accepted combination method is in doubt. It also seems that the DS method of aggregation seems the best alternative to traditional averaging.

Item Details

Item Type:Refereed Article
Keywords:capstone, evidence, aggregating, fusion
Research Division:Engineering
Research Group:Other Engineering
Research Field:Engineering not elsewhere classified
Objective Division:Education and Training
Objective Group:Learner and Learning
Objective Field:Learner and Learning Achievement
Author:Adair, D (Dr Desmond Adair)
Author:Jaeger, M (Dr Martin Jaeger)
ID Code:122573
Year Published:2017
Deposited By:Engineering
Deposited On:2017-11-19
Last Modified:2017-11-24
Downloads:0

Repository Staff Only: item control page