eCite Digital Repository

Crowd-sourced knowledge bases


Kim, YS and Kang, BH and Ryu, SH and Compton, P and Han, SC and Menzies, T, Crowd-sourced knowledge bases, Proceedings of the12th Pacific Rim Knowledge Acquisition Workshop, 5-6 September 2012, Kuching, Malaysia, pp. 258-271. ISBN 978-3-642-32541-0 (2012) [Refereed Conference Paper]

Copyright Statement

Copyright 2012 Springer

DOI: doi:10.1007/978-3-642-32541-0_23


Crowdsourcing is a low cost way of obtaining human judgements on a large number of items, but the knowledge in these judgements is not reusable and further items to be processed require further human judgement. Ideally one could also obtain the reasons people have for these judgements, so the ability to make the same judgements could be incorporated into a crowd-sourced know- ledge base. This paper reports on experiments with 27 students building know- ledge bases to classify the same set of 1000 documents. We have assessed the performance of the students building the knowledge bases using the same stu- dents to assess the performance of each other’s knowledge bases on a set of test documents. We have explored simple techniques for combining the knowledge from the students. These results suggest that although people vary in document classification, simple merging may produce reasonable consensus knowledge bases.

Item Details

Item Type:Refereed Conference Paper
Keywords:crowd-sourcing, re-useable knowledge, knowledge acquisition, document classification.
Research Division:Information and Computing Sciences
Research Group:Artificial intelligence
Research Field:Artificial intelligence not elsewhere classified
Objective Division:Information and Communication Services
Objective Group:Information systems, technologies and services
Objective Field:Information systems, technologies and services not elsewhere classified
UTAS Author:Kang, BH (Professor Byeong Kang)
UTAS Author:Han, SC (Ms Caren Han)
ID Code:81335
Year Published:2012
Deposited By:Information and Communication Technology
Deposited On:2012-11-29
Last Modified:2018-03-18
Downloads:1 View Download Statistics

Repository Staff Only: item control page