University of Tasmania
Browse

File(s) under permanent embargo

Crowd-sourced knowledge bases

conference contribution
posted on 2023-05-23, 07:05 authored by Kim, YS, Byeong KangByeong Kang, Ryu, SH, Compton, P, Han, SC, Menzies, T
Crowdsourcing is a low cost way of obtaining human judgements on a large number of items, but the knowledge in these judgements is not reusable and further items to be processed require further human judgement. Ideally one could also obtain the reasons people have for these judgements, so the ability to make the same judgements could be incorporated into a crowd-sourced know- ledge base. This paper reports on experiments with 27 students building know- ledge bases to classify the same set of 1000 documents. We have assessed the performance of the students building the knowledge bases using the same stu- dents to assess the performance of each other’s knowledge bases on a set of test documents. We have explored simple techniques for combining the knowledge from the students. These results suggest that although people vary in document classification, simple merging may produce reasonable consensus knowledge bases.

History

Publication title

Proceedings of the12th Pacific Rim Knowledge Acquisition Workshop

Editors

D Richards, BH Kang

Pagination

258-271

ISBN

978-3-642-32541-0

Department/School

School of Information and Communication Technology

Publisher

Springer

Place of publication

Berlin Heidelberg

Event title

12th Pacific Rim Knowledge Acquisition Workshop (PKAW 2012)

Event Venue

Kuching, Malaysia

Date of Event (Start Date)

2012-09-05

Date of Event (End Date)

2012-09-06

Rights statement

Copyright 2012 Springer

Repository Status

  • Restricted

Socio-economic Objectives

Information systems, technologies and services not elsewhere classified

Usage metrics

    University Of Tasmania

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC