eCite Digital Repository

The differential use and effect of knowledge-based system explanations in novice and expert judgment decisions


Arnold, V and Clark, N and Collier, PA and Leech, SA and Sutton, SG, The differential use and effect of knowledge-based system explanations in novice and expert judgment decisions, MIS Quarterly, 30, (1) pp. 79-97. ISSN 0276-7783 (2006) [Refereed Article]

Copyright Statement

Copyright 2006 Management Information Systems Research Center

Official URL:

DOI: doi:10.2307/25148718


Explanation facilities are considered essential in facilitating user interaction with knowledge-based systems (KBS). Research on explanation provision and the impact on KBS users has shown that the domain expertise affects the type of explanations selected by the user and the basis for seeking such explanations. The prior literature has been limited, however, by the use of simulated KBS that generally provide only feedback explanations (i.e., ex post to the recommendation of the KBS being presented to the user). The purpose of this study is to examine the way users with varying levels of expertise use alternative types of KBS explanations and the impact of that use on decision making. A total of 64 partner/manager-level and 82 senior/staff-level insolvency professionals participated in an experiment involving the use of a fully functioning KBS to complete a complex judgment task. In addition to feedback explanations, the KBS also provided feedforward explanations (i.e., general explanations during user input about the relationships between information cues in the KBS) and included definition type explanations (i.e., declarative-level knowledge). The results show that users were more likely to adhere to recommendations of the KBS when an explanation facility was available. Choice patterns in using explanations indicated that novices used feedforward explanations more than experts did, while experts were more likely than novices to use feedback explanations. Novices also used more declarative knowledge and initial problem solving type explanations, while experts used more procedural knowledge explanations. Finally, use of feedback explanations led to greater adherence to the KBS recommendation by experts-a condition that was even more prevalent as the use of feedback explanations increased. The results have several implications for the design and use of KBS in a professional decision-making environment.

Item Details

Item Type:Refereed Article
Keywords:knowledge-based systems
Research Division:Information and Computing Sciences
Research Group:Information systems
Research Field:Decision support and group support systems
Objective Division:Information and Communication Services
Objective Group:Other information and communication services
Objective Field:Other information and communication services not elsewhere classified
UTAS Author:Clark, N (Associate Professor Nicole Herbert)
ID Code:92830
Year Published:2006
Web of Science® Times Cited:94
Deposited By:Information and Communication Technology
Deposited On:2014-06-27
Last Modified:2014-08-05

Repository Staff Only: item control page