eCite Digital Repository

Post-implementation evaluation of a digital dictation system in a large Health Service Using HOT-Fit Framework


Bain, C and Goswami, A and Lloyd, S and Davis, L, Post-implementation evaluation of a digital dictation system in a large Health Service Using HOT-Fit Framework, Asia Pacific Journal of Health Management, 15, (4) pp. 1-11. ISSN 2204-3136 (2020) [Refereed Article]

PDF (Published version)

Copyright Statement

Asia Pacific Journal of Health Management 2020. This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) License,

DOI: doi:10.24083/apjhm.v15i4.339


Objective: The objective of this study was to evaluate a digital dictation system (DDS) that has been implemented in a large health service. The data collected in this study was used to understand the overall uptake and performance of the system and consequently improve the quality of care delivered by the organisation.

Methods: A mixed method research design was used in this study. Clinicians and Medical Transcriptionists using the DDS across the two campuses of the health service over a period of four months, were surveyed to assess the extent to which the implementation of the DDS is fulfilling its purpose. In addition, system usage statistics, project implementation documents and user support emails were also analysed.

Results: This study utilised an existing comprehensive and validated evaluation framework, the Human, Organisation and Technology Fit (HOT-Fit) framework. Human fit: 79.55% (n=35) of Clinicians and 33.33% (n=2) of MTs reported an overall satisfaction with the DDS. Organisation fit: The document analysis revealed that the DDS selected aligned best with current organizational IT strategies and was an easy fit with existing practices. Technology fit: An overall satisfaction of 53.49% (n=23) from the Clinicians and 16.67% (n=1) from the MTs was reported on the DDS. Out of 22 issues lodged regarding the system, 77.27% (n=17) issues met the Service Level Agreement (SLA).

Conclusions: The overall findings of the study suggest that, the DDS was a good fit within the organisation in terms of Human fit and Organisation fit. In terms of Technology fit there existed some technical issues on the end-user level due to the system being new to the end users. To overcome this and facilitate the smooth functioning of the DDS, effective communication with the vendor and other relevant stakeholders was recommended so that end users i.e. the Clinicians and MTs understand the system, its functionality and their role in providing timely and high-quality information for clinical care.

Item Details

Item Type:Refereed Article
Keywords:evaluation, framework, HOT-FIT
Research Division:Health Sciences
Research Group:Health services and systems
Research Field:Digital health
Objective Division:Health
Objective Group:Provision of health and support services
Objective Field:Inpatient hospital care
UTAS Author:Lloyd, S (Dr Sheree Lloyd)
ID Code:154898
Year Published:2020
Deposited By:Australian Institute of Health Service Management
Deposited On:2023-01-18
Last Modified:2023-02-09

Repository Staff Only: item control page