eCite Digital Repository

The relationship between return on investment and quality of study methodology in workplace health promotion programs


Baxter, S and Sanderson, K and Venn, AJ and Blizzard, CL and Palmer, AJ, The relationship between return on investment and quality of study methodology in workplace health promotion programs, American Journal of Health Promotion, 28, (6) pp. 347-363. ISSN 0890-1171 (2014) [Refereed Article]

Copyright Statement

Copyright 2014 American journal of health promotion

DOI: doi:10.4278/ajhp.130731-LIT-395


Objective. To determine the relationship between return on investment (ROI) and quality of study methodology in workplace health promotion programs. Data Source. Data were obtained through a systematic literature search of National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE), Health Technology Database (HTA), Cost Effectiveness Analysis (CEA) Registry, EconLit, PubMed, Embase, Wiley, and Scopus. Study Inclusion and Exclusion Criteria. Included were articles written in English or German reporting cost(s) and benefit(s) and single or multicomponent health promotion programs on working adults. Return-to-work and workplace injury prevention studies were excluded. Data Extraction. Methodological quality was graded using British Medical Journal Economic Evaluation Working Party checklist. Economic outcomes were presented as ROI. Data Synthesis. ROI was calculated as ROI = (benefits - costs of program)/costs of program. Results were weighted by study size and combined using meta-analysis techniques. Sensitivity analysis was performed using two additional methodological quality checklists. The influences of quality score and important study characteristics on ROI were explored. Results. Fifty-one studies (61 intervention arms) published between 1984 and 2012 included 261,901 participants and 122,242 controls from nine industry types across 12 countries. Methodological quality scores were highly correlated between checklists (r =.84-.93). Methodological quality improved over time. Overall weighted ROI [mean 6 standard deviation (confidence interval)] was 1.38±1.97 (1.38-1.39), which indicated a 138% return on investment. When accounting for methodological quality, an inverse relationship to ROI was found. High-quality studies (n = 18) had a smaller mean ROI, 0.26±1.74 (.23-.30), compared to moderate (n=16) 0.90±1.25 (.90-.91) and low-quality (n=27) 2.32±2.14 (2.30-2.33) studies. Randomized control trials (RCTs) (n = 12) exhibited negative ROI, -0.22±2.41(-.27 to -.16). Financial returns become increasingly positive across quasi-experimental, nonexperimental, and modeled studies: 1.12±2.16 (1.11-1.14), 1.61±0.91 (1.56-1.65), and 2.05±0.88 (2.04-2.06), respectively. Conclusion. Overall, mean weighted ROI in workplace health promotion demonstrated a positive ROI. Higher methodological quality studies provided evidence of smaller financial returns. Methodological quality and study design are important determinants. © 2014 by American Journal of Health Promotion, Inc.

Item Details

Item Type:Refereed Article
Keywords:Meta-analysis-Review, Workplace, Health Prom otion, Economic Evaluation, Quality Appraisal, Occupational Health, Cost Benefit Analysis, Return on Investment
Research Division:Economics
Research Group:Applied economics
Research Field:Health economics
Objective Division:Health
Objective Group:Evaluation of health and support services
Objective Field:Evaluation of health and support services not elsewhere classified
UTAS Author:Baxter, S (Dr Siyan Baxter)
UTAS Author:Sanderson, K (Associate Professor Kristy Sanderson)
UTAS Author:Venn, AJ (Professor Alison Venn)
UTAS Author:Blizzard, CL (Professor Leigh Blizzard)
UTAS Author:Palmer, AJ (Professor Andrew Palmer)
ID Code:93359
Year Published:2014
Web of Science® Times Cited:98
Deposited By:Menzies Institute for Medical Research
Deposited On:2014-07-29
Last Modified:2017-11-07

Repository Staff Only: item control page