This review was particularly well-received by the WHP research community and leaders in the field.127-130 It was acknowledged by the editor in chief of the American Journal of Health Promotion as “the most thorough and rigorous systematic review of the literature conducted to date on the return on investment (ROI) of workplace health promotion programs” p iv. 127 Its findings have been cited in the American Heart Association Presidential Advisory.131 The results in this review provide strong support for the need to improve standards of economic evaluations in workplace health promotion.
2.9 References
1. Drummond MF, Sculpher MJ, Torrance GW. Methods for the economic evaluation of health care programmes 3rd edition. Oxford University Press, USA; 2005. 2. Warner KE, Wickizer TM, Wolfe RA, Schildroth JE, Samuelson MH. Economic
implications of workplace health promotion programs: review of the literature. J. Occup. Med. Feb 1988;30(2):106-112.
3. Uegaki K, de Bruijne MC, van der Beek AJ, van Mechelen W, van Tulder MW. Economic Evaluations of Occupational Health Interventions from a Company's Perspective: A Systematic Review of Methods to Estimate the Cost of Health- Related Productivity Loss. Journal of Occupational Rehabilitation. Mar 2011;21(1):90-99.
4. Lerner D, Rodday AM, Cohen JT, Rogers WH. A Systematic Review of the Evidence Concerning the Economic Impact of Employee-Focused Health Promotion and Wellness Programs. J. Occup. Environ. Med. 2013;55(2):209-222.
5. van Dongen JM, Proper KI, van Wier MF, et al. Systematic review on the financial return of worksite health promotion programmes aimed at improving nutrition and/or increasing physical activity. Obes Rev. Dec 2011;12(12):1031-1049. 6. Baicker K, Cutler D, Song Z. Workplace wellness programs can generate savings.
Health Aff. (Millwood). Feb 2010;29(2):304-311.
7. Chapman LS. Meta-evaluation of worksite health promotion economic return studies: 2012 update. Am. J. Health Promot. Mar-Apr 2012;26(4):TAHP1-TAHP12. 8. Goetzel RZ, Juday TR, Ozminkowski RJ. What’s the ROI. A systematic review of
return on investment (ROI) studies of corporate health and productivity management initiatives. AWHP's Worksite Health. 1999:12-21.
9. Aldana SG. Financial impact of health promotion programs: a comprehensive review of the literature. Am. J. Health Promot. May-Jun 2001;15(5):296-320. 10. Chapman LS. Meta-evaluation of worksite health promotion economic return
studies: 2005 update. Am. J. Health Promot. Jul-Aug 2005;19(6):1-11.
11. Pelletier KR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: update VIII 2008 to 2010. J. Occup. Environ. Med. Nov 2011;53(11):1310- 1331.
12. Chiou CF, Hay JW, Wallace JF, et al. Development and validation of a grading system for the quality of cost-effectiveness studies. Med. Care. Jan 2003;41(1):32- 44.
13. Oxman A, Group GW. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(19):1490-1494.
14. Evers S, Goossens M, de Vet H, van Tulder M, Ament A. Criteria list for assessment of methodological quality of economic evaluations: Consensus on Health Economic Criteria. Int. J. Technol. Assess. Health Care. Spring 2005;21(2):240-245.
15. Centre for Reviews and Dissemination. Systematic Reviews: CRD's guidance for undertaking reviews in health care, 3rd edn. Available at
http://www.york.ac.uk/inst/crd/index_guidance.htm Accessed August 4, 2011.
York: Centre for Reviews and Dissemination2009.
16. University of York. Database of Abstracts of Reviews of Effects. Available at
http://www.crd.york.ac.uk/crdweb/ Accessed October 2011.
17. Shemilt I MM, Vale L, Marsh K, Donaldson C (editors). Evidence-based decisions and economics : health care, social welfare, education and criminal justice. 2nd ed. Chichester, West Sussex, UK ; Hoboken, NJ: Wiley-Blackwell/BMJ Books; 2010. 18. Campbell and Cochrane Economics Methods Group. Campbell and Cochrane
Economics Methods Group; How to add Health Economics to Cochrane Protocols Available from http://www.c-cemg.org/ [Accessed October 10, 2011].
19. National Institute for Health and Clinical Excellence. The Guidelines Manual: Chapter 8; Incorportaing health economics in guidelines and assessing resource impact (April 2007)
http://www.nice.org.uk/niceMedia/pdf/GuidelinesManualChapter8.pdf. 2007. 20. National Institute for Health and Clinical Excellence. The Guidelines Manual:
Appendix H: Methodology checklist - economic evaluations (January 2009)
http://www.nice.org.uk/media/633/71/The_guidelines_manual_2009_- _Appendix_H_Methodology_checklist_-_economic_evaluations.pdf. 2009. 21. Philips Z, Bojke L, Sculpher M, Claxton K, Golder S. Good practice guidelines for
decision-analytic modelling in health technology assessment: a review and consolidation of quality assessment. Pharmacoeconomics. 2006;24(4):355-371. 22. Husereau D DM, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs
AH, Mauskopf J, Loder E,. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMC Medicine. 2013;11(80).
23. Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The BMJ Economic Evaluation Working Party.
BMJ. Aug 3 1996;313(7052):275-283.
24. Stone PW. Return-on-investment models. Applied nursing research: ANR.
2005;18(3):186.
25. Finkelstein EA, Linnan LA, Tate DF, Leese PJ. A longitudinal study on the
relationship between weight loss, medical expenditures, and absenteeism among overweight employees in the WAY to Health study. J. Occup. Environ. Med. Dec 2009;51(12):1367-1373.
26. Deitz D, Cook R, Hersch R. Workplace health promotion and utilization of health services: Follow-up data findings. Journal of Behavioral Health Services and Research. 2005;32(3):306-319.
27. Millot JL, Aymard M, Bardol A. Reduced efficiency of influenza vaccine in
prevention of influenza-like illness in working adults: A 7 month prospective survey in EDF Gaz de France employees, in Rhône-Alpes, 1996-1997. Occup. Med.
2002;52(5):281-292.
28. Serxner S, Gold D, Anderson D, Williams D. The impact of a worksite health promotion program on short-term disability usage. J. Occup. Environ. Med. Jan
29. Chung M, Melnyk P, Blue D, Renaud D, Breton MC. Worksite health promotion: The value of the tune Up your heart program. Population Health Management.
2009;12(6):297-304.
30. Chenoweth DH, Garrett J. Cost-effectiveness analysis of a worksite clinic: is it worth the cost? AAOHN journal : official journal of the American Association of
Occupational Health Nurses. 2006;54(2):84-89; quiz 90-91.
31. Ide R, Mizoue T, Tsukiyama Y, Ikeda M, Yoshimura T. Evaluation of oral health promotion in the workplace: the effects on dental care costs and frequency of dental visits. Community Dent. Oral Epidemiol. Jun 2001;29(3):213-219.
32. Nelson DJ, Sennett L, Lefebvre RC. A campaign strategy for weight loss at worksites.
Health Educ. Res. 1987;2(1):27-31.
33. Renaud L, Kishchuk N, Juneau M, Nigam A, Tetreault K, Leblanc MC.
Implementation and outcomes of a comprehensive worksite health promotion program. Canadian Journal of Public Health. 2008;99(1):73-77.
34. Schwartz SM, Day B, Wildenhaus K, Silberman A, Wang C, Silberman J. The impact of an online disease management program on medical costs among health plan members. Am. J. Health Promot. 2010;25(2):126-133.
35. Nyman JA, Abraham JM, Jeffery MM, Barleen NA. The Effectiveness of a Health Promotion Program After 3 Years: Evidence From the University of Minnesota.
Med. Care. Jun 6 2012;50(9):772-778.
36. Shi L. Health promotion, medical care use, and costs in a sample of worksite employees. Evaluation Review. 1993;17(5):475-487.
37. Ozminkowski RJ, Dunn RL, Goetzel RZ, Cantor RI, Murnane J, Harrison M. A return on investment evaluation of the Citibank, N.A., health management program. Am. J. Health Promot. Sep-Oct 1999;14(1):31-43.
38. Henke RM, Goetzel RZ, McHugh J, Isaac F. Recent experience in health promotion at Johnson & Johnson: Lower health spending, strong return on investment. Health Aff. (Millwood). 2011;30(3):490-499.
39. Baker KM, Goetzel RZ, Pei X, et al. Using a return-on-investment estimation model to evaluate outcomes from an obesity management worksite health promotion program. J. Occup. Environ. Med. Sep 2008;50(9):981-990.
40. McEachan RR, Lawton RJ, Jackson C, Conner M, Meads DM, West RM. Testing a workplace physical activity intervention: a cluster randomized controlled trial. Int J Behav Nutr Phys Act. 2011;8:29.
41. Australian Government: Department of Innovation Industry Science and Research.
Key Statistics: Australian Small Businesses. Canberra ACT2011.
42. Cohen P, Darling C, Hampson A, Downs K, Tasset-Tisseau A. Influenza vaccination in an occupational setting: effectiveness and cost-benefit study (Structured abstract).
Journal of Occupational Health and Safety - Australia and New Zealand.
2003(2):167-182.
http://www.mrw.interscience.wiley.com/cochrane/cleed/articles/NHSEED- 22003009406/frame.html.
43. At'kov O, Azarov A, Zhukov D, Nicoloyannis N, Durand L. Influenza Vaccination in Healthy Working Adults in Russia: Observational Study of Effectiveness and Return on Investment for the Employer. Applied Health Economics and Health Policy.
2011;9(2):89-99.
44. Gibbs JO, Mulvaney D, Henes C, Reed RW. Work-site health promotion. Five-year trend in employee health care costs. J. Occup. Med. Nov 1985;27(11):826-830. 45. Wood EA, Olmstead GW, Craig JL. An evaluation of lifestyle risk factors and
absenteeism after two years in a worksite health promotion program. Am. J. Health Promot. 1989;4(2):128-133.
46. Milani RV, Lavie CJ. Impact of worksite wellness intervention on cardiac risk factors and one-year health care costs. Am. J. Cardiol. Nov 15 2009;104(10):1389-1392. 47. Tao X, Chenoweth D, Alfriend AS, et al. Monitoring worksite clinic performance
using a cost-benefit tool. J. Occup. Environ. Med. 2009;51(10):1151-1157. 48. Aldana SG, Merrill RM, Price K, Hardy A, Hager R. Financial impact of a
comprehensive multisite workplace health promotion program. Prev. Med. Feb 2005;40(2):131-137.
49. Ichihashi T, Muto T, Shibuya K. Cost-benefit analysis of a worksite oral-health promotion program. Ind. Health. Jan 2007;45(1):32-36.
50. Bertera RL. The effects of workplace health promotion on absenteeism and employment costs in a large industrial population. Am. J. Public Health. Sep 1990;80(9):1101-1105.
51. Campbell DS, Rumley MH. Cost-effectiveness of the influenza vaccine in a healthy, working-age population. J. Occup. Environ. Med. 1997;39(5):408-414.
52. Bridges CB, Thompson WW, Meltzer MI, et al. Effectiveness and cost-benefit of influenza vaccination of healthy working adults. JAMA: the journal of the American Medical Association. 2000;284(13):1655-1663.
53. Colombo GL, Ferro A, Vinci M, Zordan M, Serra G. Cost-benefit analysis of influenza vaccination in a public healthcare unit. Therapeutics and Clinical Risk Management.
2006;2(2):219-226.
54. Dille JH. A worksite influenza immunization program: Impact on lost work days, health care utilization, and health care spending. AAOHN J. 1999;47(7):301-309. 55. Samad AH, Usul MHBHJ, Zakaria D, et al. Workplace vaccination against influenza in
Malaysia: Does the employer benefit? J. Occ. Health 2006; 48(1):1-10.
56. Morales A, Martinez MM, Tasset-Tisseau A, Rey E, Baron-Papillon F, Follet A. Costs and benefits of influenza vaccination and work productivity in a Colombian
company from the employer's perspective. Value in Health. 2004;7(4):433-441. 57. Kumpulainen V, Makela M. Influenza vaccination among healthy employees: a cost-
benefit analysis. Scand. J. Infect. Dis. 1997(2):181-185.
http://www.mrw.interscience.wiley.com/cochrane/cleed/articles/NHSEED- 21997000750/frame.html.
Darmkrebsscreening im betrieblichen Umfeld: Kosten-Nutzen-Analyse einer Maßnahme zur Gesundheitsförderung bei Boehringer Ingelheim.
2011;136(20):1047-1052.
59. Schrammel P, Griffiths RI, Griffiths CB. A workplace breast cancer screening program: Costs and components. AAOHN J. 1998;46(11):523-529.
60. Shore G, Prasad P, Zrobak M. Metrofit: A cost-effective fitness program. Fitness in Business. 1989;4:147-153.
61. Shephard RJ. Twelve years experience of a fitness program for the salaried employees of a Toronto Life Assurance Company. Am. J. Health Promot.
1992;6(4):292-301.
62. Mills PR, Kessler RC, Cooper J, Sullivan S. Impact of a health promotion program on employee health risks and work productivity. Am. J. Health Promot. Sep-Oct 2007;22(1):45-53.
63. American Heart Association Division of Planning. Heart at Work: Technical report, extended field studies. 1987.
64. Goetzel RZ, Ozminkowski RJ, Baase CM, Billotti GM. Estimating the return-on- investment from changes in employee health risks on the Dow Chemical Company's health care costs. J. Occup. Environ. Med. Aug 2005;47(8):759-768. 65. Golaszewski T, Snow D, Lynch W, Yen L, Solomita D. A benefit-to-cost analysis of a
work-site health promotion program. J. Occup. Med. Dec 1992;34(12):1164-1172. 66. Greene BL, Miller JD, Brown TM, Harshman RS, Richerson GT, Doyle JJ. Economic
impact of the BP DownShift Program on blood pressure control among commercial driver license employees. J. Occup. Environ. Med. May 2009;51(5):542-553.
67. Groeneveld IF, van Wier MF, Proper KI, Bosmans JE, van Mechelen W, van der Beek AJ. Cost-effectiveness and cost-benefit of a lifestyle intervention for workers in the construction industry at risk for cardiovascular disease. J. Occup. Environ. Med.
2011;53(6):610.
68. Meenan RT, Vogt TM, Williams AE, Stevens VJ, Albright CL, Nigg C. Economic evaluation of a worksite obesity prevention and intervention trial among hotel workers in Hawaii. J. Occup. Environ. Med. 2010;52(SUPPL. 1):S8-S13.
69. Proper KI, de Bruyne MC, Hildebrandt VH, van der Beek AJ, Meerding WJ, van Mechelen W. Costs, benefits and effectiveness of worksite physical activity counseling from the employer's perspective. Scand. J. Work. Environ. Health.
2004;30(1):36-46.
70. Taimela S, Justén S, Aronen P, et al. An occupational health intervention programme for workers at high risk for sickness absence. Cost effectiveness analysis based on a randomised controlled trial. Occup. Environ. Med.
2008;65(4):242-248.
71. Bowne DW, Russell ML, Morgan JL, Optenberg SA, Clarke AE. Reduced disability and health care costs in an industrial fitness program. J. Occup. Environ. Med.
1984;26(11):809.
Austin, Texas: partnership between Steps to a Healthier Austin and Capital
Metropolitan Transportation Authority. Preventing chronic disease. 2009;6(2):A60. 73. Leutzinger J, Hawes C, Hunnicutt D, Richling D. Predicting the ratio of benefit to
cost in a cardiovascular disease-prevention program. Managing Employee Health Benefits. 1995;3:1-10.
74. Schultz AB, Lu C, Barnett TE, et al. Influence of participation in a worksite health- promotion program on disability days. J. Occup. Environ. Med. Aug 2002;44(8):776- 780.
75. Windsor RA, Lowe JB. Behavioral impact and cost analysis of a worksite self-help smoking cessation program. Prog. Clin. Biol. Res. 1989;293:231-242.
76. Yen L, Schultz AB, Schaefer C, Bloomberg S, Edington DW. Long-term return on investment of an employee health enhancement program at a Midwest utility company from 1999 to 2007. International Journal of Workplace Health Management. 2010;3(2):79-96.
77. Aldana SG, Jacobson BH, Harris CJ, Kelley PL, Stone WJ. Influence of a mobile worksite health promotion program on health care costs. Am. J. Prev. Med. Nov- Dec 1993;9(6):378-383.
78. Gettman L. Cost/benefit analysis of a corporate fitness program. Fitness in Business. 1986;1(1):11-17.
79. Naydeck BL, Pearson JA, Ozminkowski RJ, Day BT, Goetzel RZ. The impact of the highmark employee wellness programs on 4-year healthcare costs. J. Occup. Environ. Med. Feb 2008;50(2):146-156.
80. Harris JS. Northern Telecom: A million dollar medically based program in a rapidly changing high tech environment. Am. J. Health Promot. 1986;1(1):50-84.
81. Merrill RM, Hyatt B, Aldana SG, Kinnersley D. Lowering Employee Health Care Costs Through the Healthy Lifestyle Incentive Program. J. Public Health Manag. Pract.
May-Jun 2011;17(3):225-232.
82. Bertera RL, Oehl LK, Telepchak JM. Self-help versus group approaches to smoking cessation in the workplace: Eighteen-month follow-up and cost analysis. Am. J. Health Promot. 1990;4(3):187-192.
83. Serxner S, Adams VG, Hundahl LS, Lau S, Adessa Jr CJ, Hopkins D. A smoking cessation pilot program. Hawaii Med. J. 1993;52(10):266-272.
84. Harvey MR, Whitmer RW, Hilyer JC, Brown KC. The impact of a comprehensive medical benefit cost management program for the city of Birmingham: results at five years. Am. J. Health Promot. 1993;7(4):296-303.
85. Foote A, Erfurt JC. The benefit to cost ratio of work-site blood pressure control programs. JAMA: the journal of the American Medical Association.
1991;265(10):1283-1286.
86. Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies. The statistician. 1983;32(3):307-317.
worksite: update VI 2000-2004. J. Occup. Environ. Med. Oct 2005;47(10):1051- 1058.
88. Pelletier KR. A review and analysis of the clinical and cost-effectiveness studies of comprehensive health promotion and disease management programs at the worksite: 1995-1998 update (IV). Am. J. Health Promot. Jul-Aug 1999;13(6):333- 345, iii.
89. Hamberg-van Reenen HH, Proper KI, van den Berg M. Worksite mental health interventions: a systematic review of economic evaluations. Occup. Environ. Med.
Aug 3 2012;69:837-845.
90. Shephard RJ, Corey P, Renzland P, Cox M. The influence of an employee fitness and lifestyle modification program upon medical care costs. Can. J. Public Health.
1982;73(4):259.
91. Tsai SP, Bernacki EJ, Baun WB. Injury prevalence and associated costs among participants of an employee fitness program. Prev. Med. 1988;17(4):475-482. 92. Stein AD, Karel T, Zuidema R. Carrots and sticks: impact of an incentive/disincentive
employee flexible credit benefit plan on health status and medical costs. Am. J. Health Promot. May-Jun 1999;13(5):260-267.
93. Shimizu T, Nagashima S, Mizoue T, Higashi T, Nagata S. A psychosocial-approached health promotion program at a Japanese worksite. J UOEH. Mar 1 2003;25(1):23- 34.
94. Shi L. Worksite health promotion and changes in medical care use and sick days.
Health Values: The Journal of Health Behavior, Education & Promotion.
1993;17(5):9-17.
95. Maes S, Verhoeven C, Kittel F, Scholten H. Effects of a Dutch work-site wellness- health program: the Brabantia Project. Am. J. Public Health. 1998;88(7):1037-1041. 96. Lynch WD, Golaszewski TJ, Clearie AF, Snow D, Vickery DM. Impact of a facility-
based corporate fitness program on the number of absences from work due to illness. Journal of occupational medicine.: official publication of the Industrial Medical Association. 1990;32(1):9.
97. Knight KK, Goetzel RZ, Fielding JE, et al. An evaluation of Duke University's LIVE FOR LIFE health promotion program on changes in worker absenteeism. J. Occup. Med.
May 1994;36(5):533-536.
98. Jeffery RW, Forster JL, Dunn BV, French SA, McGovern PG, Lando HA. Effects of work-site health promotion on illness-related absenteeism. J. Occup. Environ. Med.
1993;35(11):1142.
99. Hodges LC, Harper TS, Hall-Barrow J, Tatom ID. Reducing overall health care costs for a city municipality: a real life community based learning model. AAOHN journal: official journal of the American Association of Occupational Health Nurses.
2004;52(6):247.
100. Hall-Barrow J, Hodges L, Brown P. A collaborative model for employee health and nursing education. Successful program. AAOHN journal: official journal of the American Association of Occupational Health Nurses. 2001;49(9):429.
101. Goetzel RZ, Dunn RL, Ozminkowski RJ, Satin K, Whitehead D, Cahill K. Differences between descriptive and multivariate estimates of the impact of Chevron
Corporation's Health Quest program on medical expenditures. J. Occup. Environ. Med. 1998;40(6):538.
102. Dalton BA, Harris JS. A comprehensive approach to corporate health management. J. Occup. Environ. Med. 1991;33(3):338.
103. Edington DW, Yen LT, Witting P. The financial impact of changes in personal health practices. J. Occup. Environ. Med. 1997;39(11):1037-1046.
104. Conrad KM, Riedel J, Gibbs J. Effect of worksite health promotion programs on employee absenteeism. A comparative analysis. AAOHN journal: official journal of the American Association of Occupational Health Nurses. 1990;38(12):573.
105. Cady Jr LD, Thomas PC, Karwasky RJ. Program for increasing health and physical fitness of fire fighters. J. Occup. Environ. Med. 1985;27(2):110.
106. Bertera RL. Behavioral risk factor and illness day changes with workplace health promotion: two-year results. Am. J. Health Promot. May-Jun 1993;7(5):365-373. 107. Baun WB, Bernacki EJ, Tsai SP. A preliminary investigation: effect of a corporate
fitness program on absenteeism and health care cost. J. Occup. Med. Jan 1986;28(1):18-22.
108. Anderzén I, Arnetz BB. The impact of a prospective survey-based workplace intervention program on employee health, biologic stress markers, and organizational productivity. J. Occup. Environ. Med. 2005;47(7):671.
109. Trudeau JV, Deitz DK, Cook RF. Utilization and cost of behavioral health services: employee characteristics and workplace health promotion. The Journal of
Behavioral Health Services and Research. 2002;29(1):61-74.
110. Bly JL, Jones RC, Richardson JE. Impact of worksite health promotion on health care costs and utilization. Evaluation of Johnson & Johnson's Live for Life program.