Skip to main content
Top
Published in: Health Research Policy and Systems 1/2015

Open Access 01-12-2016 | Research

Impact of tailored blogs and content on usage of Web CIPHER – an online platform to help policymakers better engage with evidence from research

Authors: Steve R. Makkar, Megan Howe, Anna Williamson, Frances Gilham

Published in: Health Research Policy and Systems | Issue 1/2015

Login to get access

Abstract

Background

There is a need to develop innovations that can help bridge the gap between research and policy. Web CIPHER is an online tool designed to help policymakers better engage with research in order to increase its use in health policymaking. The aim of the present study was to test interventions in order to increase policymakers’ usage of Web CIPHER. Namely, the impact of posting articles and blogs on topics relevant to the missions and scope of selected policy agencies in the Web CIPHER community.

Methods

Five policy agencies were targeted for the intervention. Web CIPHER usage data was gathered over a 30-month period using Google Analytics. Time series analysis was used to evaluate whether publication of tailored articles and blogs led to significant changes in usage for all Web CIPHER members from policy agencies, including those from the five target agencies. We further evaluated whether these users showed greater increases in usage following publication of articles and blogs directly targeted at their agency, and if these effects were moderated by the blog author.

Results

Web CIPHER usage gradually increased over time and was significantly predicted by the number of articles but not blogs that were posted throughout the study period. Publication of articles on sexual and reproductive health was followed by sustained increases in usage among all users, including users from the policy agency that targets this area. This effect of topic relevance did not occur for the four remaining target agencies. Finally, page views were higher for articles targeted at one’s agency compared to other agencies. This effect also occurred for blogs, particularly when the author was internal to one’s agency.

Conclusion

The findings suggest that Web CIPHER usage in general was motivated by general interest, engagement and appeal, as opposed to the agency specificity of content and work relevance. Blogs in and of themselves may not be effective at promoting usage. Thus, in order to increase policymakers’ engagement with research through similar online platforms, a potentially effective approach would be to post abundant, frequently updated, engaging, interesting and widely appealing content irrespective of form.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference LaRocca R, Yost J, Dobbins M, Ciliska D, Butt M. The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health. 2012;12:751.CrossRefPubMedPubMedCentral LaRocca R, Yost J, Dobbins M, Ciliska D, Butt M. The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health. 2012;12:751.CrossRefPubMedPubMedCentral
3.
go back to reference Perrier L, Mrklas K, Lavis JN, Straus SE. Interventions encouraging the use of systematic reviews by health policymakers and managers: a systematic review. Implement Sci. 2011;6:43.CrossRefPubMedPubMedCentral Perrier L, Mrklas K, Lavis JN, Straus SE. Interventions encouraging the use of systematic reviews by health policymakers and managers: a systematic review. Implement Sci. 2011;6:43.CrossRefPubMedPubMedCentral
4.
go back to reference Moore G, Redman S, Haines M, Todd A. Strategies to increase the use of evidence from research in population health policy & programs: a rapid review. Evid Policy. 2011;7(3):277–305.CrossRef Moore G, Redman S, Haines M, Todd A. Strategies to increase the use of evidence from research in population health policy & programs: a rapid review. Evid Policy. 2011;7(3):277–305.CrossRef
5.
go back to reference Williamson A, Makkar SR, McGrath C, Redman S. How can the use of evidence in mental health policy be increased? A systematic review. Psychiatr Serv. 2015;66(8):783–97.CrossRefPubMed Williamson A, Makkar SR, McGrath C, Redman S. How can the use of evidence in mental health policy be increased? A systematic review. Psychiatr Serv. 2015;66(8):783–97.CrossRefPubMed
6.
go back to reference Forsetlund L, Bradley P, Forsen L, Nordheim L, Jamtvedt G, Bjorndal A. Randomised controlled trial of a theoretically grounded tailored intervention to diffuse evidence-based public health practice [ISRCTN23257060]. BMC Med Educ. 2003;3:2.CrossRefPubMedPubMedCentral Forsetlund L, Bradley P, Forsen L, Nordheim L, Jamtvedt G, Bjorndal A. Randomised controlled trial of a theoretically grounded tailored intervention to diffuse evidence-based public health practice [ISRCTN23257060]. BMC Med Educ. 2003;3:2.CrossRefPubMedPubMedCentral
7.
go back to reference Di Noia J, Schwinn TM, Dastur ZA, Schinke SP. The relative efficacy of pamphlets, CD-ROM, and the Internet for disseminating adolescent drug abuse prevention programs: an exploratory study. Prev Med. 2003;37(6 Pt 1):646–53.CrossRefPubMedPubMedCentral Di Noia J, Schwinn TM, Dastur ZA, Schinke SP. The relative efficacy of pamphlets, CD-ROM, and the Internet for disseminating adolescent drug abuse prevention programs: an exploratory study. Prev Med. 2003;37(6 Pt 1):646–53.CrossRefPubMedPubMedCentral
8.
go back to reference O'Donnell S, Cranney A, Jacobson MJ, Graham ID, O'Connor AM, Tugwell P. Understanding and overcoming the barriers of implementing patient decision aids in clinical practice. J Eval Clin Pract. 2006;23(2):174–81.CrossRef O'Donnell S, Cranney A, Jacobson MJ, Graham ID, O'Connor AM, Tugwell P. Understanding and overcoming the barriers of implementing patient decision aids in clinical practice. J Eval Clin Pract. 2006;23(2):174–81.CrossRef
9.
go back to reference Purvis RL, Sambamurthy V, Zmud RW. The assimilation of knowledge platforms in organizations: an empirical investigation. Organ Sci. 2001;12(2):117–35.CrossRef Purvis RL, Sambamurthy V, Zmud RW. The assimilation of knowledge platforms in organizations: an empirical investigation. Organ Sci. 2001;12(2):117–35.CrossRef
10.
go back to reference El-Jardali F, Lavis JN, Ataya N, Jamal D. Use of health systems and policy research evidence in the health policymaking in eastern Mediterranean countries: views and practices of researchers. Implement Sci. 2012;7:2.CrossRefPubMedPubMedCentral El-Jardali F, Lavis JN, Ataya N, Jamal D. Use of health systems and policy research evidence in the health policymaking in eastern Mediterranean countries: views and practices of researchers. Implement Sci. 2012;7:2.CrossRefPubMedPubMedCentral
11.
go back to reference Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002;7(4):239–44.CrossRefPubMed Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002;7(4):239–44.CrossRefPubMed
12.
go back to reference Mirzoev TN, Omar MA, Green AT, Bird PK, Lund C, Ofori-Atta A, Doku V. Research-policy partnerships - experiences of the Mental Health and Poverty Project in Ghana, South Africa, Uganda and Zambia. Health Res Policy Syst. 2012;10:30.CrossRefPubMedPubMedCentral Mirzoev TN, Omar MA, Green AT, Bird PK, Lund C, Ofori-Atta A, Doku V. Research-policy partnerships - experiences of the Mental Health and Poverty Project in Ghana, South Africa, Uganda and Zambia. Health Res Policy Syst. 2012;10:30.CrossRefPubMedPubMedCentral
13.
go back to reference Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14:2.CrossRefPubMedPubMedCentral Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14:2.CrossRefPubMedPubMedCentral
14.
go back to reference Hennink M, Stephenson R. Using research to inform health policy: barriers and strategies in developing countries. J Health Commun. 2006;10:163–80.CrossRef Hennink M, Stephenson R. Using research to inform health policy: barriers and strategies in developing countries. J Health Commun. 2006;10:163–80.CrossRef
15.
go back to reference de Goede J, Putters P, van Ger Grinten T, van Oers HAM. Knowledge in process? Exploring barriers between epidemiological research and local health policy development. Health Res Policy Syst. 2010;8:26.CrossRefPubMedPubMedCentral de Goede J, Putters P, van Ger Grinten T, van Oers HAM. Knowledge in process? Exploring barriers between epidemiological research and local health policy development. Health Res Policy Syst. 2010;8:26.CrossRefPubMedPubMedCentral
16.
go back to reference Ellen ME, Leon G, Bouchard G, Lavis JN, Ouimet M, Grimshaw JM. What supports do health system organizations have in place to facilitate evidence-informed decision-making? A qualitative study. Implement Sci. 2013;8:84.CrossRefPubMedPubMedCentral Ellen ME, Leon G, Bouchard G, Lavis JN, Ouimet M, Grimshaw JM. What supports do health system organizations have in place to facilitate evidence-informed decision-making? A qualitative study. Implement Sci. 2013;8:84.CrossRefPubMedPubMedCentral
17.
go back to reference Makkar S, Gilham F, Williamson A, Bisset K. Usage of an online tool to help policymakers better engage with research: Web CIPHER. Implement Sci. 2015;10:56.CrossRefPubMedPubMedCentral Makkar S, Gilham F, Williamson A, Bisset K. Usage of an online tool to help policymakers better engage with research: Web CIPHER. Implement Sci. 2015;10:56.CrossRefPubMedPubMedCentral
18.
go back to reference Cutroni J. Google Analytics. Sebastopol: O'Reilly Media; 2010. Cutroni J. Google Analytics. Sebastopol: O'Reilly Media; 2010.
19.
go back to reference Braun MT. Obstacles to social networking website use among older adults. Comput Human Behav. 2013;29:673–80.CrossRef Braun MT. Obstacles to social networking website use among older adults. Comput Human Behav. 2013;29:673–80.CrossRef
20.
go back to reference Chen R. Member use of social networking sites - an empirical examination. Decis Support Syst. 2013;54:1219–27.CrossRef Chen R. Member use of social networking sites - an empirical examination. Decis Support Syst. 2013;54:1219–27.CrossRef
21.
go back to reference Li D, Browne GJ, Chau PYK. An empirical investigation of web site use using a commitment-based model. Decis Sci. 2006;37(3):427–44.CrossRef Li D, Browne GJ, Chau PYK. An empirical investigation of web site use using a commitment-based model. Decis Sci. 2006;37(3):427–44.CrossRef
22.
go back to reference Mantymaki M, Merikivi J. Investigating the drivers of the continuous use of social virtual worlds, Proceedings of the 43rd Hawaii international conference on system sciences: 5–8 June, 2010. Koloa Kauai: IEEE Computer Society; 2010. p. 1–10. Mantymaki M, Merikivi J. Investigating the drivers of the continuous use of social virtual worlds, Proceedings of the 43rd Hawaii international conference on system sciences: 5–8 June, 2010. Koloa Kauai: IEEE Computer Society; 2010. p. 1–10.
23.
go back to reference Sledgianowski D, Kuliviwat S. Using social network sites: the effects of playfulness, critical mass and trust in a hedonic context. J Comput Inf Syst. 2009;49(4):74–83. Sledgianowski D, Kuliviwat S. Using social network sites: the effects of playfulness, critical mass and trust in a hedonic context. J Comput Inf Syst. 2009;49(4):74–83.
24.
go back to reference Lazaric N, Longhi C, Thomas C. Gatekeepers of knowledge versus platforms of knowledge: from potential to realized absorptive capacity. Reg Stud. 2008;42(6):837–52.CrossRef Lazaric N, Longhi C, Thomas C. Gatekeepers of knowledge versus platforms of knowledge: from potential to realized absorptive capacity. Reg Stud. 2008;42(6):837–52.CrossRef
25.
go back to reference Sumner A, Crichton J, Theobald S, Zulu E, Parkhurst J. What shapes research impact on policy? Understanding research uptake in sexual and reproductive health policy processes in resource poor contexts. Health Res Policy Syst. 2011;9 Suppl 1:53.CrossRef Sumner A, Crichton J, Theobald S, Zulu E, Parkhurst J. What shapes research impact on policy? Understanding research uptake in sexual and reproductive health policy processes in resource poor contexts. Health Res Policy Syst. 2011;9 Suppl 1:53.CrossRef
26.
go back to reference Goldner EM, Jenkins EK, Fischer B. A narrative reveiw of recent development in knowledge translation and implications for mental health care providers. Can J Psychiatry. 2014;59(3):160–9.PubMedPubMedCentral Goldner EM, Jenkins EK, Fischer B. A narrative reveiw of recent development in knowledge translation and implications for mental health care providers. Can J Psychiatry. 2014;59(3):160–9.PubMedPubMedCentral
27.
go back to reference Lavis JN, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005;10 Suppl 1:35–48.CrossRefPubMed Lavis JN, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005;10 Suppl 1:35–48.CrossRefPubMed
28.
go back to reference Zardo P, Collie A. Measuring use of research evidence in public health policy: a policy content analysis. Implement Sci. 2014;14:496. Zardo P, Collie A. Measuring use of research evidence in public health policy: a policy content analysis. Implement Sci. 2014;14:496.
29.
30.
go back to reference Ssengooba F, Atuyambe L, Kiwanuka SN, Puvanachandra P, Glass N, Hyder AA. Research translation to inform national health policies: learning from multiple perspectives in Uganda. BMC Int Health Hum Rights. 2011;11 Suppl 1:S13.CrossRefPubMedPubMedCentral Ssengooba F, Atuyambe L, Kiwanuka SN, Puvanachandra P, Glass N, Hyder AA. Research translation to inform national health policies: learning from multiple perspectives in Uganda. BMC Int Health Hum Rights. 2011;11 Suppl 1:S13.CrossRefPubMedPubMedCentral
31.
go back to reference McCaughan D, Thompson C, Cullum N, Sheldon TA, Thompson DR. Acute care nurses' perceptions of barriers to using research information in clinical decision-making. Issues Innov Nurs Prac. 2002;39(1):46–60. McCaughan D, Thompson C, Cullum N, Sheldon TA, Thompson DR. Acute care nurses' perceptions of barriers to using research information in clinical decision-making. Issues Innov Nurs Prac. 2002;39(1):46–60.
32.
go back to reference The CIPHER Investigators. Supporting Policy In health with Research: an Intervention Trial (SPIRIT)-protocol for a stepped wedge trial. BMJ Open. 2014;4(7):e005293.CrossRefPubMedCentral The CIPHER Investigators. Supporting Policy In health with Research: an Intervention Trial (SPIRIT)-protocol for a stepped wedge trial. BMJ Open. 2014;4(7):e005293.CrossRefPubMedCentral
33.
go back to reference Cook TD, Campbell DT. Quasi-experimentation: design and analysis issues for field settings. Chicago: Rand McNally College; 1979. Cook TD, Campbell DT. Quasi-experimentation: design and analysis issues for field settings. Chicago: Rand McNally College; 1979.
34.
go back to reference Corp IBM. IBM SPSS Forecasting 19. Armonk: IBM Corp; 2010. Corp IBM. IBM SPSS Forecasting 19. Armonk: IBM Corp; 2010.
35.
go back to reference Norusis MJ. SPSS 15.0 Advanced Statistical Procedures Companion. Upper Saddle River: Prentice Hall; 2007. Norusis MJ. SPSS 15.0 Advanced Statistical Procedures Companion. Upper Saddle River: Prentice Hall; 2007.
36.
go back to reference Tabachnick BG, Fidell LS. Using Multivariate Statistics. Boston: Allyn and Bacon; 2007. Tabachnick BG, Fidell LS. Using Multivariate Statistics. Boston: Allyn and Bacon; 2007.
37.
go back to reference Wu J, Lu X. Effects of extrinsic and intrinsic motivators on using utilitarian, hedonic, and dual-purposed information systems: a meta-analysis. J Assoc Inf Syst. 2013;14(3):153–91. Wu J, Lu X. Effects of extrinsic and intrinsic motivators on using utilitarian, hedonic, and dual-purposed information systems: a meta-analysis. J Assoc Inf Syst. 2013;14(3):153–91.
38.
go back to reference Reichert T, Walker KM. Sex and magazine promotion. J Promot Manag. 2005;11(2–3):131–41.CrossRef Reichert T, Walker KM. Sex and magazine promotion. J Promot Manag. 2005;11(2–3):131–41.CrossRef
39.
go back to reference Alavi M, Leidner DE. Knowledge management and knowledge management systems: conceptual foundations and research issues. MIS Q. 2001;25(1):107–36.CrossRef Alavi M, Leidner DE. Knowledge management and knowledge management systems: conceptual foundations and research issues. MIS Q. 2001;25(1):107–36.CrossRef
40.
go back to reference Mitton C, Adair CE, McKenzie E, Patten SB, Waye PB. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007;85(4):729–68.CrossRefPubMedPubMedCentral Mitton C, Adair CE, McKenzie E, Patten SB, Waye PB. Knowledge transfer and exchange: review and synthesis of the literature. Milbank Q. 2007;85(4):729–68.CrossRefPubMedPubMedCentral
41.
go back to reference van der Heijden H. Factors influencing the usage of websites: the case of a generic portal in the Netherlands, e-Everything: e-Commerce, e-Government, e-Household, e-Democracy 14th Bled Electronic Commerce Conference. Bled: Moderna organizacija; 2001. van der Heijden H. Factors influencing the usage of websites: the case of a generic portal in the Netherlands, e-Everything: e-Commerce, e-Government, e-Household, e-Democracy 14th Bled Electronic Commerce Conference. Bled: Moderna organizacija; 2001.
42.
go back to reference van der Heijden H. Factors influencing the usage of websites: the case of a generic portal in the Netherlands. Inf Manage. 2003;40(6):541–9.CrossRef van der Heijden H. Factors influencing the usage of websites: the case of a generic portal in the Netherlands. Inf Manage. 2003;40(6):541–9.CrossRef
43.
go back to reference Hur Y, Ko YJ, Claussen CL. Determinants of using sports web portals: an empirical examination of the Sport Website Acceptance Model. Int J Sport Mark Spo. 2012;13(3):169–88. Hur Y, Ko YJ, Claussen CL. Determinants of using sports web portals: an empirical examination of the Sport Website Acceptance Model. Int J Sport Mark Spo. 2012;13(3):169–88.
44.
go back to reference van Schaik P, Ling J. An integrated model of interaction experience for information retrieval in a Web-based encyclopaedia. Interact Comput. 2011;23:18–32.CrossRef van Schaik P, Ling J. An integrated model of interaction experience for information retrieval in a Web-based encyclopaedia. Interact Comput. 2011;23:18–32.CrossRef
45.
go back to reference Hartmann DP, Gottman JM, Jones RR, Gardner W, Kazdin AE, Vaught RS. Interrupted time series analysis and its application to behavioral data. J Appl Behav Anal. 1980;13:543–59.CrossRefPubMedPubMedCentral Hartmann DP, Gottman JM, Jones RR, Gardner W, Kazdin AE, Vaught RS. Interrupted time series analysis and its application to behavioral data. J Appl Behav Anal. 1980;13:543–59.CrossRefPubMedPubMedCentral
46.
go back to reference Hawkes S, K Aulakh B, Jadeja N, Jimenez M, Buse K, Anwar I, Barge S, Odubanjo MO, Shukla A, Ghaffar A, et al. Strengthening capacity to apply health research evidence in policy making: experience from four countries. Health Policy Plann. 2016;31(2):161–70.CrossRef Hawkes S, K Aulakh B, Jadeja N, Jimenez M, Buse K, Anwar I, Barge S, Odubanjo MO, Shukla A, Ghaffar A, et al. Strengthening capacity to apply health research evidence in policy making: experience from four countries. Health Policy Plann. 2016;31(2):161–70.CrossRef
Metadata
Title
Impact of tailored blogs and content on usage of Web CIPHER – an online platform to help policymakers better engage with evidence from research
Authors
Steve R. Makkar
Megan Howe
Anna Williamson
Frances Gilham
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2015
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/s12961-016-0157-5

Other articles of this Issue 1/2015

Health Research Policy and Systems 1/2015 Go to the issue