Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Development and validation of a survey to measure features of clinical networks

Authors: Bernadette Bea Brown, Mary Haines, Sandy Middleton, Christine Paul, Catherine D’Este, Emily Klineberg, Elizabeth Elliott, on behalf of the Clinical Networks Research Group

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

Networks of clinical experts are increasingly being implemented as a strategy to improve health care processes and outcomes and achieve change in the health system. Few are ever formally evaluated and, when this is done, not all networks are equally successful in their efforts. There is a need to formatively assess the strategic and operational management and leadership of networks to identify where functioning could be improved to maximise impact. This paper outlines the development and psychometric evaluation of an Internet survey to measure features of clinical networks and provides descriptive results from a sample of members of 19 diverse clinical networks responsible for evidence-based quality improvement across a large geographical region.

Methods

Instrument development was based on: a review of published and grey literature; a qualitative study of clinical network members; a program logic framework; and consultation with stakeholders. The resulting domain structure was validated for a sample of 592 clinical network members using confirmatory factor analysis. Scale reliability was assessed using Cronbach’s alpha. A summary score was calculated for each domain and aggregate level means and ranges are reported.

Results

The instrument was shown to have good construct validity across seven domains as demonstrated by a high level of internal consistency, and all Cronbach’s α coefficients were equal to or above 0.75. In the survey sample of network members there was strong reported commitment and belief in network-led quality improvement initiatives, which were perceived to have improved quality of care (72.8 %) and patient outcomes (63.2 %). Network managers were perceived to be effective leaders and clinical co-chairs were perceived as champions for change. Perceived external support had the lowest summary score across the seven domains.

Conclusions

This survey, which has good construct validity and internal reliability, provides a valid instrument to use in future research related to clinical networks. The survey will be of use to health service managers to identify strengths and areas where networks can be improved to increase effectiveness and impact on quality of care and patient outcomes. Equally, the survey could be adapted for use in the assessment of other types of networks.
Appendix
Available only for authorised users
Footnotes
1
Univariate and multivariate analyses examining the relationships between survey domains and main study outcomes, namely quality of care and system-wide change, are reported elsewhere.
 
Literature
1.
Fleury M, Mercier C, Denis J. Regional planning implementation and its impact on integration of a mental health care network. Int J Health Plann Manage. 2002;17(4):315–32.CrossRefPubMed
2.
Hamilton KE, Sullivan FM, Donnan PT, Taylor R, Ikenwilo D, Scott A, et al. A managed clinical network for cardiac services: set-up, operation and impact on patient care. Int J Integr Care. 2005;5:1–13.CrossRef
3.
Laliberte L, Fennell ML, Papandonatos G. The relationship of membership in research networks to compliance with treatment guidelines for early-stage breast cancer. Med Care. 2005;43(5):471–9.CrossRefPubMed
4.
McClellan WM, Frankenfield DL, Frederick PR, Flanders WD, Alfaro-Correa A, Rocco M, et al. Can dialysis therapy be improved? A report from the ESRD Core Indicators Project. Am J Kidney Dis. 1999;34(6):1075–82.CrossRefPubMed
5.
Ray-Coquard I, Philip T, Laroche G, Froger X, Suchaud J-P, Voloch A, et al. A controlled ‘before-after’ study: impact of a clinical guidelines programme and regional cancer network organization on medical practice. Br J Cancer. 2002;86:313–21.CrossRefPubMedPubMedCentral
6.
Ray-Coquard I, Philip T, Laroche G, Froger X, Suchaud J-P, Voloch A, et al. Persistence of Medical Change at Implementation of Clinical Guidelines on Medical Practice: A Controlled Study in a Cancer Network. J Clin Oncol. 2005;23(19):4414–23.CrossRefPubMed
7.
8.
Tolson D, McIntosh J, Loftus L, Cormie P. Developing a managed clinical network in palliative care: a realistic evaluation. Int J Nurs Stud. 2007;44:183–95.CrossRefPubMed
9.
Touati N, Roberge D, Denis JL, Cazale L, Pineault R, Tremblay D. Clinical leaders at the forefront of change in health-care systems: advantages and issues. Lessons learned from the evaluation of the implementation of an integrated oncological services network. Health Serv Manage Res. 2006;19(2):105–22.CrossRefPubMed
10.
Gale C, Santhakumaran S, Nagarajan S, Statnikov Y, Modi N, Neonatal Data Analysis U, et al. Impact of managed clinical networks on NHS specialist neonatal services in England: population based study. BMJ. 2012;344:e2105.CrossRefPubMedPubMedCentral
11.
Cadilhac DA, Pearce DC, Levi CR, Donnan GA. Improvements in the quality of care and health outcomes with new stroke care units following implementation of a clinician-led, health system redesign programme in New South Wales, Australia. Qual Saf Health Care. 2008;17:329–33.CrossRefPubMed
12.
Greene A, Pagliari C, Cunningham S, Donnan P, Evans J, Emslie-Smith A, et al. Do managed clinical networks improve quality of diabetes care? Evidence from a retrospective mixed methods evaluation. Qual Saf Health Care. 2009;18(6):456–61.CrossRefPubMed
13.
Haines M, Brown B, Craig J, D'Este C, Elliott E, Klineberg E, et al. Determinants of successful clinical networks: the conceptual framework and study protocol. Implementation Sci. 2012;7(1):16.CrossRef
14.
Addicott R, McGivern G, Ferlie E. Networks, Organizational Learning and Knowledge Management: NHS Cancer Networks. Public Money Manage. 2006;26(2):87–94.CrossRef
15.
Ahgren B, Axelsson R. Determinants of integrated health care development: chains of care in Sweden. Int J Health Plann Manage. 2007;22(2):145–57.CrossRefPubMed
16.
Goodwin N, 6 P, Peck E, Freeman T, Posaner R. Managing Across Diverse Networks of Care: Lessons from Other Sectors. London: NHS Service Delivery and Organisaton Programme, 2004.
17.
Hamilton KE, Sullivan FM, Donnan PT, Taylor R, Ikenwilo D, Scott A, et al. A managed clinical network for cardiac services: set-up, operation and impact on patient care. Int J Integr Care. 2005;5:e10.CrossRef
18.
Squires JE, Estabrooks CA, O'Rourke HM, Gustavsson P, Newburn-Cook CV, Wallin L. A systematic review of the psychometric properties of self-report research utilization measures used in healthcare. Implementation Sci. 2011;6:83.CrossRef
19.
American Psychological Association. National Council on Measurement in Education, American Educational Research Association: Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 1999.
20.
National Lead Clinicians Group established [press release]. Canberra: Australian Government, Department of Health and Ageing; 2011.
21.
Goodwin N, Perri 6, Peck E, Freeman T, Posaner R. Managing Across Diverse Networks of Care: Lessons from Other Sectors. London: National Co-ordinating Centre for NHS Service Delivery and Organisation; 2004.
22.
McInnes E, Middleton S, Gardner G, Haines M, Haertsch M, Paul CL, et al. A qualitative study of stakeholder views of the conditions for and outcomes of successful clinical networks. BMC Health Serv Res. 2012;12:49.CrossRefPubMedPubMedCentral
23.
Australian Bureau of Statistics. 3101.0 - Australian Demographic Statistics, Sep 2014. Canberra: ABS; 2015.
24.
25.
Braithwaite J, Goulston K. Turning the health system 90° down under. Lancet. 2004;364(9432):397–9.CrossRefPubMed
26.
Stewart GJ, Dwyer JM, Goulston KJ. The Greater Metropolitan Clinical Taskforce: an Australian model for clinician governance. Med J Aust. 2006;184(12):597–8.PubMed
27.
28.
Bate P, Mendel P, Robert GB. Organising for quality: the improvement journeys of leading hospitals in Europe and the United States. Oxon: Radcliffe Publishing Ltd; 2008.
29.
Braithwaite J, Westbrook JI, Ranmuthugala G, Cunningham F, Plumb J, Wiley J, et al. The development, design, testing, refinement, simulation and application of an evaluation framework for communities of practice and social-professional networks. BMC Health Serv Res. 2009;9:162.CrossRefPubMedPubMedCentral
30.
Ovretveit J. Improvement leaders: what do they and should they do? A summary of a review of research. [Review]. Qual Saf Health Care. 2010;19(6):490–2.PubMed
31.
Addicott R, Ferlie E. Understanding power relationships in health care networks. J Health Organ Manag. 2007;21(4-5):393–405.CrossRefPubMed
32.
Ferlie E, Fitzgerald L, McGivern G, Dopson S, Exworthy M. Networks in Health Care: a Comparative Study of Their Management, Impact and Performance. Report for the National Institute for Health Research Service Delivery and Organisation programme. . 2010.
33.
Shipton H, Armstrong C, West M, Dawson J. The impact of leadership and quality climate on hospital performance. Int J Qual Health Care. 2008;20(6):439–45.CrossRefPubMed
34.
Rao PR. Emotional intelligence: The Sine Qua Non for a clinical leadership toolbox. J Commun Disord. 2006;39(4):310–9.CrossRefPubMed
35.
Yukl G. Leadership in Organizations. Fifthth ed. Upper Saddle River: Prentice Hall; 2002.
36.
Ogrinc G, Mooney SE, Estrada C, Foster T, Goldmann D, Hall LW, et al. The SQUIRE (Standards for Quality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration. Qual Saf Health Care. 2008;17(1):i13–32.CrossRefPubMedPubMedCentral
37.
Speroff T, O’Connor GT. Study designs for PDSA quality improvement research. Qual Manag Health Care. 2004;13(1):17–32.CrossRefPubMed
38.
Nies H, Van Linschoten P, Plaisier A, Romijn C. Networks as regional structures for collaboration in integrated care for older people. Barcelona: International Conference on New Research and Developments in Integrated Care 21-22 February; 2003.
39.
Turrini A, Cristofoli D, Frosini F, Nasi G. Networking literature about determinants of network effectiveness. Public Adm. 2010;88(2):528–50.CrossRef
40.
41.
Yano EM, Fleming B, Canelo I, et al. National Survey Results for the Chief of Staff Module of the VHA Clinical Practice Organizational Survey: Technical Monograph 07-CPOS01. In: Department of Veterans Affairs Health Services Research and Development, Center for the Study of Healthcare Provider Behavior, editor. Sepulveda, Calif, US;2007.
42.
43.
Epley N, Gilovich T. When effortful thinking influences judgmental anchoring: differential effects of forewarning and incentives on self-generated and externally provided anchors. J Behav Decis Mak. 2005;18:199–212.CrossRef
44.
Hassan E. Recall bias can be a threat to retrospective and prospective research designs. Internet J Epidemiol. 2006;3(2):4.
45.
Hatcher L. A Step-By-Step Approach to Using the SAS System for Factor Analysis and Structural Equation Modeling. Cary: SAS Institute Inc; 1994.
46.
George D, Mallery P. SPSS for Windows step by step: A simple guide and reference. Boston: Allyn & Bacon; 2003.
47.
Nulty DD. The adequacy of response rates to online and paper surveys: what can be done? Assess Eval High Educ. 2008;33(3):301–14.CrossRef
48.
49.
Kalucy D. Determinants of Effective Clinical Networks: Validation sub-study. Masters Thesis. Sydney: University of New South Wales; 2013.
50.
51.
Metadata
Title
Development and validation of a survey to measure features of clinical networks
Authors
Bernadette Bea Brown
Mary Haines
Sandy Middleton
Christine Paul
Catherine D’Este
Emily Klineberg
Elizabeth Elliott
on behalf of the Clinical Networks Research Group
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1800-0

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue

Study protocol

Improving access to medicines for non-communicable diseases in rural India: a mixed methods study protocol using quasi-experimental design

Research article

General practitioners’ perceptions of public reporting of institution and individual medicine prescribing data

Research article

Compliance with birth dose of Hepatitis B vaccine in high endemic and hard to reach areas in the Colombian amazon: results from a vaccination survey

Research article

Clinical and demographic correlates of medication and visit adherence in a large randomized controlled trial

Erratum

Erratum to: Advanced Practice Pharmacists: a retrospective evaluation of the efficacy and cost of ClinicaL Pharmacist PractitionErs managing ambulatory Medicare patients in North Carolina (APPLE-NC)

Study protocol

Testing a counselling intervention in antenatal care for women experiencing partner violence: a study protocol for a randomized controlled trial in Johannesburg, South Africa