Skip to main content
Top
Published in: BMC Health Services Research 1/2010

Open Access 01-12-2010 | Research article

Opening the black box of quality improvement collaboratives: an Actor-Network theory approach

Authors: Tineke Broer, Anna P Nieboer, Roland A Bal

Published in: BMC Health Services Research | Issue 1/2010

Login to get access

Abstract

Background

Quality improvement collaboratives are often labeled as black boxes because effect studies usually do not describe exactly how the results were obtained. In this article we propose a way of opening such a black box, by taking up a dynamic perspective based on Actor-Network Theory. We thereby analyze how the problematisation process and the measurement practices are constructed. Findings from this analysis may have consequences for future evaluation studies of collaboratives.

Methods

In an ethnographic design we probed two projects within a larger quality improvement collaborative on long term mental health care and care for the intellectually disabled. Ethnographic observations were made at nine national conferences. Furthermore we conducted six case studies involving participating teams. Additionally, we interviewed the two program leaders of the overall projects.

Results

In one project the problematisation seemed to undergo a shift of focus away from the one suggested by the project leaders. In the other we observed multiple roles of the measurement instrument used. The instrument did not only measure effects of the improvement actions but also changed these actions and affected the actors involved.

Conclusions

Effectiveness statistics ideally should be complemented with an analysis of the construction of the collaborative and the improvement practices. Effect studies of collaboratives could benefit from a mixed methods research design that combines quantitative and qualitative methods.
Literature
1.
go back to reference Committee on Quality of Health Care in America, Institute of Medicine (US): Crossing the quality chasm: A new health system for the 21st century. 2001, Washington. D.C.: National Academy Press Committee on Quality of Health Care in America, Institute of Medicine (US): Crossing the quality chasm: A new health system for the 21st century. 2001, Washington. D.C.: National Academy Press
2.
go back to reference Institute for Healthcare Improvement: The Breakthrough Series: IHI's Collaborative Model for Achieving Breakthrough Improvement. 2003, Institute for Healthcare Improvement Institute for Healthcare Improvement: The Breakthrough Series: IHI's Collaborative Model for Achieving Breakthrough Improvement. 2003, Institute for Healthcare Improvement
3.
go back to reference Schouten LMT, Hulscher MEJL, Everdingen JJE, Huijsman R, Grol RPTM: Evidence for the impact of quality improvement collaboratives: systematic review. Br Med J. 2008, 336 (7659): 1491-1494. 10.1136/bmj.39570.749884.BE.CrossRef Schouten LMT, Hulscher MEJL, Everdingen JJE, Huijsman R, Grol RPTM: Evidence for the impact of quality improvement collaboratives: systematic review. Br Med J. 2008, 336 (7659): 1491-1494. 10.1136/bmj.39570.749884.BE.CrossRef
4.
go back to reference Mittman BS: Creating the evidence base for quality improvement collaboratives. Ann Intern Med. 2004, 140 (11): 897-901.CrossRefPubMed Mittman BS: Creating the evidence base for quality improvement collaboratives. Ann Intern Med. 2004, 140 (11): 897-901.CrossRefPubMed
5.
go back to reference Bate P, Robert G: Studying Health Care "Quality" Qualitatively: The Dilemmas and Tensions between Different Forms of Evaluation Research within the U.K. National Health Service. Qual Health Res. 2002, 12 (7): 966-981. 10.1177/104973202129120386.CrossRefPubMed Bate P, Robert G: Studying Health Care "Quality" Qualitatively: The Dilemmas and Tensions between Different Forms of Evaluation Research within the U.K. National Health Service. Qual Health Res. 2002, 12 (7): 966-981. 10.1177/104973202129120386.CrossRefPubMed
6.
go back to reference Wilson T, Berwick DM, Cleary MPPPD: What do collaborative improvement projects do? Experience from seven countries. Jt Comm Qual Saf. 2003, 29: 85-93. Wilson T, Berwick DM, Cleary MPPPD: What do collaborative improvement projects do? Experience from seven countries. Jt Comm Qual Saf. 2003, 29: 85-93.
8.
go back to reference Bate P, Robert G, McLeod H: Report on the 'breakthrough' Collaborative Approach to Quality and Service Improvement Within Four Regions of the NHS: A Research Based Investigation of the Orthopaedic Services Collaborative Within the Eastern, South and West, South East and Trent Regions. 2002, Birmingham: University of Birmingham, Health Services Management Centre Bate P, Robert G, McLeod H: Report on the 'breakthrough' Collaborative Approach to Quality and Service Improvement Within Four Regions of the NHS: A Research Based Investigation of the Orthopaedic Services Collaborative Within the Eastern, South and West, South East and Trent Regions. 2002, Birmingham: University of Birmingham, Health Services Management Centre
9.
go back to reference Robert G, Hardacre J, Locock L, Bate SP: Evaluating the effectiveness of the Mental Health Collaborative as an approach to bringing about improvements to admission, stay and discharge on acute wards in the Trent and Northern & Yorkshire regions: an action research project. 2002, Birmingham: University of Birmingham Robert G, Hardacre J, Locock L, Bate SP: Evaluating the effectiveness of the Mental Health Collaborative as an approach to bringing about improvements to admission, stay and discharge on acute wards in the Trent and Northern & Yorkshire regions: an action research project. 2002, Birmingham: University of Birmingham
10.
go back to reference van den Berg M, Frenken R, Bal R: Quantitative data management in quality improvement collaboratives. BMC health services research. 2009, 9: 175-10.1186/1472-6963-9-175.CrossRefPubMedPubMedCentral van den Berg M, Frenken R, Bal R: Quantitative data management in quality improvement collaboratives. BMC health services research. 2009, 9: 175-10.1186/1472-6963-9-175.CrossRefPubMedPubMedCentral
11.
go back to reference McMaster T, Vidgen RT, Wastell DG: Technology transfer: diffusion or translation?. Facilitating technology transfer trough partnership: learning from practice and research. Edited by: McMaster T. 1997, London: Chapman & Hall, Ltd, 64-75.CrossRef McMaster T, Vidgen RT, Wastell DG: Technology transfer: diffusion or translation?. Facilitating technology transfer trough partnership: learning from practice and research. Edited by: McMaster T. 1997, London: Chapman & Hall, Ltd, 64-75.CrossRef
12.
go back to reference Latour B: Science in action: How to follow scientists and engineers through society. 1987, Cambridge, Massachusetts: Harvard Univ Pr Latour B: Science in action: How to follow scientists and engineers through society. 1987, Cambridge, Massachusetts: Harvard Univ Pr
13.
go back to reference Latour B: Reassembling the social: An introduction to actor-network-theory. 2005, Oxford: Oxford University Press, USA Latour B: Reassembling the social: An introduction to actor-network-theory. 2005, Oxford: Oxford University Press, USA
14.
go back to reference Callon M: Some elements of a sociology of translation: domestication of the scallops and the fishermen of St Brieuc Bay. Power, action and belief: A new sociology of knowledge. Edited by: Law J. 1986, London: Routledge and Kegan Paul, 196-229. Callon M: Some elements of a sociology of translation: domestication of the scallops and the fishermen of St Brieuc Bay. Power, action and belief: A new sociology of knowledge. Edited by: Law J. 1986, London: Routledge and Kegan Paul, 196-229.
15.
go back to reference Mol A: Ontological politics. A word and some questions. Sociol Rev. 1998, 46 (S): 74-89. 10.1111/1467-954X.46.s.5.CrossRef Mol A: Ontological politics. A word and some questions. Sociol Rev. 1998, 46 (S): 74-89. 10.1111/1467-954X.46.s.5.CrossRef
16.
go back to reference Zuiderent-Jerak T, Strating M, Nieboer A, Bal R: Sociological refigurations of patient safety; ontologies of improvement and 'acting with' quality collaboratives in healthcare. Soc Sci Med. 2009, 69 (12): 1713-1721. 10.1016/j.socscimed.2009.09.049.CrossRefPubMed Zuiderent-Jerak T, Strating M, Nieboer A, Bal R: Sociological refigurations of patient safety; ontologies of improvement and 'acting with' quality collaboratives in healthcare. Soc Sci Med. 2009, 69 (12): 1713-1721. 10.1016/j.socscimed.2009.09.049.CrossRefPubMed
17.
go back to reference Miller P, O'Leary T: Accounting and the construction of the governable person. Accounting, Organizations and Society. 1987, 12 (3): 235-265. 10.1016/0361-3682(87)90039-0.CrossRef Miller P, O'Leary T: Accounting and the construction of the governable person. Accounting, Organizations and Society. 1987, 12 (3): 235-265. 10.1016/0361-3682(87)90039-0.CrossRef
18.
go back to reference Miller P: Governing by numbers: Why calculative practices matter. Social Research. 2001, 68: 379-396. Miller P: Governing by numbers: Why calculative practices matter. Social Research. 2001, 68: 379-396.
19.
go back to reference Ward S: Filling the world with self-esteem: A social history of truth-making. Canadian Journal of Sociology. 1996, 21: 1-23.CrossRef Ward S: Filling the world with self-esteem: A social history of truth-making. Canadian Journal of Sociology. 1996, 21: 1-23.CrossRef
20.
go back to reference Hacking I: The social construction of what?. 1999, Harvard: Harvard University Press Hacking I: The social construction of what?. 1999, Harvard: Harvard University Press
21.
go back to reference Power M: Counting, Control and Calculation: Reflections on Measuring and Management. Human Relations. 2004, 57 (6): 765-783. 10.1177/0018726704044955.CrossRef Power M: Counting, Control and Calculation: Reflections on Measuring and Management. Human Relations. 2004, 57 (6): 765-783. 10.1177/0018726704044955.CrossRef
22.
go back to reference Power M: Organized uncertainty. 2007, Oxford: Oxford University Press Power M: Organized uncertainty. 2007, Oxford: Oxford University Press
23.
go back to reference Sauder M, Espeland WN: The discipline of rankings: tight coupling and organizational change. Am Sociol Rev. 2009, 74 (1): 63-82. 10.1177/000312240907400104.CrossRef Sauder M, Espeland WN: The discipline of rankings: tight coupling and organizational change. Am Sociol Rev. 2009, 74 (1): 63-82. 10.1177/000312240907400104.CrossRef
24.
go back to reference Strating MMH, Zuiderent-Jerak T, Nieboer AP, Bal RA: Evaluating the Care for better collaborative: Results of the first year of evaluation. 2008, Rotterdam: Dept. of Health Policy and Management Strating MMH, Zuiderent-Jerak T, Nieboer AP, Bal RA: Evaluating the Care for better collaborative: Results of the first year of evaluation. 2008, Rotterdam: Dept. of Health Policy and Management
25.
go back to reference Anthony WA: Recovery from mental illness: The guiding vision of the mental health service system in the 1990 s. Psychosocial Rehabilitation Journal. 1993, 16: 11-23.CrossRef Anthony WA: Recovery from mental illness: The guiding vision of the mental health service system in the 1990 s. Psychosocial Rehabilitation Journal. 1993, 16: 11-23.CrossRef
26.
go back to reference Deegan PE: Recovery: The lived experience of rehabilitation. Psychosocial Rehabilitation Journal. 1988, 11 (4): 11-19.CrossRef Deegan PE: Recovery: The lived experience of rehabilitation. Psychosocial Rehabilitation Journal. 1988, 11 (4): 11-19.CrossRef
27.
go back to reference Hilgartner S: The social construction of risk objects: Or, how to pry open networks of risk. Organizations, uncertainties, and risk. Edited by: Short JF, Clarke L. 1992, Boulder, CO: Westview Pr, 39-53. Hilgartner S: The social construction of risk objects: Or, how to pry open networks of risk. Organizations, uncertainties, and risk. Edited by: Short JF, Clarke L. 1992, Boulder, CO: Westview Pr, 39-53.
28.
go back to reference Greenhalgh T, Stones R: Theorising big IT programmes in healthcare: Strong structuration theory meets actor-network theory. Social science & medicine. 2010, 1285-1294. Greenhalgh T, Stones R: Theorising big IT programmes in healthcare: Strong structuration theory meets actor-network theory. Social science & medicine. 2010, 1285-1294.
29.
go back to reference Callon M: Writing and (re) writing devices as tools for managing complexity. Complexities: social studies of knowledge practices. Edited by: Law J, Mol A. 2002, Durham: Duke University Press, 191-217.CrossRef Callon M: Writing and (re) writing devices as tools for managing complexity. Complexities: social studies of knowledge practices. Edited by: Law J, Mol A. 2002, Durham: Duke University Press, 191-217.CrossRef
Metadata
Title
Opening the black box of quality improvement collaboratives: an Actor-Network theory approach
Authors
Tineke Broer
Anna P Nieboer
Roland A Bal
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2010
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-10-265

Other articles of this Issue 1/2010

BMC Health Services Research 1/2010 Go to the issue