Skip to main content
Top
Published in: BMC Health Services Research 1/2006

Open Access 01-12-2006 | Research article

Coping with methodological dilemmas; about establishing the effectiveness of interventions in routine medical practice

Authors: Yvonne JFM Jansen, Roland Bal, Marc Bruijnzeels, Marleen Foets, Rianne Frenken, Antoinette de Bont

Published in: BMC Health Services Research | Issue 1/2006

Login to get access

Abstract

Background

The aim of this paper is to show how researchers balance between scientific rigour and localisation in conducting pragmatic trial research. Our case is the Quattro Study, a pragmatic trial on the effectiveness of multidisciplinary patient care teams used in primary health care centres in deprived neighbourhoods of two major cities in the Netherlands for intensified secondary prevention of cardiovascular diseases.

Methods

For this study an ethnographic design was used. We observed and interviewed the researchers and the practice nurses. All gathered research documents, transcribed observations and interviews were analysed thematically.

Results

Conducting a pragmatic trial is a continuous balancing act between meeting methodological demands and implementing a complex intervention in routine primary health care. As an effect, the research design had to be adjusted pragmatically several times and the intervention that was meant to be tailor-made became a rather stringent procedure.

Conclusion

A pragmatic trial research is a dynamic process that, in order to be able to assess the validity and reliability of any effects of interventions must also have a continuous process of methodological and practical reflection. Ethnographic analysis, as we show, is therefore of complementary value.
Literature
1.
go back to reference Nutbeam D: The challenge to provide 'evidence' in health promotion. Health Promotion International. 1999, 14 (2): 99-101. 10.1093/heapro/14.2.99.CrossRef Nutbeam D: The challenge to provide 'evidence' in health promotion. Health Promotion International. 1999, 14 (2): 99-101. 10.1093/heapro/14.2.99.CrossRef
2.
go back to reference Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. American Journal of Preventive Medicine. 2005, 28 (5S): 226-230. 10.1016/j.amepre.2005.02.014.CrossRef Anderson LM, Brownson RC, Fullilove MT, Teutsch SM, Novick LF, Fielding J, Land GH: Evidence-based public health policy and practice: promises and limits. American Journal of Preventive Medicine. 2005, 28 (5S): 226-230. 10.1016/j.amepre.2005.02.014.CrossRef
3.
go back to reference Druss B: Evidence based medicine: does it make a difference? Use wisely. British Medical Journal. 2005, 330: 92-10.1136/bmj.330.7482.92.CrossRef Druss B: Evidence based medicine: does it make a difference? Use wisely. British Medical Journal. 2005, 330: 92-10.1136/bmj.330.7482.92.CrossRef
4.
go back to reference McQueen D: Perspectives on health promotion: theory, evidence, practice and the emergence of complexity. Health Promotion International. 2000, 15 (2): 95-97. 10.1093/heapro/15.2.95.CrossRef McQueen D: Perspectives on health promotion: theory, evidence, practice and the emergence of complexity. Health Promotion International. 2000, 15 (2): 95-97. 10.1093/heapro/15.2.95.CrossRef
5.
go back to reference Leys M: Health care policy; qualitative evidence and health technology assessment. Health Policy. 2003, 65: 217-226. 10.1016/S0168-8510(02)00209-9.CrossRef Leys M: Health care policy; qualitative evidence and health technology assessment. Health Policy. 2003, 65: 217-226. 10.1016/S0168-8510(02)00209-9.CrossRef
6.
go back to reference Barnes J, Stein A, Rosenberg WMC: Evidence based medicine and evaluation of mental health services: methodological issues and future directions. Archives of Disease in Childhood. 1999, 80 (3): 280-285.CrossRef Barnes J, Stein A, Rosenberg WMC: Evidence based medicine and evaluation of mental health services: methodological issues and future directions. Archives of Disease in Childhood. 1999, 80 (3): 280-285.CrossRef
7.
go back to reference Blair E: Gold is not always good enough: the shortcomings of randomization when evaluating interventions in small heterogeneous samples. Journal of Clinical Epidemiology. 2004, 57: 1219-1222. 10.1016/j.jclinepi.2004.06.003.CrossRef Blair E: Gold is not always good enough: the shortcomings of randomization when evaluating interventions in small heterogeneous samples. Journal of Clinical Epidemiology. 2004, 57: 1219-1222. 10.1016/j.jclinepi.2004.06.003.CrossRef
8.
go back to reference Roland M, Torgerson DJ: Understanding controlled trials: What are pragmatic trials?. British Medical Journal. 1998, 316: 285.CrossRef Roland M, Torgerson DJ: Understanding controlled trials: What are pragmatic trials?. British Medical Journal. 1998, 316: 285.CrossRef
9.
go back to reference MacPherson H: Pragmatic clinical trials. Complementary Therapies in Medicine. 2004, 12: 136—140. MacPherson H: Pragmatic clinical trials. Complementary Therapies in Medicine. 2004, 12: 136—140.
10.
go back to reference Armitage P: Attitudes in clinical trials. Statistics in Medicine. 1998, 17: 2675-2683. 10.1002/(SICI)1097-0258(19981215)17:23<2675::AID-SIM34>3.0.CO;2-1.CrossRef Armitage P: Attitudes in clinical trials. Statistics in Medicine. 1998, 17: 2675-2683. 10.1002/(SICI)1097-0258(19981215)17:23<2675::AID-SIM34>3.0.CO;2-1.CrossRef
11.
go back to reference Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutical trials. Journal of Chronic Diseases / Journal of Clinical Epidemiology. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.CrossRef Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutical trials. Journal of Chronic Diseases / Journal of Clinical Epidemiology. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.CrossRef
12.
go back to reference Hotopf M: The pragmatic randomised controlled trial. Advances in Psychiatric Treatment. 2002, 8: 326-333. 10.1192/apt.8.5.326.CrossRef Hotopf M: The pragmatic randomised controlled trial. Advances in Psychiatric Treatment. 2002, 8: 326-333. 10.1192/apt.8.5.326.CrossRef
13.
go back to reference Black N: Why we need observational studies to evaluate the effectiveness of health care. British Medical Journal. 1996, 312: 1215-1218.CrossRef Black N: Why we need observational studies to evaluate the effectiveness of health care. British Medical Journal. 1996, 312: 1215-1218.CrossRef
14.
go back to reference Padkin A, Rowan K, Black N: Using high quality clinical databases to complement the results of randomised controlled trials: the case of recombinant human activated protein C. British Medical Journal. 2001, 323: 923-926. 10.1136/bmj.323.7318.923.CrossRef Padkin A, Rowan K, Black N: Using high quality clinical databases to complement the results of randomised controlled trials: the case of recombinant human activated protein C. British Medical Journal. 2001, 323: 923-926. 10.1136/bmj.323.7318.923.CrossRef
15.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J, RIPPLE_Study_Team: Health Service Research; Process evaluation in randomised controlled trials of complex interventions . British Medical Journal. 2006, 332 (7538): 413-416. 10.1136/bmj.332.7538.413.CrossRef Oakley A, Strange V, Bonell C, Allen E, Stephenson J, RIPPLE_Study_Team: Health Service Research; Process evaluation in randomised controlled trials of complex interventions . British Medical Journal. 2006, 332 (7538): 413-416. 10.1136/bmj.332.7538.413.CrossRef
16.
go back to reference Spratley JP: Participation Observation. 1980, Fort Worth/Philadelphia/San Diego/New York/Orlando/Austin/San Antonio/Toronto/Montreal/London/Sydney/Tokyo , Harcourt Brace College Publishers Spratley JP: Participation Observation. 1980, Fort Worth/Philadelphia/San Diego/New York/Orlando/Austin/San Antonio/Toronto/Montreal/London/Sydney/Tokyo , Harcourt Brace College Publishers
17.
go back to reference Creswell JW: Research Design; Qualitative, Quantitative, and Mixed Methods Approaches. 2003, Thousand Oaks / London / New Delhi , SAGE Publications, Inc., 2nd Creswell JW: Research Design; Qualitative, Quantitative, and Mixed Methods Approaches. 2003, Thousand Oaks / London / New Delhi , SAGE Publications, Inc., 2nd
18.
go back to reference Garfinkel H: Studies in Ethnomethodology. 2003, Cambridge , Polity Press in association with Blackwell Publishing Ltd. Garfinkel H: Studies in Ethnomethodology. 2003, Cambridge , Polity Press in association with Blackwell Publishing Ltd.
19.
go back to reference El Fakiri F, Bruijnzeels MA, Hoes AW: Prevention of cardiovascular diseases: focus on modifiable cardiovascular risk. Heart. 2005, 92 (6): 741-745. 10.1136/hrt.2005.068114.CrossRef El Fakiri F, Bruijnzeels MA, Hoes AW: Prevention of cardiovascular diseases: focus on modifiable cardiovascular risk. Heart. 2005, 92 (6): 741-745. 10.1136/hrt.2005.068114.CrossRef
20.
go back to reference Campbell M, Fitzpatrick R, Haines A, Kinmonth AN, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. British Medical Journal. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRef Campbell M, Fitzpatrick R, Haines A, Kinmonth AN, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. British Medical Journal. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRef
21.
go back to reference Marks HM: The Progress of Experiment; Science and Therapeutic reform in the United States, 1900-1990. 1997, Cambridge, UK , Cambridge University Press Marks HM: The Progress of Experiment; Science and Therapeutic reform in the United States, 1900-1990. 1997, Cambridge, UK , Cambridge University Press
22.
go back to reference Ward E, King M, Lloyd M, Bower P, Friedl K: Conducting randomized trials in general practice: methodological and practical issues. British Journal of General Practice. 1999, 49: 919-922. Ward E, King M, Lloyd M, Bower P, Friedl K: Conducting randomized trials in general practice: methodological and practical issues. British Journal of General Practice. 1999, 49: 919-922.
23.
go back to reference Tones K: Evaluating health promotion: a tale of three errors. Patient Education and Counseling. 2000, 39 (2-3): 227-236. 10.1016/S0738-3991(99)00035-X.CrossRef Tones K: Evaluating health promotion: a tale of three errors. Patient Education and Counseling. 2000, 39 (2-3): 227-236. 10.1016/S0738-3991(99)00035-X.CrossRef
24.
go back to reference Visser A: Research methods, interventions and evaluation in patient education: a kaleidoscope. Patient Education and Counseling. 2000, 39 (2-3): 147-148. 10.1016/S0738-3991(99)00002-6.CrossRef Visser A: Research methods, interventions and evaluation in patient education: a kaleidoscope. Patient Education and Counseling. 2000, 39 (2-3): 147-148. 10.1016/S0738-3991(99)00002-6.CrossRef
25.
go back to reference Callon M: Writing and (re)writing devices as tools for managing complexities. In Complexities; Social Studies of Knowledge Practices Edited by: Law J, Mol A. Durham/London, Duke University Press; 2002:191-217.CrossRef Callon M: Writing and (re)writing devices as tools for managing complexities. In Complexities; Social Studies of Knowledge Practices Edited by: Law J, Mol A. Durham/London, Duke University Press; 2002:191-217.CrossRef
Metadata
Title
Coping with methodological dilemmas; about establishing the effectiveness of interventions in routine medical practice
Authors
Yvonne JFM Jansen
Roland Bal
Marc Bruijnzeels
Marleen Foets
Rianne Frenken
Antoinette de Bont
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2006
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-6-160

Other articles of this Issue 1/2006

BMC Health Services Research 1/2006 Go to the issue