Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2007

Open Access 01-12-2007 | Research article

The Hawthorne Effect: a randomised, controlled trial

Authors: Rob McCarney, James Warner, Steve Iliffe, Robbert van Haselen, Mark Griffin, Peter Fisher

Published in: BMC Medical Research Methodology | Issue 1/2007

Login to get access

Abstract

Background

The 'Hawthorne Effect' may be an important factor affecting the generalisability of clinical research to routine practice, but has been little studied. Hawthorne Effects have been reported in previous clinical trials in dementia but to our knowledge, no attempt has been made to quantify them. Our aim was to compare minimal follow-up to intensive follow-up in participants in a placebo controlled trial of Ginkgo biloba for treating mild-moderate dementia.

Methods

Participants in a dementia trial were randomised to intensive follow-up (with comprehensive assessment visits at baseline and two, four and six months post randomisation) or minimal follow-up (with an abbreviated assessment at baseline and a full assessment at six months). Our primary outcomes were cognitive functioning (ADAS-Cog) and participant and carer-rated quality of life (QOL-AD).

Results

We recruited 176 participants, mainly through general practices. The main analysis was based on Intention to treat (ITT), with available data. In the ANCOVA model with baseline score as a co-variate, follow-up group had a significant effect on outcome at six months on the ADAS-Cog score (n = 140; mean difference = -2.018; 95%CI -3.914, -0.121; p = 0.037 favouring the intensive follow-up group), and on participant-rated quality of life score (n = 142; mean difference = -1.382; 95%CI -2.642, -0.122; p = 0.032 favouring minimal follow-up group). There was no significant difference on carer quality of life.

Conclusion

We found that more intensive follow-up of individuals in a placebo-controlled clinical trial of Ginkgo biloba for treating mild-moderate dementia resulted in a better outcome than minimal follow-up, as measured by their cognitive functioning.

Trial registration

Current controlled trials: ISRCTN45577048
Appendix
Available only for authorised users
Literature
1.
go back to reference Mayo E: The human problems of an industrial civilization. 1993, New York, MacMillan, 3: 53-73. 2 Mayo E: The human problems of an industrial civilization. 1993, New York, MacMillan, 3: 53-73. 2
2.
go back to reference Roethlisberger FJ, Dickson WJ: Management and the Worker. 1939, Cambridge, Mass., Harvard University Press Roethlisberger FJ, Dickson WJ: Management and the Worker. 1939, Cambridge, Mass., Harvard University Press
3.
go back to reference Franke RH, Kaul JD: The Hawthorne experiments: First statistical interpretation. Am Sociol Rev. 1978, 43: 623-643. 10.2307/2094540.CrossRef Franke RH, Kaul JD: The Hawthorne experiments: First statistical interpretation. Am Sociol Rev. 1978, 43: 623-643. 10.2307/2094540.CrossRef
4.
go back to reference Braunholtz DA, Edwards SJ, Lilford RJ: Are randomized clinical trials good for us (in the short term)? Evidence for a "trial effect". [Review] [26 refs]. Journal of Clinical Epidemiology. 2001, 54: 217-224. 10.1016/S0895-4356(00)00305-X.CrossRefPubMed Braunholtz DA, Edwards SJ, Lilford RJ: Are randomized clinical trials good for us (in the short term)? Evidence for a "trial effect". [Review] [26 refs]. Journal of Clinical Epidemiology. 2001, 54: 217-224. 10.1016/S0895-4356(00)00305-X.CrossRefPubMed
5.
go back to reference Peppercorn JM, Weeks JC, Cook EF, Joffe S: Comparison of outcomes in cancer patients treated within and outside clinical trials: conceptual framework and structured review.[see comment]. [Review] [52 refs]. Lancet. 2004, 363: 263-270. 10.1016/S0140-6736(03)15383-4.CrossRefPubMed Peppercorn JM, Weeks JC, Cook EF, Joffe S: Comparison of outcomes in cancer patients treated within and outside clinical trials: conceptual framework and structured review.[see comment]. [Review] [52 refs]. Lancet. 2004, 363: 263-270. 10.1016/S0140-6736(03)15383-4.CrossRefPubMed
6.
go back to reference Rosen WG, Mohs RC, Davis KL: A new rating scale for Alzheimer's disease. American Journal of Psychiatry. 1984, 141: 1356-1364.CrossRefPubMed Rosen WG, Mohs RC, Davis KL: A new rating scale for Alzheimer's disease. American Journal of Psychiatry. 1984, 141: 1356-1364.CrossRefPubMed
7.
go back to reference Logsdon RC, Gibbons LE, McCurry SM, al. : Quality of life in Alzheimer's disease: patient and caregiver reports. Journal of Mental Health and Ageing. 1999, 5: 21-32. Logsdon RC, Gibbons LE, McCurry SM, al. : Quality of life in Alzheimer's disease: patient and caregiver reports. Journal of Mental Health and Ageing. 1999, 5: 21-32.
8.
go back to reference American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders DSM-IV-TR (Text Revision). 2000, Washington, American Psychiatric Press, 4 American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders DSM-IV-TR (Text Revision). 2000, Washington, American Psychiatric Press, 4
9.
go back to reference Folstein MF, Folstein SE, McHugh PR: 'Mini-mental state': a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975, 12: 189-198. 10.1016/0022-3956(75)90026-6.CrossRefPubMed Folstein MF, Folstein SE, McHugh PR: 'Mini-mental state': a practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975, 12: 189-198. 10.1016/0022-3956(75)90026-6.CrossRefPubMed
10.
go back to reference Rogers SL, Friedhoff LT: The efficacy and safety of donepezil in patients with Alzheimer's disease: results of a US Multicentre, Randomized, Double-Blind, Placebo-Controlled Trial. The Donepezil Study Group. Dementia. 1996, 7: 293-303.PubMed Rogers SL, Friedhoff LT: The efficacy and safety of donepezil in patients with Alzheimer's disease: results of a US Multicentre, Randomized, Double-Blind, Placebo-Controlled Trial. The Donepezil Study Group. Dementia. 1996, 7: 293-303.PubMed
11.
go back to reference Tariot PN, Cummings JL, Katz IR, Mintzer J, Perdomo CA, Schwam EM, Whalen E: A randomized, double-blind, placebo-controlled study of the efficacy and safety of donepezil in patients with Alzheimer's disease in the nursing home setting.[see comment]. Journal of the American Geriatrics Society. 2001, 49: 1590-1599. 10.1111/j.1532-5415.2001.49266.x.CrossRefPubMed Tariot PN, Cummings JL, Katz IR, Mintzer J, Perdomo CA, Schwam EM, Whalen E: A randomized, double-blind, placebo-controlled study of the efficacy and safety of donepezil in patients with Alzheimer's disease in the nursing home setting.[see comment]. Journal of the American Geriatrics Society. 2001, 49: 1590-1599. 10.1111/j.1532-5415.2001.49266.x.CrossRefPubMed
12.
go back to reference Birks J: Cholinesterase inhibitors for Alzheimer's disease. [Review] [47 refs]. Cochrane Database of Systematic Reviews. 2006, CD005593- Birks J: Cholinesterase inhibitors for Alzheimer's disease. [Review] [47 refs]. Cochrane Database of Systematic Reviews. 2006, CD005593-
13.
go back to reference O'Connor DW, Pollitt PA, Brook CP, Reiss BB, Roth M: Does early intervention reduce the number of elderly people with dementia admitted to institutions for long term care?. BMJ. 1991, 302: 871-875.CrossRefPubMedPubMedCentral O'Connor DW, Pollitt PA, Brook CP, Reiss BB, Roth M: Does early intervention reduce the number of elderly people with dementia admitted to institutions for long term care?. BMJ. 1991, 302: 871-875.CrossRefPubMedPubMedCentral
14.
go back to reference Wickstrom G, Bendix T: The "Hawthorne effect"--what did the original Hawthorne studies actually show?. Scandinavian Journal of Work, Environment & Health. 2000, 26: 363-367.CrossRef Wickstrom G, Bendix T: The "Hawthorne effect"--what did the original Hawthorne studies actually show?. Scandinavian Journal of Work, Environment & Health. 2000, 26: 363-367.CrossRef
15.
go back to reference Rossi P, Freeman H: Evaluation: a systematic approach. 1989, London, Sage Publications Rossi P, Freeman H: Evaluation: a systematic approach. 1989, London, Sage Publications
16.
go back to reference Jones S: Was there a Hawthorne effect?. Am J Sociol. 1992, 98: 451-468. 10.1086/230046.CrossRef Jones S: Was there a Hawthorne effect?. Am J Sociol. 1992, 98: 451-468. 10.1086/230046.CrossRef
17.
go back to reference Rosen NA, Sales SM: Behavior in a nonexperiment: the effects of behavioral field research on the work performance of factory employees. J Appl Psychol. 1966 Rosen NA, Sales SM: Behavior in a nonexperiment: the effects of behavioral field research on the work performance of factory employees. J Appl Psychol. 1966
18.
go back to reference Parsons HM: What caused the Hawthorne effect? A scientific detective story. Adm Soc. 1978, 10: 259-283. 10.1177/009539977801000301.CrossRef Parsons HM: What caused the Hawthorne effect? A scientific detective story. Adm Soc. 1978, 10: 259-283. 10.1177/009539977801000301.CrossRef
19.
go back to reference French J: Experiments in field settings. Research methods in behavioural sciences. Edited by: Festinger L and Katz D. 1953, New York, Holt, Rinehart and Wilson, 98-135. French J: Experiments in field settings. Research methods in behavioural sciences. Edited by: Festinger L and Katz D. 1953, New York, Holt, Rinehart and Wilson, 98-135.
20.
go back to reference Rogers SL, Farlow MR, Doody RS, Mohs R, Friedhoff LT, Albala B, Baumel B, Booker G, Dexter J, Farmer M, Feighner JP, Ferris S, Gordon B, Gorman DG, Hanna G, Harrell LE, Hubbard R, Kennedy J, kinney FC, McCarthy J, Scharre DW, Schaerf F, Schneider L, Seltzer B, Siegal A, Stark SR, Strauss A, Walshe TM: A 24-week, double-blind, placebo-controlled trial of donepezil in patients with Alzheimer's disease. Neurology. 1998, 50: 136-145.CrossRefPubMed Rogers SL, Farlow MR, Doody RS, Mohs R, Friedhoff LT, Albala B, Baumel B, Booker G, Dexter J, Farmer M, Feighner JP, Ferris S, Gordon B, Gorman DG, Hanna G, Harrell LE, Hubbard R, Kennedy J, kinney FC, McCarthy J, Scharre DW, Schaerf F, Schneider L, Seltzer B, Siegal A, Stark SR, Strauss A, Walshe TM: A 24-week, double-blind, placebo-controlled trial of donepezil in patients with Alzheimer's disease. Neurology. 1998, 50: 136-145.CrossRefPubMed
21.
go back to reference Rosler M, Anand R, Cicin-Sain A, Gauthier S, Agid Y, Dal Bianco P, Stahelin HB, Hartman R, Gharabawi M, Bayer T, Berger A: Efficacy and safety of rivastigmine in patients with Alzheimer's disease: International randomised controlled trial. British Medical Journal. 1999, 318: 633-640.CrossRefPubMedPubMedCentral Rosler M, Anand R, Cicin-Sain A, Gauthier S, Agid Y, Dal Bianco P, Stahelin HB, Hartman R, Gharabawi M, Bayer T, Berger A: Efficacy and safety of rivastigmine in patients with Alzheimer's disease: International randomised controlled trial. British Medical Journal. 1999, 318: 633-640.CrossRefPubMedPubMedCentral
22.
go back to reference Zec RF, Landreth ES, Vicari SK, Belman J, Feldman E, Andrise A, Robbs R, Becker R, Kumar V: Alzheimer Disease Assessment Scale: a subtest analysis. Alzheimer Disease & Associated Disorders. 1992, 6 (3): 164-181. 10.1097/00002093-199206030-00004.CrossRef Zec RF, Landreth ES, Vicari SK, Belman J, Feldman E, Andrise A, Robbs R, Becker R, Kumar V: Alzheimer Disease Assessment Scale: a subtest analysis. Alzheimer Disease & Associated Disorders. 1992, 6 (3): 164-181. 10.1097/00002093-199206030-00004.CrossRef
23.
go back to reference Talwalker S, Overall JE, Srirama MK, Gracon SI: Cardinal features of cognitive dysfunction in Alzheimer's disease: a factor-analytic study of the Alzheimer's Disease Assessment Scale. Journal of Geriatric Psychiatry & Neurology. 1996, 9: 39-46.CrossRef Talwalker S, Overall JE, Srirama MK, Gracon SI: Cardinal features of cognitive dysfunction in Alzheimer's disease: a factor-analytic study of the Alzheimer's Disease Assessment Scale. Journal of Geriatric Psychiatry & Neurology. 1996, 9: 39-46.CrossRef
24.
go back to reference Hrobjartsson A, Gotzsche PC: Is the Placebo Powerless? — An Analysis of Clinical Trials Comparing Placebo with No Treatment. NEJM. 2001, 344: 1594-1602. 10.1056/NEJM200105243442106.CrossRefPubMed Hrobjartsson A, Gotzsche PC: Is the Placebo Powerless? — An Analysis of Clinical Trials Comparing Placebo with No Treatment. NEJM. 2001, 344: 1594-1602. 10.1056/NEJM200105243442106.CrossRefPubMed
Metadata
Title
The Hawthorne Effect: a randomised, controlled trial
Authors
Rob McCarney
James Warner
Steve Iliffe
Robbert van Haselen
Mark Griffin
Peter Fisher
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2007
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-7-30

Other articles of this Issue 1/2007

BMC Medical Research Methodology 1/2007 Go to the issue