Skip to main content
Top
Published in: Trials 1/2015

Open Access 01-12-2015 | Research

Challenges to undertaking randomised trials with looked after children in social care settings

Authors: Gillian Mezey, Fiona Robinson, Rona Campbell, Steve Gillard, Geraldine Macdonald, Deborah Meyer, Chris Bonell, Sarah White

Published in: Trials | Issue 1/2015

Login to get access

Abstract

Background

Randomised controlled trials (RCTs) are widely viewed as the gold standard for assessing effectiveness in health research; however many researchers and practitioners believe that RCTs are inappropriate and un-doable in social care settings, particularly in relation to looked after children. The aim of this article is to describe the challenges faced in conducting a pilot study and phase II RCT of a peer mentoring intervention to reduce teenage pregnancy in looked after children in a social care setting.

Methods

Interviews were undertaken with social care professionals and looked after children, and a survey conducted with looked after children, to establish the feasibility and acceptability of the intervention and research design.

Results

Barriers to recruitment and in managing the intervention were identified, including social workers acting as informal gatekeepers; social workers concerns and misconceptions about the recruitment criteria and the need for and purpose of randomisation; resource limitations, which made it difficult to prioritise research over other demands on their time and difficulties in engaging and retaining looked after children in the study.

Conclusions

The relative absence of a research infrastructure and culture in social care and the lack of research support funding available for social care agencies, compared to health organisations, has implications for increasing evidence-based practice in social care settings, particularly in this very vulnerable group of young people.
Appendix
Available only for authorised users
Literature
1.
go back to reference Davies H, Nutley S, Smith P, editors. What works? Evidence-based policy and practice in public services. Bristol: The Policy Press; 2000. Davies H, Nutley S, Smith P, editors. What works? Evidence-based policy and practice in public services. Bristol: The Policy Press; 2000.
2.
go back to reference Gray M, Joy E, Plath D, Webb S. Opinions about evidence: a study of social workers attitudes towards evidence based practice. J Soc Work. 2013;0:1–18. doi: 10.1177/1468017313475555 Gray M, Joy E, Plath D, Webb S. Opinions about evidence: a study of social workers attitudes towards evidence based practice. J Soc Work. 2013;0:1–18. doi: 10.1177/1468017313475555
3.
go back to reference Burke A, Early T. Readiness to adopt best practice among adolescents’ AOD treatment providers. Health Soc Work. 2003;28(2):99–105.CrossRefPubMed Burke A, Early T. Readiness to adopt best practice among adolescents’ AOD treatment providers. Health Soc Work. 2003;28(2):99–105.CrossRefPubMed
4.
go back to reference Morrow V, Richards M. The ethics of social research with children: an overview. Child Soc. 1996;10(2):90–105.CrossRef Morrow V, Richards M. The ethics of social research with children: an overview. Child Soc. 1996;10(2):90–105.CrossRef
5.
go back to reference Oakley A, Strange V, Toroyan T, Wiggins M, Roberts I, Stephenson J. Using random allocation to evaluate social interventions: three recent UK examples. Ann Am Acad Pol Soc Sci. 2003;589:170–89.CrossRef Oakley A, Strange V, Toroyan T, Wiggins M, Roberts I, Stephenson J. Using random allocation to evaluate social interventions: three recent UK examples. Ann Am Acad Pol Soc Sci. 2003;589:170–89.CrossRef
6.
go back to reference Guyatt G, Oxman A, Kunz R, Vist G, Falck-Ytter Y, Schunemann H. What is quality of evidence and why is it important to clinicians? BMJ. 2008;336:995–8.CrossRefPubMedPubMedCentral Guyatt G, Oxman A, Kunz R, Vist G, Falck-Ytter Y, Schunemann H. What is quality of evidence and why is it important to clinicians? BMJ. 2008;336:995–8.CrossRefPubMedPubMedCentral
7.
go back to reference Dixon J, Biehal N, Green J, Sinclair I, Kay C, Parry E. Trials and tribulations: challenges and prospects for randomised controlled trials of social work with children.. Br J Soc Work 2013:1-19 doi.10.1093/bjsw/bct035 Dixon J, Biehal N, Green J, Sinclair I, Kay C, Parry E. Trials and tribulations: challenges and prospects for randomised controlled trials of social work with children.. Br J Soc Work 2013:1-19 doi.10.1093/bjsw/bct035
8.
go back to reference Macdonald G. Social work in the UK: a testing ground for trialists. J Child Serv. 2008;3(1):27–39.CrossRef Macdonald G. Social work in the UK: a testing ground for trialists. J Child Serv. 2008;3(1):27–39.CrossRef
9.
go back to reference Macdonald G, Macdonald K. Ethical issues in social work research. In: Hugman R, Smith D, editors. Ethical issues in social work. London: Routledge; 1995. p. 46–64. Macdonald G, Macdonald K. Ethical issues in social work research. In: Hugman R, Smith D, editors. Ethical issues in social work. London: Routledge; 1995. p. 46–64.
10.
go back to reference Rycroft-Malone J, Seers K, Titchen A, Harvey G, Kitson A, McCormack B. What counts as evidence in evidence-based practice? J Adv Nurs. 2004;47:81–90.CrossRefPubMed Rycroft-Malone J, Seers K, Titchen A, Harvey G, Kitson A, McCormack B. What counts as evidence in evidence-based practice? J Adv Nurs. 2004;47:81–90.CrossRefPubMed
11.
go back to reference Slade M. and Priebe S. Are randomised controlled trials the only gold that glitters? British Journal of Psychiatry. 2001. doi:10.1192/bjp.179.4.286. Slade M. and Priebe S. Are randomised controlled trials the only gold that glitters? British Journal of Psychiatry. 2001. doi:10.1192/bjp.179.4.286.
12.
go back to reference Howard L, de Salis I, Tomlin Z, Thornicroft G, Donovan J. Why is recruitment to trials difficult? an investigation into recruitment difficulties in an RCT of supported employment in patients with severe mental illness. Contemp Clin Trials. 2009;30(1):40–6.CrossRefPubMedPubMedCentral Howard L, de Salis I, Tomlin Z, Thornicroft G, Donovan J. Why is recruitment to trials difficult? an investigation into recruitment difficulties in an RCT of supported employment in patients with severe mental illness. Contemp Clin Trials. 2009;30(1):40–6.CrossRefPubMedPubMedCentral
13.
go back to reference Elliott J. Making evidence‐based practice educational. Br Educ Res J. 2001;27:555–74.CrossRef Elliott J. Making evidence‐based practice educational. Br Educ Res J. 2001;27:555–74.CrossRef
14.
go back to reference Hodkinson P. Research as a form of work: expertise, community and methodological objectivity. Br Educ Res J. 2004;30(1):9–29.CrossRef Hodkinson P. Research as a form of work: expertise, community and methodological objectivity. Br Educ Res J. 2004;30(1):9–29.CrossRef
15.
go back to reference Macdonald G. Social care: rhetoric and reality. In: Davies H, Nutley S, Smith P, editors. What works? Evidence-based policy and practice in public service. Bristol: Policy Press; 2000. p. 117–40. Macdonald G. Social care: rhetoric and reality. In: Davies H, Nutley S, Smith P, editors. What works? Evidence-based policy and practice in public service. Bristol: Policy Press; 2000. p. 117–40.
16.
go back to reference Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143–56.CrossRefPubMed Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143–56.CrossRefPubMed
17.
go back to reference McDonald A, Knight R, Cmpbell M, Entwistle V, Grant A, Cook J, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials 2006, 7(9) doi.10.1186/1745-6215-7-9. McDonald A, Knight R, Cmpbell M, Entwistle V, Grant A, Cook J, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials 2006, 7(9) doi.10.1186/1745-6215-7-9.
18.
go back to reference Marsh P, Fisher M. Developing the evidence base for social work and social care practice. Using knowledge in Social Care. Report10. London: Social Care Institute for Excellence; 2005. Marsh P, Fisher M. Developing the evidence base for social work and social care practice. Using knowledge in Social Care. Report10. London: Social Care Institute for Excellence; 2005.
19.
go back to reference Sheldon B, Chilvers R. Evidence-based social care: a study of prospects and problems. Lyme Regis: Russell House Publishing; 2000. Sheldon B, Chilvers R. Evidence-based social care: a study of prospects and problems. Lyme Regis: Russell House Publishing; 2000.
20.
go back to reference Schofield G, Ward E, Biggart L, Scaife V, Dodsworth J, Larsson B, et al. Looked after children and offending: reducing risk and promoting resilience. UEA and TACT: East Anglia; 2012. Schofield G, Ward E, Biggart L, Scaife V, Dodsworth J, Larsson B, et al. Looked after children and offending: reducing risk and promoting resilience. UEA and TACT: East Anglia; 2012.
21.
go back to reference Francis J. Investing in children’s futures: enhancing the educational arrangements of ‘looked after’ children and young people. Child Fam Soc Work. 2000;5(1):23–33.CrossRef Francis J. Investing in children’s futures: enhancing the educational arrangements of ‘looked after’ children and young people. Child Fam Soc Work. 2000;5(1):23–33.CrossRef
22.
go back to reference Polnay L, Ward H. Promoting the health of looked after children. Government proposals demand leadership and a culture change. BMJ. 2000;320(7236):661–2.CrossRefPubMedPubMedCentral Polnay L, Ward H. Promoting the health of looked after children. Government proposals demand leadership and a culture change. BMJ. 2000;320(7236):661–2.CrossRefPubMedPubMedCentral
23.
go back to reference Ward H, Lynch M, Skuse T, Jones H. Issues concerning the health of looked after children. Adopt Fost J. 2002;26(4):8–18.CrossRef Ward H, Lynch M, Skuse T, Jones H. Issues concerning the health of looked after children. Adopt Fost J. 2002;26(4):8–18.CrossRef
24.
go back to reference Brodie I, Berridge D, Beckett W. The health of children looked after by local authorities. Br J Nurs. 1997;6(7):386–90.CrossRefPubMed Brodie I, Berridge D, Beckett W. The health of children looked after by local authorities. Br J Nurs. 1997;6(7):386–90.CrossRefPubMed
26.
go back to reference Viner RM, Taylor B. Adult health and social outcomes of children who have been in public care: population-based study. Pediatrics. 2005;115(4):894–9.CrossRefPubMed Viner RM, Taylor B. Adult health and social outcomes of children who have been in public care: population-based study. Pediatrics. 2005;115(4):894–9.CrossRefPubMed
27.
go back to reference Ford T, Vostanis P, Meltzer H, Goodman R. Psychiatric disorder among British children looked after by local authorities: comparison with children living in private households. Br J Psychiatry. 2007;190:319–25.CrossRefPubMed Ford T, Vostanis P, Meltzer H, Goodman R. Psychiatric disorder among British children looked after by local authorities: comparison with children living in private households. Br J Psychiatry. 2007;190:319–25.CrossRefPubMed
28.
go back to reference Knight A, Chase E, Aggleton P. Teenage pregnancy among young people in and leaving care: messages and implications for foster care. Adopt Fost J. 2006;30(1):58–69.CrossRef Knight A, Chase E, Aggleton P. Teenage pregnancy among young people in and leaving care: messages and implications for foster care. Adopt Fost J. 2006;30(1):58–69.CrossRef
29.
go back to reference Social Care Institute for Excellence. Preventing teenage pregnancy in looked after children, Report No: research briefing 9. 2004. London:Social Care Institute for Excellence. Social Care Institute for Excellence. Preventing teenage pregnancy in looked after children, Report No: research briefing 9. 2004. London:Social Care Institute for Excellence.
30.
go back to reference Daniels H, Cole T, Sellman E, Sutton J, Visser J, Bedward J. Study of young people permanently excluded from school, Research report RR405. Nottingham: DfES Publications; 2003. Daniels H, Cole T, Sellman E, Sutton J, Visser J, Bedward J. Study of young people permanently excluded from school, Research report RR405. Nottingham: DfES Publications; 2003.
31.
go back to reference Blower A, Addo A, Hodgson J, Lamington L, Towlson K. Mental health of ‘looked after’ children: a needs assessment. Clin Child Psychol Psychiatry. 2004;9(1):117–29.CrossRef Blower A, Addo A, Hodgson J, Lamington L, Towlson K. Mental health of ‘looked after’ children: a needs assessment. Clin Child Psychol Psychiatry. 2004;9(1):117–29.CrossRef
32.
go back to reference Meltzer H, Gatward R, Corbin T, Goodman R, Ford T. The mental health of young people. London: HMSO; 2003. Meltzer H, Gatward R, Corbin T, Goodman R, Ford T. The mental health of young people. London: HMSO; 2003.
33.
go back to reference Department for Education. Statutory guidance on children who run away or go missing from home or care. London: Department for Education; 2013. Department for Education. Statutory guidance on children who run away or go missing from home or care. London: Department for Education; 2013.
35.
go back to reference Heptinstall E. Gaining access to looked after children for research purposes: lessons learned. Br J Soc Work. 2000;30:867–72.CrossRef Heptinstall E. Gaining access to looked after children for research purposes: lessons learned. Br J Soc Work. 2000;30:867–72.CrossRef
36.
go back to reference Murray C. Children and young people’s participation and non-participation in research. Adopt Fost. 2005;29(1):57–66.CrossRef Murray C. Children and young people’s participation and non-participation in research. Adopt Fost. 2005;29(1):57–66.CrossRef
37.
go back to reference Gillick v West Norfolk & Wisbech Area Health Authority. 1985. Gillick v West Norfolk & Wisbech Area Health Authority. 1985.
38.
go back to reference SCIE/NICE. Promoting the quality of life of looked-after children and young people. London: SCIE/NICE; 2010. SCIE/NICE. Promoting the quality of life of looked-after children and young people. London: SCIE/NICE; 2010.
39.
go back to reference Mezey G, Meyer D, Robinson F, Bonell C, Campbell R, Gillard S, et al. Developing and piloting a peer mentoring intervention to reduce teenage pregnancy in looked after children and care leavers. Health Technology Assessment Journal Series 2015. In press Mezey G, Meyer D, Robinson F, Bonell C, Campbell R, Gillard S, et al. Developing and piloting a peer mentoring intervention to reduce teenage pregnancy in looked after children and care leavers. Health Technology Assessment Journal Series 2015. In press
40.
go back to reference Patton M. Qualitative evaluation methods. Beverley Hill, CA: Sage; 1980. Patton M. Qualitative evaluation methods. Beverley Hill, CA: Sage; 1980.
41.
go back to reference Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.CrossRef Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.CrossRef
44.
go back to reference Webb S. Evidence-based practice and decision analysis in social work: an implementation model’. J Soc Work. 2002;2(1):46–63.CrossRef Webb S. Evidence-based practice and decision analysis in social work: an implementation model’. J Soc Work. 2002;2(1):46–63.CrossRef
45.
go back to reference Meinich Petersen S, Zoffmann V, Kjaergaard J, Graff Steensballe L, Greisen G. Disappointment and adherence among parents of newborns allocated to the control group: a qualitative study of a randomized clinical trial. Trials 2014; 15:126 doi.10.1186/1745-6215-15-126 Meinich Petersen S, Zoffmann V, Kjaergaard J, Graff Steensballe L, Greisen G. Disappointment and adherence among parents of newborns allocated to the control group: a qualitative study of a randomized clinical trial. Trials 2014; 15:126 doi.10.1186/1745-6215-15-126
46.
go back to reference Lindstrom D, Sundberg-Petersson I, Adami J, Tonnesen H. Disappointment and drop-out rate after being allocated to control group in a smoking cessation trial. Contemp Clin Trials. 2010;31:22–6.CrossRefPubMed Lindstrom D, Sundberg-Petersson I, Adami J, Tonnesen H. Disappointment and drop-out rate after being allocated to control group in a smoking cessation trial. Contemp Clin Trials. 2010;31:22–6.CrossRefPubMed
47.
go back to reference Torgerson DJ, Torgerson CJ. Designing randomised trials in health, education and the social sciences: an introduction. London: Palgrave Macmillan; 2008.CrossRef Torgerson DJ, Torgerson CJ. Designing randomised trials in health, education and the social sciences: an introduction. London: Palgrave Macmillan; 2008.CrossRef
48.
go back to reference Robinson E, Kerr C, Stevens A, Lilford R, Braunholtz D, Edwards S, et al. Lay public’s understanding of equipoise and randomisation in randomised controlled trials. Health Technol Assess J Ser. 2005;9(8):1–192. Robinson E, Kerr C, Stevens A, Lilford R, Braunholtz D, Edwards S, et al. Lay public’s understanding of equipoise and randomisation in randomised controlled trials. Health Technol Assess J Ser. 2005;9(8):1–192.
49.
go back to reference Featherstone K, Donovan J. Why don’t they just tell me straight, why allocate it?” The struggle to make sense of participating in a randomised controlled trial. Soc Sci Med. 2002;55:709–19.CrossRefPubMed Featherstone K, Donovan J. Why don’t they just tell me straight, why allocate it?” The struggle to make sense of participating in a randomised controlled trial. Soc Sci Med. 2002;55:709–19.CrossRefPubMed
50.
go back to reference Roche K. The politics of children’s rights. In: Brannen J, O’Brien M, editors. Children in families: research and policy. London: Falmer Press; 1996. Roche K. The politics of children’s rights. In: Brannen J, O’Brien M, editors. Children in families: research and policy. London: Falmer Press; 1996.
51.
go back to reference Sheldon B. Social work effectiveness experiments: review and implications. Br J Soc Work. 1986;16(2):223–42. Sheldon B. Social work effectiveness experiments: review and implications. Br J Soc Work. 1986;16(2):223–42.
52.
go back to reference MacDonald G, Sheldon B, Gillespie J. Contemporary studies of the effectiveness of social work. Br J Soc Work. 1992;22(6):615–43. MacDonald G, Sheldon B, Gillespie J. Contemporary studies of the effectiveness of social work. Br J Soc Work. 1992;22(6):615–43.
53.
go back to reference Cullen FT, Gendreau P. From nothing works to what works: changing professional ideology in the 21st century. Prison J. 2001;81(3):313–38.CrossRef Cullen FT, Gendreau P. From nothing works to what works: changing professional ideology in the 21st century. Prison J. 2001;81(3):313–38.CrossRef
54.
go back to reference Biesta G. Why “What works” won’t work; evidence based practice and the democratic deficit in education research. Educ Theory. 2007;57:1–22.CrossRef Biesta G. Why “What works” won’t work; evidence based practice and the democratic deficit in education research. Educ Theory. 2007;57:1–22.CrossRef
55.
go back to reference Snowdon C, Garcia J, Elbourne D. Making sense of randomization; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med. 1997;45(9):1337–55.CrossRefPubMed Snowdon C, Garcia J, Elbourne D. Making sense of randomization; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med. 1997;45(9):1337–55.CrossRefPubMed
57.
go back to reference Ruggeri M, Lasalvia A, Bonetto C. A new generation of pragmatic trials of psychosocial interventions is needed. Epidemiol Psychiatric Sci. 2013;22(2):111–7.CrossRef Ruggeri M, Lasalvia A, Bonetto C. A new generation of pragmatic trials of psychosocial interventions is needed. Epidemiol Psychiatric Sci. 2013;22(2):111–7.CrossRef
58.
go back to reference Campbell R, Holliday SF, Audrey J, Bloor S, Parry-Langdon M, Hughes N, et al. An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomised trial. Lancet. 2008;371(9624):1595–602.CrossRefPubMedPubMedCentral Campbell R, Holliday SF, Audrey J, Bloor S, Parry-Langdon M, Hughes N, et al. An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomised trial. Lancet. 2008;371(9624):1595–602.CrossRefPubMedPubMedCentral
59.
go back to reference Strange V, Forrest S, Oakley A. Peer-led sex education—characteristics of peer educators and their perceptions of the impact on them of participation in a peer education programme. Health Educ Res. 2001;17:327–37.CrossRef Strange V, Forrest S, Oakley A. Peer-led sex education—characteristics of peer educators and their perceptions of the impact on them of participation in a peer education programme. Health Educ Res. 2001;17:327–37.CrossRef
60.
go back to reference Hobbs T, Carr MJ, Holley MJ, Gray NL, Axford N. ’A dark art comes to the water-cooler: a review of some key texts on RCTs for children’s services professionals and researchers’. J Child Serv. 2008;3(1):40–50. 64. Hobbs T, Carr MJ, Holley MJ, Gray NL, Axford N. ’A dark art comes to the water-cooler: a review of some key texts on RCTs for children’s services professionals and researchers’. J Child Serv. 2008;3(1):40–50. 64.
61.
go back to reference Donovan J, Paramasican S, de Salid I, Toerien M. Clear obstacles and hidden challenges: understanding recruitment perspectives in six pragmatic randomised controlled trials. Trials. 2014;15(5). Donovan J, Paramasican S, de Salid I, Toerien M. Clear obstacles and hidden challenges: understanding recruitment perspectives in six pragmatic randomised controlled trials. Trials. 2014;15(5).
Metadata
Title
Challenges to undertaking randomised trials with looked after children in social care settings
Authors
Gillian Mezey
Fiona Robinson
Rona Campbell
Steve Gillard
Geraldine Macdonald
Deborah Meyer
Chris Bonell
Sarah White
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Trials / Issue 1/2015
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-015-0708-z

Other articles of this Issue 1/2015

Trials 1/2015 Go to the issue