Skip to main content
Top
Published in: Trials 1/2011

Open Access 01-12-2011 | Research

Intracluster correlation coefficients and coefficients of variation for perinatal outcomes from five cluster-randomised controlled trials in low and middle-income countries: results and methodological implications

Authors: Christina Pagel, Audrey Prost, Sonia Lewycka, Sushmita Das, Tim Colbourn, Rajendra Mahapatra, Kishwar Azad, Anthony Costello, David Osrin

Published in: Trials | Issue 1/2011

Login to get access

Abstract

Background

Public health interventions are increasingly evaluated using cluster-randomised trials in which groups rather than individuals are allocated randomly to treatment and control arms. Outcomes for individuals within the same cluster are often more correlated than outcomes for individuals in different clusters. This needs to be taken into account in sample size estimations for planned trials, but most estimates of intracluster correlation for perinatal health outcomes come from hospital-based studies and may therefore not reflect outcomes in the community. In this study we report estimates for perinatal health outcomes from community-based trials to help researchers plan future evaluations.

Methods

We estimated the intracluster correlation and the coefficient of variation for a range of outcomes using data from five community-based cluster randomised controlled trials in three low-income countries: India, Bangladesh and Malawi. We also performed a simulation exercise to investigate the impact of cluster size and number of clusters on the reliability of estimates of the coefficient of variation for rare outcomes.

Results

Estimates of intracluster correlation for mortality outcomes were lower than those for process outcomes, with narrower confidence intervals throughout for trials with larger numbers of clusters. Estimates of intracluster correlation for maternal mortality were particularly variable with large confidence intervals. Stratified randomisation had the effect of reducing estimates of intracluster correlation. The simulation exercise showed that estimates of intracluster correlation are much less reliable for rare outcomes such as maternal mortality. The size of the cluster had a greater impact than the number of clusters on the reliability of estimates for rare outcomes.

Conclusions

The breadth of intracluster correlation estimates reported here in terms of outcomes and contexts will help researchers plan future community-based public health interventions around maternal and newborn health. Our study confirms previous work finding that estimates of intracluster correlation are associated with the prevalence of the outcome of interest, the nature of the outcome of interest (mortality or behavioural) and the size and number of clusters. Estimates of intracluster correlation for maternal mortality need to be treated with caution and a range of estimates should be used in planning future trials.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hayes R, Moulton LH: Cluster Randomised Controlled Trials. 2009, New York: Chapman & Hall/CRC PressCrossRef Hayes R, Moulton LH: Cluster Randomised Controlled Trials. 2009, New York: Chapman & Hall/CRC PressCrossRef
2.
go back to reference Grosskurth H, Mosha F, Todd J, Mwijarubi E, Klokke A, Senkoro K, Mayaud P, Changalucha J, Nicoll A, ka-Gina G, Newell J, Mugeye K, Mabey D, Hayes R: Impact of improved treatment of sexually transmitted diseases on HIV infection in rural Tanzania: randomised controlled trial. The Lancet. 1995, 346: 530-536. 10.1016/S0140-6736(95)91380-7.CrossRef Grosskurth H, Mosha F, Todd J, Mwijarubi E, Klokke A, Senkoro K, Mayaud P, Changalucha J, Nicoll A, ka-Gina G, Newell J, Mugeye K, Mabey D, Hayes R: Impact of improved treatment of sexually transmitted diseases on HIV infection in rural Tanzania: randomised controlled trial. The Lancet. 1995, 346: 530-536. 10.1016/S0140-6736(95)91380-7.CrossRef
3.
go back to reference Wall M, Hayes R, Moore D, Petticrew M, Clow A, Schmidt , Draper A, Lock K, Lynch R, Renton A: Evaluation of community level interventions to address social and structural determinants of health: a cluster randomised controlled trial. BMC Public Health. 2009, 9: 207-10.1186/1471-2458-9-207.CrossRefPubMedPubMedCentral Wall M, Hayes R, Moore D, Petticrew M, Clow A, Schmidt , Draper A, Lock K, Lynch R, Renton A: Evaluation of community level interventions to address social and structural determinants of health: a cluster randomised controlled trial. BMC Public Health. 2009, 9: 207-10.1186/1471-2458-9-207.CrossRefPubMedPubMedCentral
4.
go back to reference Shah More N, Bapat U, Das S, Patil S, Porel M, Vaidya L, Koriya B, Barnett S, Costello A, Fernandez A, Osrin D: Cluster-randomised controlled trial of community mobilisation in Mumbai slums to improve care during pregnancy, delivery, postpartum and for the newborn. Trials. 2008, 9: 7-10.1186/1745-6215-9-7.CrossRef Shah More N, Bapat U, Das S, Patil S, Porel M, Vaidya L, Koriya B, Barnett S, Costello A, Fernandez A, Osrin D: Cluster-randomised controlled trial of community mobilisation in Mumbai slums to improve care during pregnancy, delivery, postpartum and for the newborn. Trials. 2008, 9: 7-10.1186/1745-6215-9-7.CrossRef
6.
go back to reference Killip S, Mahfoud Z, Pearce K: What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Annals of family medicine. 2004, 2: 204-208. 10.1370/afm.141.CrossRefPubMedPubMedCentral Killip S, Mahfoud Z, Pearce K: What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Annals of family medicine. 2004, 2: 204-208. 10.1370/afm.141.CrossRefPubMedPubMedCentral
7.
go back to reference Hayes RJ, Bennett S: Simple sample size calculation for cluster-randomized trials. International Journal of Epidemiology. 1999, 28 (2): 319-326. 10.1093/ije/28.2.319.CrossRefPubMed Hayes RJ, Bennett S: Simple sample size calculation for cluster-randomized trials. International Journal of Epidemiology. 1999, 28 (2): 319-326. 10.1093/ije/28.2.319.CrossRefPubMed
8.
go back to reference Preisser JS, Reboussin BA, Song EY, Wolfson M: The importance and role of intracluster correlations in planning cluster trials. 2007, 18: 552-560. Preisser JS, Reboussin BA, Song EY, Wolfson M: The importance and role of intracluster correlations in planning cluster trials. 2007, 18: 552-560.
9.
go back to reference Donner A, Klar N: Pitfalls and controversies in cluster randomization trials. Americal Journal of Public Health. 2004, 94: 416-422. 10.2105/AJPH.94.3.416.CrossRef Donner A, Klar N: Pitfalls and controversies in cluster randomization trials. Americal Journal of Public Health. 2004, 94: 416-422. 10.2105/AJPH.94.3.416.CrossRef
10.
go back to reference Chakraborty H, Moore J, Carlo WA, Hartwell TD, Wright LL: A simulation based technique to estimate intracluster correlation for a binary variable. Contemporary clinical trials. 2009, 30: 71-80. 10.1016/j.cct.2008.07.008.CrossRefPubMed Chakraborty H, Moore J, Carlo WA, Hartwell TD, Wright LL: A simulation based technique to estimate intracluster correlation for a binary variable. Contemporary clinical trials. 2009, 30: 71-80. 10.1016/j.cct.2008.07.008.CrossRefPubMed
11.
go back to reference Turner RM, Prevost AT, Thompson SG: Allowing for imprecision of the intracluster correlation coefficient in the design of cluster randomised trials. Statistics in medicine. 2004, 23: 1195-1214. 10.1002/sim.1721.CrossRefPubMed Turner RM, Prevost AT, Thompson SG: Allowing for imprecision of the intracluster correlation coefficient in the design of cluster randomised trials. Statistics in medicine. 2004, 23: 1195-1214. 10.1002/sim.1721.CrossRefPubMed
12.
13.
go back to reference Baqui AH, El-Arifeen S, Darmstadt GL, Ahmed S, Williams EK: Effect of community-based newborn-care intervention package implemented through two service-delivery strategies in Sylhet district, Bangladesh: a cluster-randomised controlled trial. Lancet. 2008, 371: 1936-1944. 10.1016/S0140-6736(08)60835-1.CrossRefPubMed Baqui AH, El-Arifeen S, Darmstadt GL, Ahmed S, Williams EK: Effect of community-based newborn-care intervention package implemented through two service-delivery strategies in Sylhet district, Bangladesh: a cluster-randomised controlled trial. Lancet. 2008, 371: 1936-1944. 10.1016/S0140-6736(08)60835-1.CrossRefPubMed
14.
go back to reference Kumar V, Mohanty S, Kumar A, Misra R, Santosham M: Effect of community-based behaviour change management on neonatal mortality in Shivgarh, Uttar Pradesh, India: a cluster-randomised controlled trial. Lancet. 2008, 372: 1151-1162. 10.1016/S0140-6736(08)61483-X.CrossRefPubMed Kumar V, Mohanty S, Kumar A, Misra R, Santosham M: Effect of community-based behaviour change management on neonatal mortality in Shivgarh, Uttar Pradesh, India: a cluster-randomised controlled trial. Lancet. 2008, 372: 1151-1162. 10.1016/S0140-6736(08)61483-X.CrossRefPubMed
15.
go back to reference Bhutta ZA, Soofi S: Community-based newborn care: are we there yet?. Lancet. 2008, 372: 1124-1126. 10.1016/S0140-6736(08)61458-0.CrossRefPubMed Bhutta ZA, Soofi S: Community-based newborn care: are we there yet?. Lancet. 2008, 372: 1124-1126. 10.1016/S0140-6736(08)61458-0.CrossRefPubMed
16.
go back to reference Nair N, Tripathy P, Prost A, Costello A, Osrin D: Community-based approaches to improve newborn survival in low-income countries. PLoS Med. 7: e1000246- Nair N, Tripathy P, Prost A, Costello A, Osrin D: Community-based approaches to improve newborn survival in low-income countries. PLoS Med. 7: e1000246-
17.
go back to reference Taljaard M, Donner A, Villar J, Wojdyla D, Velazco A, Bataglia V, Faundes A, Langer A, Narvaez A, Valladares E: Intracluster correlation coefficients from the 2005 WHO Global Survey on Maternal and Perinatal Health: implications for implementation research. Paediatric and perinatal epidemiology. 2008, 22: 117-125. 10.1111/j.1365-3016.2007.00901.x.CrossRefPubMed Taljaard M, Donner A, Villar J, Wojdyla D, Velazco A, Bataglia V, Faundes A, Langer A, Narvaez A, Valladares E: Intracluster correlation coefficients from the 2005 WHO Global Survey on Maternal and Perinatal Health: implications for implementation research. Paediatric and perinatal epidemiology. 2008, 22: 117-125. 10.1111/j.1365-3016.2007.00901.x.CrossRefPubMed
18.
go back to reference Manandhar DS, Osrin D, Shrestha BP, Mesko N, Morrison J, Tumbahangphe KM, Tamang S, Thapa S, Shrestha D, Thapa B: Effect of a participatory intervention with women's groups on birth outcomes in Nepal: cluster-randomised controlled trial. Lancet. 2004, 364: 970-979. 10.1016/S0140-6736(04)17021-9.CrossRefPubMed Manandhar DS, Osrin D, Shrestha BP, Mesko N, Morrison J, Tumbahangphe KM, Tamang S, Thapa S, Shrestha D, Thapa B: Effect of a participatory intervention with women's groups on birth outcomes in Nepal: cluster-randomised controlled trial. Lancet. 2004, 364: 970-979. 10.1016/S0140-6736(04)17021-9.CrossRefPubMed
19.
go back to reference Campbell MK, Grimshaw JM, Elbourne DA: Intracluster correlation coefficients in cluster randomised trials: empirical insights into how should they be reported. BMC Medical Research Methodology. 2004, 4: 9-10.1186/1471-2288-4-9.CrossRefPubMedPubMedCentral Campbell MK, Grimshaw JM, Elbourne DA: Intracluster correlation coefficients in cluster randomised trials: empirical insights into how should they be reported. BMC Medical Research Methodology. 2004, 4: 9-10.1186/1471-2288-4-9.CrossRefPubMedPubMedCentral
20.
go back to reference Thomson A, Hayes R, Cousens S: Measures of between-cluster variability in cluster randomized trials with binary outcomes. Statistics in Medicine. 2009, 28: 1739-1751. 10.1002/sim.3582.CrossRefPubMed Thomson A, Hayes R, Cousens S: Measures of between-cluster variability in cluster randomized trials with binary outcomes. Statistics in Medicine. 2009, 28: 1739-1751. 10.1002/sim.3582.CrossRefPubMed
21.
go back to reference Barnett S, Nair N, Tripathy PK, Borghi J, Rath S, Costello AM: A prospective key informant surveillance system to measure maternal mortality - findings from indigenous populations in Jharkhand and Orissa, India. BMC Pregnancy Childbirth. 2008, 8: 6-10.1186/1471-2393-8-6.CrossRefPubMedPubMedCentral Barnett S, Nair N, Tripathy PK, Borghi J, Rath S, Costello AM: A prospective key informant surveillance system to measure maternal mortality - findings from indigenous populations in Jharkhand and Orissa, India. BMC Pregnancy Childbirth. 2008, 8: 6-10.1186/1471-2393-8-6.CrossRefPubMedPubMedCentral
22.
go back to reference Azad K, Barnett S, Banerjee B: Effect of scaling up women's groups on birth outcomes in three rural districts in Bangladesh: a cluster-randomised controlled trial. Lancet. 2010, 375: 1193-1202. 10.1016/S0140-6736(10)60142-0.CrossRefPubMed Azad K, Barnett S, Banerjee B: Effect of scaling up women's groups on birth outcomes in three rural districts in Bangladesh: a cluster-randomised controlled trial. Lancet. 2010, 375: 1193-1202. 10.1016/S0140-6736(10)60142-0.CrossRefPubMed
23.
go back to reference Lewycka S, Mwansambo C, Kazembe P, Phiri T, Mganga A: A cluster randomised controlled trial of the community effectiveness of two interventions in rural Malawi to improve health care and to reduce maternal, newborn and infant mortality. Trials. 2010, 11: 88-10.1186/1745-6215-11-88.CrossRefPubMedPubMedCentral Lewycka S, Mwansambo C, Kazembe P, Phiri T, Mganga A: A cluster randomised controlled trial of the community effectiveness of two interventions in rural Malawi to improve health care and to reduce maternal, newborn and infant mortality. Trials. 2010, 11: 88-10.1186/1745-6215-11-88.CrossRefPubMedPubMedCentral
24.
go back to reference International Classification of Diseases. 2007, Tenth Revision (ICD-10), World Health Organisation, Geneva International Classification of Diseases. 2007, Tenth Revision (ICD-10), World Health Organisation, Geneva
25.
go back to reference Donner N, Klar N: Design and analysis of cluster randomization trials in health research. 2000, London: Arnold Donner N, Klar N: Design and analysis of cluster randomization trials in health research. 2000, London: Arnold
26.
go back to reference Ukoumunne OC: A comparison of confidence interval methods for the intraclass correlation coefficient in cluster randomized trials. Statistics in Medicine. 2002, 21: 3757-74. 10.1002/sim.1330.CrossRefPubMed Ukoumunne OC: A comparison of confidence interval methods for the intraclass correlation coefficient in cluster randomized trials. Statistics in Medicine. 2002, 21: 3757-74. 10.1002/sim.1330.CrossRefPubMed
29.
go back to reference Kidney E, Winter HR, Khan KS, Metin Gülmezoglu M, Meads CS: Systematic review of effect of community-level interventions to reduce maternal mortality. BMC Pregnancy Childbirth. 2009, 9: 2-10.1186/1471-2393-9-2.CrossRefPubMedPubMedCentral Kidney E, Winter HR, Khan KS, Metin Gülmezoglu M, Meads CS: Systematic review of effect of community-level interventions to reduce maternal mortality. BMC Pregnancy Childbirth. 2009, 9: 2-10.1186/1471-2393-9-2.CrossRefPubMedPubMedCentral
30.
go back to reference Kirkwood BR, Manu A, Tawiah-Agyemang ten Asbroek G, Gyan T, Weobong B, Lewandowski ER, Soremekun S, Danso S, Pitt C, Hanson K, Owusu-Agyei S, Hill Z: NEWHINTS cluster randomised trial to evaluate the impact on neonatal mortality in rural Ghana of routine home visits to provide a package of essential newborn care interventions in the third trimester of pregnancy and the first week of life: trial protocol. Trials. 2010, 11: 58-10.1186/1745-6215-11-58.CrossRefPubMedPubMedCentral Kirkwood BR, Manu A, Tawiah-Agyemang ten Asbroek G, Gyan T, Weobong B, Lewandowski ER, Soremekun S, Danso S, Pitt C, Hanson K, Owusu-Agyei S, Hill Z: NEWHINTS cluster randomised trial to evaluate the impact on neonatal mortality in rural Ghana of routine home visits to provide a package of essential newborn care interventions in the third trimester of pregnancy and the first week of life: trial protocol. Trials. 2010, 11: 58-10.1186/1745-6215-11-58.CrossRefPubMedPubMedCentral
31.
go back to reference Campbell MK, Fayers PM, Grimshaw JM: Determinants of the intracluster correlation coefficient in cluster randomised trials: the case of implementation research. Clinical trials (London, England). 2005, 2: 99-107.CrossRef Campbell MK, Fayers PM, Grimshaw JM: Determinants of the intracluster correlation coefficient in cluster randomised trials: the case of implementation research. Clinical trials (London, England). 2005, 2: 99-107.CrossRef
Metadata
Title
Intracluster correlation coefficients and coefficients of variation for perinatal outcomes from five cluster-randomised controlled trials in low and middle-income countries: results and methodological implications
Authors
Christina Pagel
Audrey Prost
Sonia Lewycka
Sushmita Das
Tim Colbourn
Rajendra Mahapatra
Kishwar Azad
Anthony Costello
David Osrin
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Trials / Issue 1/2011
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-12-151

Other articles of this Issue 1/2011

Trials 1/2011 Go to the issue