Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

Bias-corrected estimator for intraclass correlation coefficient in the balanced one-way random effects model

Authors: Eshetu G Atenafu, Jemila S Hamid, Teresa To, Andrew R Willan, Brian M Feldman, Joseph Beyene

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

Intraclass correlation coefficients (ICCs) are used in a wide range of applications. However, most commonly used estimators for the ICC are known to be subject to bias.

Methods

Using second order Taylor series expansion, we propose a new bias-corrected estimator for one type of intraclass correlation coefficient, for the ICC that arises in the context of the balanced one-way random effects model. A simulation study is performed to assess the performance of the proposed estimator. Data have been generated under normal as well as non-normal scenarios.

Results

Our simulation results show that the new estimator has reduced bias compared to the least square estimator which is often referred to as the conventional or analytical estimator. The results also show marked bias reduction both in normal and non-normal data scenarios. In particular, our estimator outperforms the analytical estimator in a non-normal setting producing estimates that are very close to the true ICC values.

Conclusions

The proposed bias-corrected estimator for the ICC from a one-way random effects analysis of variance model appears to perform well in the scenarios we considered in this paper and can be used as a motivation to construct bias-corrected estimators for other types of ICCs that arise in more complex scenarios. It would also be interesting to investigate the bias-variance trade-off.
Appendix
Available only for authorised users
Literature
1.
go back to reference Fisher RA: On the “probable error” of a coefficient of correlation deduced from a small sample. Metron. 1921, 1: 1-32. Fisher RA: On the “probable error” of a coefficient of correlation deduced from a small sample. Metron. 1921, 1: 1-32.
2.
go back to reference Donner A: A review of inference procedures for the intraclass correlation coefficient in the one-way random effects model. Int Stat Rev. 1986, 54: 67-82. 10.2307/1403259.CrossRef Donner A: A review of inference procedures for the intraclass correlation coefficient in the one-way random effects model. Int Stat Rev. 1986, 54: 67-82. 10.2307/1403259.CrossRef
3.
go back to reference Cronbach LJ, Gleser GC, Nanda H, Rajaratnam N: The dependability of behavioral measurements: theory of generalizability od scores and profiles. 1972, New York: Wiley Cronbach LJ, Gleser GC, Nanda H, Rajaratnam N: The dependability of behavioral measurements: theory of generalizability od scores and profiles. 1972, New York: Wiley
4.
go back to reference Ebel RL: Estimation of the reliability of ratings. Psychometrika. 1951, 16: 407-424. 10.1007/BF02288803.CrossRef Ebel RL: Estimation of the reliability of ratings. Psychometrika. 1951, 16: 407-424. 10.1007/BF02288803.CrossRef
5.
go back to reference Visscher PM: On the sampling variance of intraclass correlations and genetic correlation. Genetics. 1998, 149: 1605-1614.PubMedPubMedCentral Visscher PM: On the sampling variance of intraclass correlations and genetic correlation. Genetics. 1998, 149: 1605-1614.PubMedPubMedCentral
6.
go back to reference Visscher PM, et al: Assumption-free estimation of heritability from genome-wide identity-by-descent sharing between full sibilings. PLoS Genet. 2006, 2 (3): e41-10.1371/journal.pgen.0020041.CrossRefPubMedPubMedCentral Visscher PM, et al: Assumption-free estimation of heritability from genome-wide identity-by-descent sharing between full sibilings. PLoS Genet. 2006, 2 (3): e41-10.1371/journal.pgen.0020041.CrossRefPubMedPubMedCentral
7.
go back to reference Bradley RA, Schumann DEW: The comparison of the sensitivities of similar experiments: applications. Biometrics. 1957, 13: 496-10.2307/2527974.CrossRef Bradley RA, Schumann DEW: The comparison of the sensitivities of similar experiments: applications. Biometrics. 1957, 13: 496-10.2307/2527974.CrossRef
8.
go back to reference Pellis L, Hal NL, von Burema J, Keijer J: The intraclass correlation coefficient applied for evaluation of data correction, labeling methods, and rectal biopsy sampling in DNA microarray experiments. Physiol Genomics. 2003, 16: 99-106. 10.1152/physiolgenomics.00111.2003.CrossRefPubMed Pellis L, Hal NL, von Burema J, Keijer J: The intraclass correlation coefficient applied for evaluation of data correction, labeling methods, and rectal biopsy sampling in DNA microarray experiments. Physiol Genomics. 2003, 16: 99-106. 10.1152/physiolgenomics.00111.2003.CrossRefPubMed
9.
go back to reference Killip S, Mahfoud Z, Pearce K: What is an intracluster correlation coefficient? Crucial concepts for primary care researchers: crucial concepts for primary care researchers. Ann Family Med. 2003, 2 (3): 204-208.CrossRef Killip S, Mahfoud Z, Pearce K: What is an intracluster correlation coefficient? Crucial concepts for primary care researchers: crucial concepts for primary care researchers. Ann Family Med. 2003, 2 (3): 204-208.CrossRef
10.
go back to reference Non parametric bootstrap confidence intervals for the correlation coefficient. Stat Med. 2003, 22: 3805-3821. 10.1002/sim.1643. Non parametric bootstrap confidence intervals for the correlation coefficient. Stat Med. 2003, 22: 3805-3821. 10.1002/sim.1643.
11.
go back to reference Altaye M, Donner A, Klar N: Inference procedures for assessing interobserver agreement among multiple raters. Biometrics. 2001, 457: 584-588.CrossRef Altaye M, Donner A, Klar N: Inference procedures for assessing interobserver agreement among multiple raters. Biometrics. 2001, 457: 584-588.CrossRef
12.
go back to reference Ghosh H, Das A: Optimal diallel cross designs for estimation of heritability. J Stat Planning and Inference. 2003, 116 (1): 185-196. 10.1016/S0378-3758(02)00180-5.CrossRef Ghosh H, Das A: Optimal diallel cross designs for estimation of heritability. J Stat Planning and Inference. 2003, 116 (1): 185-196. 10.1016/S0378-3758(02)00180-5.CrossRef
13.
go back to reference Shoukri MM, Donner A: Efficiency considerations in the analysis of inter-observer agreement. Biostatistics. 2001, 2: 321-336.CrossRef Shoukri MM, Donner A: Efficiency considerations in the analysis of inter-observer agreement. Biostatistics. 2001, 2: 321-336.CrossRef
14.
go back to reference Fisher RA: Statistical Methods for Research Workers. 1925, Edinburgh: Oliver and Boyd Fisher RA: Statistical Methods for Research Workers. 1925, Edinburgh: Oliver and Boyd
15.
go back to reference Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychological Bull. 1979, 86: 420-428.CrossRef Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychological Bull. 1979, 86: 420-428.CrossRef
16.
go back to reference Fleiss JL, Cohen J: The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Meas. 1973, 33: 613-619. 10.1177/001316447303300309.CrossRef Fleiss JL, Cohen J: The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Meas. 1973, 33: 613-619. 10.1177/001316447303300309.CrossRef
17.
go back to reference Müller R, Büttner P: A critical discussion of intraclass correlation coefficients. Stat Med. 1994, 13: 2465-2476. 10.1002/sim.4780132310.CrossRefPubMed Müller R, Büttner P: A critical discussion of intraclass correlation coefficients. Stat Med. 1994, 13: 2465-2476. 10.1002/sim.4780132310.CrossRefPubMed
18.
go back to reference Snedecor GW: Statistical Methods. 1946, Ames: The Iowa State University Press Snedecor GW: Statistical Methods. 1946, Ames: The Iowa State University Press
19.
go back to reference Konishi S: Normalizing and variance stabilizing transformations for intraclass correlation. Ann Inst Statist Math. 1985, 37: Part A 87-94.CrossRef Konishi S: Normalizing and variance stabilizing transformations for intraclass correlation. Ann Inst Statist Math. 1985, 37: Part A 87-94.CrossRef
20.
go back to reference Weinberg R, Patel YC: Simulated intraclass correlation coefficients and their z transforms. J Stat Comput Simul. 1981, 13: 13-26. 10.1080/00949658108810471.CrossRef Weinberg R, Patel YC: Simulated intraclass correlation coefficients and their z transforms. J Stat Comput Simul. 1981, 13: 13-26. 10.1080/00949658108810471.CrossRef
21.
go back to reference Wang CS, Yadell BS, Rutledge JJ: Bias of maximum likelihood estimator of intraclass correlation. Theor Appl Genet. 1991, 82: 421-424. 10.1007/BF00588594.CrossRefPubMed Wang CS, Yadell BS, Rutledge JJ: Bias of maximum likelihood estimator of intraclass correlation. Theor Appl Genet. 1991, 82: 421-424. 10.1007/BF00588594.CrossRefPubMed
22.
go back to reference Ponzoni RW, James JW: Possible biases in heritability estimates from intraclass correlation. Theor Appl Genet. 1978, 53: 25-27.PubMed Ponzoni RW, James JW: Possible biases in heritability estimates from intraclass correlation. Theor Appl Genet. 1978, 53: 25-27.PubMed
23.
go back to reference Olkin I, Pratt W: Unbiased estimation of certain correlation coefficients. Ann Mathamatical Stat. 1958, 29: 201-211. 10.1214/aoms/1177706717.CrossRef Olkin I, Pratt W: Unbiased estimation of certain correlation coefficients. Ann Mathamatical Stat. 1958, 29: 201-211. 10.1214/aoms/1177706717.CrossRef
24.
go back to reference Snedecor GW, Cochran WG: Statistical Methods. 1980, Ames: The Iowa State University Press Snedecor GW, Cochran WG: Statistical Methods. 1980, Ames: The Iowa State University Press
25.
go back to reference Das A, Ghosh H: Estimation of the ratio of variance components and optimal diallel cross over designs. Indian Statistical Institute. 2003, Technical Report Das A, Ghosh H: Estimation of the ratio of variance components and optimal diallel cross over designs. Indian Statistical Institute. 2003, Technical Report
26.
go back to reference Barnhart HX, Haber MJ, Lin LI: An overview on assessing agreement with continuous measurements. J Biopharmaceutical Stat. 2007, 17: 529-569. 10.1080/10543400701376480.CrossRef Barnhart HX, Haber MJ, Lin LI: An overview on assessing agreement with continuous measurements. J Biopharmaceutical Stat. 2007, 17: 529-569. 10.1080/10543400701376480.CrossRef
27.
go back to reference Chen CC, Barnhat HX: Comparison of ICC and CCC for assessing agreement for data without and with replications. Comput Stat Data Anal. 2008, 53: 554-564. 10.1016/j.csda.2008.09.026.CrossRef Chen CC, Barnhat HX: Comparison of ICC and CCC for assessing agreement for data without and with replications. Comput Stat Data Anal. 2008, 53: 554-564. 10.1016/j.csda.2008.09.026.CrossRef
28.
go back to reference Costa-Santos C, Bernardes J, Ayres-De-Campos D, Costa A, Costa C: The limits of agreement and the intraclass correlation coefficient may be inconsistent in the interpretation of agreement. J Clin Epidemiol. 2011, 64: 264-269. 10.1016/j.jclinepi.2009.11.010.CrossRefPubMed Costa-Santos C, Bernardes J, Ayres-De-Campos D, Costa A, Costa C: The limits of agreement and the intraclass correlation coefficient may be inconsistent in the interpretation of agreement. J Clin Epidemiol. 2011, 64: 264-269. 10.1016/j.jclinepi.2009.11.010.CrossRefPubMed
Metadata
Title
Bias-corrected estimator for intraclass correlation coefficient in the balanced one-way random effects model
Authors
Eshetu G Atenafu
Jemila S Hamid
Teresa To
Andrew R Willan
Brian M Feldman
Joseph Beyene
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-126

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue