Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Research article

The appropriateness of Bland-Altman’s approximate confidence intervals for limits of agreement

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Percentiles are widely used as reference limits for determining the relative magnitude and substantial importance of quantitative measurements. An important application is the advocated Bland-Altman limits of agreement.

Methods

To contribute to the data analysis and design planning of reference limit or percentile research, the purpose of this paper is twofold. The first is to clarify the statistical features of interval estimation procedures for normal percentiles. The second goal is to provide sample size procedures for precise interval estimation of normal percentiles.

Results

The delineation demonstrates the theoretical connections between different pivotal quantities for obtaining exact confidence intervals. Moreover, the seemingly accurate approximate methods with equidistant from the principal estimators are shown to have undesirable confidence limits. It is found that the optimal sample size has a minimum for median or mean, and increases as the percentile approaches the extremes.

Conclusions

The exact interval procedure should be used in preference to the approximate methods. Computer algorithms are presented to implement the suggested interval precision and sample size calculations for planning percentile research.
Appendix
Available only for authorised users
Literature
1.
Bland JM, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;327:307–10.CrossRef
2.
Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.CrossRefPubMed
3.
Royston P, Matthews JNS. Estimation of reference ranges from normal samples. Stat Med. 1991;10:691–5.CrossRefPubMed
4.
Keating JP, Mason RL, Balakrishnan N. Percentile estimators in location-scale parameter families under absolute loss. Metrika. 2010;72:351–67.CrossRef
5.
Keating JP, Tripathi RC. Percentiles, estimation of, encyclopedia of statistical sciences, vol. VI. New York: Wiley; 1985. p. 668–74.
6.
Parrish RS. Comparison of quantile estimators in normal sampling. Biometrics. 1990;46:247–57.CrossRef
7.
Rukhin AL. A class of minimax estimators of a normal quantile. Stat Probabil Lett. 1983;1:217–21.CrossRef
8.
Zidek JV. Inadmissibility of the best invariant estimator of extreme quantiles of the normal law under squared error loss. Ann Math Stat. 1969;40:1801–8.CrossRef
9.
Zidek JV. Inadmissibility of a class of estimators of a normal quantile. Ann Math Stat. 1971;42:1444.CrossRef
10.
Hahn GJ. Statistical intervals for a normal population, part I. Tables, examples and applications. J Qual Technol. 1970;2:115–25.CrossRef
11.
Hahn GJ. Statistical intervals for a normal population, part II. Formulas, assumptions, some derivations. J Qual Technol. 1970;2:195–206.CrossRef
12.
Hahn GJ, Meeker WQ. Statistical intervals: a guide for practitioners. New York: Wiley; 1991.CrossRef
13.
Vardeman SB. What about the other intervals? Am Stat. 1992;46:193–7.
14.
Johnson NL, Kotz S, Balakrishnan N. Continuous univariate distributions, vol. 2. 2nd ed. New York: Wiley; 1995.
15.
Owen DB. A survey of properties and applications of the noncentral t-distribution. Technometrics. 1968;10:445–78.
16.
17.
Krishnamoorthy K, Mathew T. Statistical tolerance regions: theory, applications, and computation, vol. 744. New York: Wiley; 2009.CrossRef
18.
Odeh RE, Owen DB. Tables for normal tolerance limits, sampling plans, and screening. New York: Marcel Dekker; 1980.
19.
Carkeet A. Exact parametric confidence intervals for Bland-Altman limits of agreement. Optom Vis Sci. 2015;92:e71–80.CrossRefPubMed
20.
Carkeet A, Goh YT. Confidence and coverage for Bland-Altman limits of agreement and their approximate confidence intervals. Stat Methods Med Res. 2018;27:1559–74.CrossRefPubMed
21.
Barnhart HX, Haber MJ, Lin LI. An overview on assessing agreement with continuous measurements. J Biopharm Stat. 2007;17:529–69.CrossRefPubMed
22.
Choudhary PK, Nagaraja HN. Measuring agreement in method comparison studies–a review. In: Balakrishnan N, Kannan N, Nagaraja HN, editors. Advances in ranking and selection, multiple comparisons, and reliability. Boston: Birkhauser; 2004. p. 215–44.
23.
Lin LI, Hedayat AS, Sinha B, et al. Statistical methods in assessing agreement: models, issues and tools. J Am Stat Assoc. 2002;97:257–70.CrossRef
24.
Chakraborti S, Li J. Confidence interval estimation of a normal percentile. Am Stat. 2007;61:331–6.CrossRef
25.
Lawless JF. Statistical models and methods for lifetime data. 2nd ed. New York: Wiley; 2003.
26.
Beal SL. Sample size determination for confidence intervals on the population mean and on the difference between two population means. Biometrics. 1989;45:969–77.CrossRefPubMed
27.
Kupper LL, Hafner KB. How appropriate are popular sample size formulas? Am Stat. 1989;43:101–5.
Metadata
Title
The appropriateness of Bland-Altman’s approximate confidence intervals for limits of agreement
Publication date
01-12-2018
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0505-y

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue

Research article

A randomized comparison of three data collection models for the measurement of parent experiences with diabetes outpatient care

Technical advance

Assessing the effect of a partly unobserved, exogenous, binary time-dependent covariate on survival probabilities using generalised pseudo-values

Research article

Adjustment for unmeasured confounding through informative priors for the confounder-outcome relation

Research article

Synthesising conceptual frameworks for patient and public involvement in research – a critical appraisal of a meta-narrative review

Research article

A comparison of multiple imputation methods for missing data in longitudinal studies

Research article

Towards integrated surveillance of zoonoses: spatiotemporal joint modeling of rodent population data and human tularemia cases in Finland