Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Debate

Evaluation of surrogate measures of insulin sensitivity - correlation with gold standard is not enough

Authors: Anna Rudvik, Marianne Månsson

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Impaired insulin sensitivity is a key abnormality underlying the development of type 2 diabetes. Measuring insulin sensitivity is therefore of importance in identifying individuals at risk of developing diabetes and for the evaluation of diabetes-focused interventions. A number of measures have been proposed for this purpose. Among these the hyperinsulinemic euglycemic clamp (HEC) is considered the gold standard. However, as the HEC is a costly, time consuming and invasive method requiring trained staff, there is a need for simpler so called surrogate measures.

Main message

A frequently used approach to evaluate surrogate measures is through correlation with the HEC. We discuss limitations with this method. We suggest other aspects to take into consideration, such as repeatability, reproducibility, systematic biases and discrimination ability. In addition, we focus on three frequently used surrogate measures. We argue that they are one-to-one transformations of each other, and therefore question the benefits of further comparison between them. They give the same results in all rank-based methods, for instance Spearman correlations, Mann-Whitney tests and receiver operating characteristic (ROC) analysis.

Conclusions

We suggest investigating further aspects than correlation alone when evaluating a surrogate measure of insulin sensitivity. We recommend choosing one of the three surrogate measures HOMA-IR, QUICKI and FIRI for analysis of a clinical study.
Appendix
Available only for authorised users
Literature
1.
go back to reference deFronzo R, Tobin JD, Andres R. Glucose clamp technique: a method for quantifying insulin secretion and resistance. Am J Physiol Endocrinol Metab. 1979; 237(3):214–23.CrossRef deFronzo R, Tobin JD, Andres R. Glucose clamp technique: a method for quantifying insulin secretion and resistance. Am J Physiol Endocrinol Metab. 1979; 237(3):214–23.CrossRef
2.
go back to reference Otten J, Ahrén B, Olsson T. Surrogate measures of insulin sensitivity vs the hyperinsulineamic-euglycemic clamp: a meta-analysis. Diabetologia. 2014; 57(9):1781–8.CrossRefPubMed Otten J, Ahrén B, Olsson T. Surrogate measures of insulin sensitivity vs the hyperinsulineamic-euglycemic clamp: a meta-analysis. Diabetologia. 2014; 57(9):1781–8.CrossRefPubMed
5.
go back to reference Borai A, Livingstone C, Kaddam I, Ferns G. Selection of the appropriate method for the assessment of insulin resistance. BMC Med Res Methodol. 2011; 11:158.CrossRefPubMedPubMedCentral Borai A, Livingstone C, Kaddam I, Ferns G. Selection of the appropriate method for the assessment of insulin resistance. BMC Med Res Methodol. 2011; 11:158.CrossRefPubMedPubMedCentral
6.
go back to reference de Koster JD, Hostens M, Hermans K, Van der Broeck W, Opsomer G. Validation of different measures of insulin sensitivity of glucose metabolism in dairy cows using the hyperinsulinemic euglycemic clamp test as the gold standard. Domest Anim Endocrinol. 2016; 57:117–26.CrossRefPubMed de Koster JD, Hostens M, Hermans K, Van der Broeck W, Opsomer G. Validation of different measures of insulin sensitivity of glucose metabolism in dairy cows using the hyperinsulinemic euglycemic clamp test as the gold standard. Domest Anim Endocrinol. 2016; 57:117–26.CrossRefPubMed
7.
go back to reference Hoffman RP. Indices of insulin action calculated from fasting glucose and insulin reflect hepatic, not peripheral, insulin sensitivity in African-American and Caucasian adolescents. Pediatr Diabetes. 2008; 9:57–61.CrossRefPubMed Hoffman RP. Indices of insulin action calculated from fasting glucose and insulin reflect hepatic, not peripheral, insulin sensitivity in African-American and Caucasian adolescents. Pediatr Diabetes. 2008; 9:57–61.CrossRefPubMed
8.
go back to reference Jeffries C, Jackson W, Robinson E, Hoffman P. Evaluation of HOMA and QUICKI as measures of insulin sensitivity in prepubertal children. Pediatr Diabetes. 2003; 4:119–25.CrossRef Jeffries C, Jackson W, Robinson E, Hoffman P. Evaluation of HOMA and QUICKI as measures of insulin sensitivity in prepubertal children. Pediatr Diabetes. 2003; 4:119–25.CrossRef
9.
go back to reference Uwaifo GI, Fallon EM, Chin J, Elberg J, Parikh SJ, Yanovski JA. Indices of insulin action, disposal, and secretion derived from fasting samples and clamps in normal glucose-tolerant black and white children. Diabetes Care. 2002; 25(11):2081–7.CrossRefPubMed Uwaifo GI, Fallon EM, Chin J, Elberg J, Parikh SJ, Yanovski JA. Indices of insulin action, disposal, and secretion derived from fasting samples and clamps in normal glucose-tolerant black and white children. Diabetes Care. 2002; 25(11):2081–7.CrossRefPubMed
10.
go back to reference Wallace TM, Levy JC, Matthews DR. Use and abuse of HOMA modeling. Diabetes Care. 2005; 27(6):1487–95.CrossRef Wallace TM, Levy JC, Matthews DR. Use and abuse of HOMA modeling. Diabetes Care. 2005; 27(6):1487–95.CrossRef
11.
go back to reference Stumwoll M, Mitrakou A, Pimenta W, Jenssen T, Yki-Järvinen H, Van Haeften T, Renn W, Gerich J. Use of the oral glucose tolerance test to assess insulin release and insulin sensitivity. Diabetes Care. 2000; 23(3):295–301.CrossRef Stumwoll M, Mitrakou A, Pimenta W, Jenssen T, Yki-Järvinen H, Van Haeften T, Renn W, Gerich J. Use of the oral glucose tolerance test to assess insulin release and insulin sensitivity. Diabetes Care. 2000; 23(3):295–301.CrossRef
12.
go back to reference Ikeada Y, Suehiro T, Nakamura T, Kumon Y, Hashimoto K. Clinical significance of the insulin resistance index as assessed by homeostasis model assessment. Endocr J. 2001; 48(1):81–6.CrossRef Ikeada Y, Suehiro T, Nakamura T, Kumon Y, Hashimoto K. Clinical significance of the insulin resistance index as assessed by homeostasis model assessment. Endocr J. 2001; 48(1):81–6.CrossRef
13.
go back to reference Mari A, Pacini G, Murphy E, Ludvik B, Nolan J. A model-based method for assessing insulin sensitivity from the oral glucose tolerance test. Diabetes Care. 2001; 24(3):539–48.CrossRefPubMed Mari A, Pacini G, Murphy E, Ludvik B, Nolan J. A model-based method for assessing insulin sensitivity from the oral glucose tolerance test. Diabetes Care. 2001; 24(3):539–48.CrossRefPubMed
14.
go back to reference Yokoyama H, Emoto M, Fujiwara S, Motoyama K, Morioka T, Komatsu M, Tahara H, Shoji T, Okuno Y, Nishizawa Y. Quantiative insulin sensitivity check index and the reciprocal index of homeostasis model assessment in normal range weight and moderately obese type 2 diabetic patients. Diabetes Care. 2003; 26(8):2426–32.CrossRefPubMed Yokoyama H, Emoto M, Fujiwara S, Motoyama K, Morioka T, Komatsu M, Tahara H, Shoji T, Okuno Y, Nishizawa Y. Quantiative insulin sensitivity check index and the reciprocal index of homeostasis model assessment in normal range weight and moderately obese type 2 diabetic patients. Diabetes Care. 2003; 26(8):2426–32.CrossRefPubMed
15.
go back to reference Rössner SM, Neovius M, Mattson A, Marcus C, Norgren S. HOMA-IR and QUICKI: decide on a general standard instead of making further comparisons. Acta Peadiatr. 2010; 99(11):1735–40.CrossRef Rössner SM, Neovius M, Mattson A, Marcus C, Norgren S. HOMA-IR and QUICKI: decide on a general standard instead of making further comparisons. Acta Peadiatr. 2010; 99(11):1735–40.CrossRef
16.
go back to reference Ruige JB, Mertens IL, Bartholomeeusen E, Dirnick E, Ferrannini E, Van Gaal LF. Fasting-based estimates of insulin sensitivity in overweight and obesity: a critical appraisal. Obesity. 2006; 14(7):1250–6.CrossRefPubMed Ruige JB, Mertens IL, Bartholomeeusen E, Dirnick E, Ferrannini E, Van Gaal LF. Fasting-based estimates of insulin sensitivity in overweight and obesity: a critical appraisal. Obesity. 2006; 14(7):1250–6.CrossRefPubMed
17.
go back to reference Rupinski M, Dunlap W. Approximating Pearson product-moment correlations from Kendall’s tau and Spearman’s rho. Educ Psychol Meas. 1996; 56(3):419–29.CrossRef Rupinski M, Dunlap W. Approximating Pearson product-moment correlations from Kendall’s tau and Spearman’s rho. Educ Psychol Meas. 1996; 56(3):419–29.CrossRef
18.
go back to reference Berger VW. Does the Prentice criterion validate surrogate endpoints?Stat Med. 2004; 23(10):1571–8.CrossRefPubMed Berger VW. Does the Prentice criterion validate surrogate endpoints?Stat Med. 2004; 23(10):1571–8.CrossRefPubMed
19.
go back to reference Buyse M, Molenberghs G. Criteria for the validation of surrogate endpoints in randomized experiments. Biometrics. 1998; 54:1014–29.CrossRefPubMed Buyse M, Molenberghs G. Criteria for the validation of surrogate endpoints in randomized experiments. Biometrics. 1998; 54:1014–29.CrossRefPubMed
20.
go back to reference Freedman LS, Graubard BI, Schatzkin A. Statistical validation of intermediate endpoints for chronic diseases. Stat Med. 1992; 11(2):167–78.CrossRefPubMed Freedman LS, Graubard BI, Schatzkin A. Statistical validation of intermediate endpoints for chronic diseases. Stat Med. 1992; 11(2):167–78.CrossRefPubMed
21.
go back to reference Cheng YJ, Kahn HS, Gregg EW, Imperatore G, Geiss LS. Recent population changes in HbA1c and fasting insulin concentrations among US adults with preserved glucos homeostasis. Diabetologia. 2010; 53:1890–3.CrossRefPubMed Cheng YJ, Kahn HS, Gregg EW, Imperatore G, Geiss LS. Recent population changes in HbA1c and fasting insulin concentrations among US adults with preserved glucos homeostasis. Diabetologia. 2010; 53:1890–3.CrossRefPubMed
22.
go back to reference Li C, Ford ES, McGuire LC, Mokdad AH, Little RR, Reaven GM. Trends in hyperinsulinemia among nondiabetic adults in the U.S. Diabetes Care. 2006; 29(11):2396–402.CrossRefPubMed Li C, Ford ES, McGuire LC, Mokdad AH, Little RR, Reaven GM. Trends in hyperinsulinemia among nondiabetic adults in the U.S. Diabetes Care. 2006; 29(11):2396–402.CrossRefPubMed
23.
go back to reference Duc Son L, Brookshire T, Krakoff J, Bunt JC. Repeatability and reproducibility of the hyperinsulinemic-euglycemic clamp and the tracer dilution technique in a controlled inpatient setting. Metabolism. 2009; 58(3):304–10.CrossRef Duc Son L, Brookshire T, Krakoff J, Bunt JC. Repeatability and reproducibility of the hyperinsulinemic-euglycemic clamp and the tracer dilution technique in a controlled inpatient setting. Metabolism. 2009; 58(3):304–10.CrossRef
24.
go back to reference Bergman RN, Finegood DT, Ader M. Assessment of insulin sensitivity in vivo. Endocr Rev. 1985; 6:45–86.CrossRefPubMed Bergman RN, Finegood DT, Ader M. Assessment of insulin sensitivity in vivo. Endocr Rev. 1985; 6:45–86.CrossRefPubMed
Metadata
Title
Evaluation of surrogate measures of insulin sensitivity - correlation with gold standard is not enough
Authors
Anna Rudvik
Marianne Månsson
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0521-y

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue