Abstract
Objective
Continuous glucose monitoring (CGM) has the potential to improve glucose control in the intensive care unit (ICU) setting. We sought to evaluate the accuracy of the intermittently scanned CGM (isCGM) system in critically ill patients.
Research design and methods
Adult patients were consecutively enrolled from three ICUs from August 2020 to January 2021. The performance of FreeStyle Libre Pro was evaluated against the venous blood glucose samples as a reference. Numerical accuracy was examined by the mean absolute relative difference (MARD), the Bland–Altman analysis, and the International Organization for Standardization criteria. Clinical accuracy was assessed by performing the Clarke and consensus error grid analysis.
Results
A total of 122 patients were included and 3416 matched glucose pairs were analyzed. The overall MARD was 18.0%, and the highest MARD (33.1%) was observed in the hypoglycemic range (<70 mg/dL). The Bland–Altman analysis revealed a mean bias of −11.7 mg/dL, with the 95% limits of agreement of −73.0 to 49.5 mg/dL. The percentages of isCGM glucose values within ±15%/15, ±20%/20, and ±30%/30 mg/dL were 49.8%, 64.7%, and 84.5%, respectively. The Clarke and consensus error grid analysis showed acceptable clinical accuracy with 98.5% and 98.8% of glucose values falling into zones A and B.
Conclusions
Our study demonstrated suboptimal overall accuracy of isCGM for critically ill patients. Whether the adjunctive use of isCGM could improve glucose management and health outcomes in the critically ill needs further investigation.
Clinical trial registration
ChiCTR2100042036, Chinese Clinical Trial Registry.
Similar content being viewed by others
Introduction
Hyperglycemia is common in the intensive care unit (ICU) and may be secondary to either diabetes or critical illness-associated hyperglycemia. Since the landmark study of Van den Berghe et al. [1], it is generally accepted that maintenance of blood glucose levels within a specified range is associated with improved morbidity and mortality in inpatients including the critically ill. Needless to say, glucose monitoring is essential for the adjustment of treatment regimens and optimal glucose control.
Currently, bedside fingertip blood glucose measurement is still the standard of care for the evaluation of blood glucose levels in the ICU. According to the latest American Diabetes Association guidelines, hospitalized patients need 3–6 finger blood glucose tests every day. More frequent monitoring, approximately every 30 min to 2 h, is required for patients who use intravenous insulin [2]. Compared with fingertip blood glucose testing, continuous glucose monitoring (CGM) has the advantage of comprehensive 24-h monitoring, allowing for the assessment of glucose patterns and trends, and the identification of asymptomatic hypoglycemia and nocturnal hypoglycemia [3] that are unrecognized by conventional methods. Although CGM has been demonstrated to improve glycemic control in outpatients with diabetes [4, 5] and in hospitalized patients in non-critical care settings [6], the use of CGM in the ICU is still limited, with accuracy being a major concern. In this regard, numerous previous studies have evaluated the performance of multiple CGM sensors, and the results varied widely [7,8,9]. Moreover, only a few have assessed the performance of isCGM in ICUs [8, 10,11,12]. Therefore, this study aimed to evaluate the analytical and clinical accuracy of an isCGM device in a large group of critically ill patients.
Research design and methods
Study design
This was a prospective, observational, multicenter study performed at the Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Jinshan Branch of Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, and Lingang Campus of Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine (names of principal investigators listed in Supplementary Table 1). The study protocol was approved by the ethics committee of Shanghai Sixth People’s Hospital, and all subjects gave informed consent before the study enrollment (ChiCTR2100042036, Chinese Clinical Trial Registry).
Participants
The study involved patients from three central ICUs from August 2020 to January 2021. Eligible participants were adult patients with acute physiology and chronic health evaluation II (APACHE II) scores over 15 and good venous access and who were expected to remain in the ICU for at least 3 days. Key exclusion criteria included using glucocorticoids and immunosuppressants; pregnancy or planned pregnancy; severe anemia (hemoglobin <6 g/dL); allergy to the adhesive used in the monitoring; adverse skin diseases (such as cowhide moss or rash) in the instrument placement area; a need for MRI examination; or an eventual ICU stay less than 3 days due to various reasons (such as death or ICU discharge).
Procedures
The study team approached patients shortly after hospital admission to explain the design and potential risks of the study. After informed consent was obtained, a trained team member placed a FreeStyle Libre Pro (Abbott Diabetes Care, Alameda, CA, USA) in the posterior upper arm according to the instructions. Data can be obtained starting within 60 min after the sensor is successfully initiated, and the glucose value can be collected every 15 min for 14 days (hereafter referred to as the isCGM value). The research team took 0.5 mL of venous blood every 15 min for 7 consecutive hours on a random day after enrollment. Venous plasma blood glucose was measured immediately as the reference glucose values with a blood glucose lactic acid analyzer (EKF BIOSEN-C line series, German) using the glucose-oxidase method after centrifugation at bedside (hereafter referred to as the venous blood glucose [vBG] value). The isCGM values were matched with the vBG values measured simultaneously, and the corresponding glucose pairs were used to assess the accuracy of isCGM.
Patient age, gender, medical history, medication, use of renal replacement therapy, and use of ventilator were collected. Blood gas, leukocytes, and creatinine were measured by the alcohol method, and glycosylated hemoglobin was measured by the high-pressure liquid method. The patient’s heart rate and blood pressure were collected from the intensive care system.
The patients and the study team were blinded to the isCGM glucose results during the research. According to the guidelines of the American Diabetes Association, these three centers adopted a unified glycemic control program. All isCGM data were downloaded after ICU discharge using LibreView software (Abbott Diabetes Care, Alameda, CA, USA) after removal from this study.
Statistical analysis
For the evaluation of analytical accuracy, we calculated the absolute relative difference (ARD) ([sensor glucose – reference glucose]/reference glucose, %) between matched glucose pairs, and then mean ARD (MARD) was reported. We also conducted the Bland–Altman analysis and calculated the percentages of sensor glucose levels within ±15%/15, ±20%/20, and ±30%/30 mg/dL from the reference glucose value. These metrics were evaluated for all paired glucose values and in different glucose ranges (<70, 70–180, and >180 mg/dL). Clinical accuracy was assessed by performing the Clarke and consensus error grid analysis. The error grid analyses were performed with MATLAB R2021a (MathWorks). All other analyses were conducted with SAS 9.4. A P value of <0.05 (two-tailed) was considered statistically significant.
Results
Basic information of the participants
A total of 122 patients were finally included for analysis. The mean age of the study population was 65.4 ± 15.5 years, and 43 (35.2%) were female. Twenty-three (18.9%) patients were diagnosed with type 2 diabetes (Table 1). The mean hemoglobin A1c (HbA1c) level was 6.2 ± 1.5% (44.5 ± 16.2 mmol/mol), the median length of hospital stay was 27.5 days, and the median length of ICU stay was 20 days. During the study, 32 patients received antihypertensive drugs, 32 patients received vasopressors, 29 patients received heart rate-lowering drugs, 90 patients were intubated, and 34 patients were on renal replacement therapy.
Accuracy analysis
A total of 3416 matched pairs of isCGM/vBG values were analyzed. The average vBG value was 150.7 ± 62.0 mg/dL, and the average isCGM value was 139.0 ± 63.7 mg/dL (Table 1). The overall MARD was 18.0 ± 13.4% (Table 2). The Bland–Altman analysis revealed a mean bias of −11.7 mg/dL, with the 95% limits of agreement of −73.0 to 49.5 mg/dL (Fig. 1). For 3212 of the 3416 paired values (94.0%), the difference was within the 95% limits of agreement. The percentages of isCGM values within ±15%/15, ±20%/20, and ±30%/30 mg/dL of vBG values were 49.8%, 64.7%, and 84.5%, respectively (Table 2).
The Clarke and consensus error grid analysis showed acceptable clinical accuracy, with 98.5% (zone A: 64.0%, zone B: 34.5%) and 98.8% (zone A: 65.2%, zone B: 33.5%) of glucose values falling into zones A + B, respectively (Fig. 2).
Factors affecting accuracy
The accuracy was higher in the hyperglycemic range (>180 mg/dL, n = 923, MARD 16.3 ± 12.3%) than in the target range of 70–180 mg/dL (n = 2411, MARD 18.2 ± 12.9%) (P < 0.001) (Table 2). The highest MARD was observed in the hypoglycemic range (<70 mg/dL, n = 82, MARD 33.1%) (P < 0.001).
For glucose readings <70 mg/dL (n = 82), ±15%/15, ±20%/20, and ±30%/30 mg/dL were 46.3%, 58.5%, and 75.6%, respectively (Table 2). The percentages for glucose values within 70–180 mg/dL (n = 2411) were 48.1%, 63.5%, and 84.3%, respectively. For glucose readings >180 mg/dL (n = 923), ±15%/15, ±20%/20, and ±30%/30 mg/dL were 54.7%, 67.9%, and 85.6%, respectively.
For further evaluation, data were stratified by subgroups according to selected clinical factors. Linear regression analysis with the interaction component was performed to explore the relationship between MARD and these clinical variables (Supplementary Table 2). Significantly lower MARD was observed in patients with diabetes when compared with those without diabetes (interaction P = 0.015). The accuracy of isCGM was not influenced by other characteristics including age, gender, pH, APACHE II score, or the use of vasopressors.
Discussion
To date, most hospitalized patients undergo fingertip capillary blood glucose testing as the primary method of glucose monitoring. However, the accuracy of blood glucose meters varies greatly [13] and may be affected by several factors [14]. Moreover, frequent measurements in those patients who use insulin will simultaneously increase the workload of medical workers and the risk of infection, especially in the context of the COVID-19 pandemic. On the other hand, there is a large body of evidence that isCGM can improve glucose control and quality of life [15–17]. In a randomized controlled multicenter study, Bolinder et al. found that using isCGM (freestyle Libre) for 2 weeks reduced the whole-day hypoglycemic events (<70 mg/dL) by 25.8%, the nocturnal hypoglycemic events by 33.2% and the severe hypoglycemic events (<40 mg/dL) by 55% in patients with type 1 diabetes with good glycemic control (HbA1c ≤ 7.5% [58.5 mmol/mol]) [18]. This suggests that isCGM may improve blood glucose control in critically ill patients.
The accuracy of isCGM in critically ill patients has been reported in some studies, but these studies have some limitations, such as a small sample size, few matched pairs, the single-center and/or retrospective study design, and inconsistent reference methods, which also partially explains for the conflicting results concerning the MARD values (14–41%). For instance, Ancona et al. analyzed 185 pairs in 8 critically ill patients with type 2 diabetes and showed that the MARD was 14% [8]. The analysis of the accuracy of isCGM in the hypoglycemic range was precluded in that study due to the lack of hypoglycemic glycose pairs. Several previous studies evaluated the accuracy of isCGM in a pediatric ICU (n = 16, 711 pairs) [10], a cardiology ICU (n = 15, 149 pairs) [11], and COVID-19 patients in an ICU (n = 17, 171 pairs) [12], respectively, but the results could not be extended to all critically ill patients.
In this prospective study, we analyzed 3416 pairs from 122 patients, and the MARD was 18.0%, implying suboptimal overall accuracy for critically ill patients. Furthermore, we found that the accuracy of blood glucose monitoring decreased as vBG decreased but was not influenced by patients’ characteristics, such as age, gender, pH, APACHE II score, or the use of vasopressors, suggesting that these results could be generalized to a wide range of critically ill patients.
Of note, together with the current glucose value, CGM systems provide trend arrows to indicate the direction and rate of glucose change, to inform decision making. Therefore, the ideal assessment of CGM accuracy should include both point accuracy and trend accuracy [19]. However, there is no well-accepted metric for evaluating trend accuracy. Interestingly, in a small study investigating the accuracy of isCGM, visual inspection revealed that FGM values closely followed the trend of the reference method (arterial blood gas) despite the poor point accuracy [9]. Taken together, although the point accuracy of isCGM in our study does not justify the nonadjunctive use of this device in ICU, it is possible that patients may benefit from a hybrid management protocol incorporating both isCGM (including glucose values and trend) and point-of-care measurements while reducing the workload and infection risk of health providers. The impact of such protocols on the outcomes of critically ill patients warrants further investigations.
The advantage of this study lies in the inclusion of a mixed population of medical-surgical ICU patients, the multicenter study design, a large number of glucose pairs comprising the full range of glycemia, the use of venous plasma glucose as the only reference standard, and the unified equipment used to measure vBG. Nevertheless, there are some limitations to this research. First, most of the samples in this study were taken during the day. Therefore, we could not examine the difference in the accuracy of isCGM between daytime and nighttime. However, the relatively large sample size enabled us to investigate the accuracy of FGM in the full range of glucose levels (i.e., hypoglycemic, euglycemic, and hyperglycemic ranges), which partially mitigates this concern. Second, trend accuracy was not evaluated in this study, which may be an interesting issue to address in the future. Finally, the effect of isCGM on glycemic outcomes could not be determined in this study.
In summary, our study demonstrated suboptimal overall accuracy of isCGM for critically ill patients. Whether the adjunctive use of isCGM could improve glucose management and health outcomes in the critically ill needs further investigation.
Data availability
Restrictions apply to the availability of data generated or analyzed during this study to preserve patient confidentiality or because they were used under license. The corresponding author will, on request, detail the restrictions and any conditions under which access to some data may be provided.
References
G. van den Berghe, P. Wouters, F. Weekers et al. Intensive insulin therapy in critically ill patients. N. Engl. J. Med. 345(19), 1359–1367 (2001)
American Diabetes Association, 15. Diabetes care in the hospital: standards of medical care in diabetes—2021. Diabetes Care 44(Supplement 1), S211–S220 (2021)
T. Danne, R. Nimri, T. Battelino et al. International consensus on use of continuous glucose monitoring. Diabetes Care 40(12), 1631–1640 (2017)
R.W. Beck, T. Riddlesworth, K. Ruedy et al. Effect of continuous glucose monitoring on glycemic control in adults with type 1 diabetes using insulin injections: the DIAMOND randomized clinical trial. JAMA 317(4), 371–378 (2017)
R.A. Vigersky, S.J. Fonda, M. Chellappa et al. Short- and long-term effects of real-time continuous glucose monitoring in patients with type 2 diabetes. Diabetes Care 35(1), 32–38 (2012)
A.M. Gómez, G.E. Umpierrez, O.M. Muñoz et al. Continuous glucose monitoring versus capillary point-of-care testing for inpatient glycemic control in type 2 diabetes patients hospitalized in the general ward and treated with a basal bolus insulin regimen. J. Diabetes Sci. Technol. 10(2), 325–329 (2015)
S. Rijkenberg, S.C. van Steen, J.H. DeVries et al. Accuracy and reliability of a subcutaneous continuous glucose monitoring device in critically ill patients. J. Clin. Monit. Comput. 32(5), 953–964 (2018)
P. Ancona, G.M. Eastwood, L. Lucchetta et al. The performance of flash glucose monitoring in critically ill patients with diabetes. Crit. Care Resusc. 19(2), 167–174 (2017)
F. Schierenbeck, A. Franco-Cereceda, J. Liska, Accuracy of 2 different continuous glucose monitoring systems in patients undergoing cardiac surgery. J. Diabetes Sci. Technol. 11(1), 108–116 (2017)
E. Kotzapanagiotou, E. Tsotridou, E. Volakli et al. Evaluation of continuous flash glucose monitoring in a pediatric ICU setting. J. Clin. Monit. Comput. 34(4), 843–852 (2020)
M.C. Perez-Guzman, E. Duggan, S. Gibanica et al. Continuous glucose monitoring in the operating room and cardiac intensive care unit. Diabetes Care 44(3), e50–e52 (2021)
Y. Zhang, X. Liu, J. Zhang et al. Evaluation for the feasibility and accuracy of Freestyle Libre Flash Glucose Monitoring System used by COVID-19 patients in intensive care unit. J. Diabetes 13(7), 603–605 (2021)
D.C. Klonoff, J.L. Parkes, B.P. Kovatchev et al. Investigation of the accuracy of 18 marketed blood glucose monitors. Diabetes Care 41(8), 1681–1688 (2018)
M.J. Rice, J.L. Smith, D.B. Coursin, Glucose measurement in the ICU: regulatory intersects reality. Crit. Care Med. 45(4), 741–743 (2017)
V. Tyndall, R.H. Stimson, N.N. Zammitt et al. Marked improvement in HbA following commencement of flash glucose monitoring in people with type 1 diabetes. Diabetologia 62(8), 1349–1356 (2019)
M. Fokkert, P. van Dijk, M. Edens et al. Improved well-being and decreased disease burden after 1-year use of flash glucose monitoring (FLARE-NL4). BMJ Open Diabetes Res. Care 7(1), e000809 (2019)
S. Charleer, C. De Block, Van, L. Huffel et al. Quality of life and glucose control after 1 year of nationwide reimbursement of intermittently scanned continuous glucose monitoring in adults living with type 1 diabetes (FUTURE): a prospective observational real-world cohort study. Diabetes Care 43(2), 389–397 (2020)
J. Bolinder, R. Antuna, P. Geelhoed-Duijvestijn et al. Novel glucose-sensing technology and hypoglycaemia in type 1 diabetes: a multicentre, non-masked, randomised controlled trial. Lancet 388(10057), 2254–2263 (2016)
J. Wernerman, T. Desaive, S. Finfer et al. Continuous glucose control in the ICU: report of a 2013 round table meeting. Crit. Care 18(3), 226 (2014)
Acknowledgements
The authors thank the study volunteers and the study staff for their participation. We also thank the teams at each clinical site in the ICUs of the Jinshan Branch of Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine and the Lingang Campus of Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University School of Medicine.
Funding
This work was funded by the National Key R&D Program of China (2018YFC2000802), the Shanghai Municipal Education Commission—Gaofeng Clinical Medicine Grant Support (20161430), and Shanghai Commission of Science and Technology (20Y11901000).
Author information
Authors and Affiliations
Contributions
Y.Li, J.Z., and Y.Lu designed the study. W.H., S.L., Yu.W., K.F., X.H., Y.Z., and L.H. collected the data. W.H. and S.L. cleaned the data. W.H., S.L., J.L., and Y.S. performed the statistical analysis. W.H., S.L., J.L., and Ya.W. wrote the draft of the manuscript. J.Z., Y.Li, and Y.Lu rescanned and edited the manuscript. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Ethics approval
The study and the analysis plan were approved by the Research Ethics Committees of Shanghai Sixth People’s Hospital Affiliated with Shanghai Jiao Tong University School of Medicine.
Informed consent
We have obtained informed consent from all participants.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Huang, W., Li, S., Lu, J. et al. Accuracy of the intermittently scanned continuous glucose monitoring system in critically ill patients: a prospective, multicenter, observational study. Endocrine 78, 470–475 (2022). https://doi.org/10.1007/s12020-022-03216-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12020-022-03216-3