Skip to main content
Top
Published in: Diabetes Therapy 2/2024

Open Access 15-12-2023 | Original Research

Evaluation of System Accuracy, Precision, Hematocrit Influence, and User Performance of Two Blood Glucose Monitoring Systems Based on ISO 15197:2013/EN ISO 15197:2015

Authors: Stefan Pleus, Nina Jendrike, Annette Baumstark, Jochen Mende, Stephanie Wehrstedt, Cornelia Haug, Guido Freckmann

Published in: Diabetes Therapy | Issue 2/2024

Login to get access

Abstract

Introduction

Sufficiently high analytical quality of blood glucose monitoring systems (BGMS) is a prerequisite for efficient diabetes therapy. In this study we assessed system accuracy, measurement repeatability, intermediate measurement precision, user performance, and the influence of hematocrit on two CE-marked blood glucose monitoring systems. For one BGMS, measurement accuracy using venous samples was additionally investigated.

Methods

Study procedures were based on the International Organization of Standardization (ISO) 15197:2013/EN ISO 15197:2015 (“ISO 15197”). User performance included data from 100 subjects who used one test strip lot, whereas for all other analyses three different reagent system lots were used. For system accuracy assessment, 100 capillary samples were measured in duplicate with each of three reagent system lots per system, resulting in 600 results per system.

Results

CareSens S Fit and CareSens H Beat both fulfilled the ISO 15197 accuracy criteria with 97.5–100% of each test strip lot’s results falling within ± 15 mg/dL or ± 15% of the results of the comparison method and 100% of results in consensus error grid (CEG) zone A for all three lots. User performance evaluation revealed sufficient accuracy in the hands of lay users although some handling errors were documented by study staff. Assessment of measurement repeatability and intermediate measurement precision is given by standard deviation (SD) (glucose levels < 100 mg/dL) and by coefficient of variation (CV) (glucose concentrations ≥ 100 mg/dL). SD was ≤ 4.1 mg/dL and CV ≤ 4.2% for measurement repeatability and SD was ≤ 2.2 mg/dL and CV ≤ 2.6% for intermediate measurement precision. In case of hematocrit influence, both BGMS complied with all three tested lots with the defined criteria.

Conclusion

Both BGMS analyzed in this study fulfilled the required accuracy criteria of ISO 15197. They showed high precision, good performance in the hands of lay users, and the influence of hematocrit was acceptable in the labeled range.
Appendix
Available only for authorised users
Literature
1.
go back to reference International Organization for Standardization. In vitro diagnostic test systems - Requirements for blood-glucose monitoring systems for self-testing in managing diabetes mellitus (ISO 15197:2013). 2015(EN ISO 15197:2015). International Organization for Standardization. In vitro diagnostic test systems - Requirements for blood-glucose monitoring systems for self-testing in managing diabetes mellitus (ISO 15197:2013). 2015(EN ISO 15197:2015).
2.
go back to reference Jendrike N, Baumstark A, Pleus S, et al. Evaluation of four blood glucose monitoring systems for self-testing with built-in insulin dose advisor based on ISO 15197:2013: system accuracy and hematocrit influence. Diabetes Technol Ther. 2018;20(4):303–13.CrossRefPubMed Jendrike N, Baumstark A, Pleus S, et al. Evaluation of four blood glucose monitoring systems for self-testing with built-in insulin dose advisor based on ISO 15197:2013: system accuracy and hematocrit influence. Diabetes Technol Ther. 2018;20(4):303–13.CrossRefPubMed
3.
go back to reference Bright D, Dunseath G, Berti F, Scuffi C, Valgimigli F, Luzio S. Accuracy evaluation of a blood glucose monitoring system according to EN ISO 15197:2015. J Diabetes Sci Technol. 2017;11(4):849–50.CrossRefPubMedPubMedCentral Bright D, Dunseath G, Berti F, Scuffi C, Valgimigli F, Luzio S. Accuracy evaluation of a blood glucose monitoring system according to EN ISO 15197:2015. J Diabetes Sci Technol. 2017;11(4):849–50.CrossRefPubMedPubMedCentral
4.
go back to reference Pleus S, Baumstark A, Jendrike N, et al. System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015. BMJ Open Diabet Res Care. 2020;8(1):e001067.CrossRef Pleus S, Baumstark A, Jendrike N, et al. System accuracy evaluation of 18 CE-marked current-generation blood glucose monitoring systems based on EN ISO 15197:2015. BMJ Open Diabet Res Care. 2020;8(1):e001067.CrossRef
6.
go back to reference Parkes JL, Slatin SL, Pardo S, Ginsberg BH. A new consensus error grid to evaluate the clinical significance of inaccuracies in the measurement of blood glucose. Diabetes Care. 2000;23(8):1143–8.CrossRefPubMed Parkes JL, Slatin SL, Pardo S, Ginsberg BH. A new consensus error grid to evaluate the clinical significance of inaccuracies in the measurement of blood glucose. Diabetes Care. 2000;23(8):1143–8.CrossRefPubMed
7.
go back to reference Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet. 1986;327(8476):307–10.CrossRef Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet. 1986;327(8476):307–10.CrossRef
8.
go back to reference Katz LB, Macleod K, Grady M, Cameron H, Pfutzner A, Setford S. A comprehensive evaluation of strip performance in multiple blood glucose monitoring systems. Expert Rev Med Devices. 2015;12(3):263–71.CrossRefPubMed Katz LB, Macleod K, Grady M, Cameron H, Pfutzner A, Setford S. A comprehensive evaluation of strip performance in multiple blood glucose monitoring systems. Expert Rev Med Devices. 2015;12(3):263–71.CrossRefPubMed
9.
go back to reference Ji LN, Guo LX, Liu LB. Accuracy and precision assessment of a new blood glucose monitoring system. Clin Chem Lab Med. 2016;54(1):181–8.CrossRefPubMed Ji LN, Guo LX, Liu LB. Accuracy and precision assessment of a new blood glucose monitoring system. Clin Chem Lab Med. 2016;54(1):181–8.CrossRefPubMed
10.
go back to reference Park HI, Lee SS, Son JW, et al. Analytical performance evaluation of Infopia element auto-coding blood glucose monitoring system for self-monitoring of blood glucose. J Clin Lab Anal. 2016;30(6):849–58.CrossRefPubMedPubMedCentral Park HI, Lee SS, Son JW, et al. Analytical performance evaluation of Infopia element auto-coding blood glucose monitoring system for self-monitoring of blood glucose. J Clin Lab Anal. 2016;30(6):849–58.CrossRefPubMedPubMedCentral
11.
go back to reference Pleus S, Jendrike N, Baumstark A, Mende J, Haug C, Freckmann G. Evaluation of analytical performance of three blood glucose monitoring systems: system accuracy, measurement repeatability, and intermediate measurement precision. J Diabet Sci Technol. 2019;13(1):111–7.CrossRef Pleus S, Jendrike N, Baumstark A, Mende J, Haug C, Freckmann G. Evaluation of analytical performance of three blood glucose monitoring systems: system accuracy, measurement repeatability, and intermediate measurement precision. J Diabet Sci Technol. 2019;13(1):111–7.CrossRef
12.
go back to reference Solvik UO, Risa M, Jacobsen CE, Monsen G, Sandberg S. Performance of 10 systems for self-monitoring of blood glucose by trained healthcare professionals and in the hands of the users. Clin Chem. 2015;61(5):772–4.CrossRefPubMed Solvik UO, Risa M, Jacobsen CE, Monsen G, Sandberg S. Performance of 10 systems for self-monitoring of blood glucose by trained healthcare professionals and in the hands of the users. Clin Chem. 2015;61(5):772–4.CrossRefPubMed
13.
go back to reference Bailey TS, Wallace JF, Pardo S, et al. Accuracy and user performance evaluation of a new, wireless-enabled blood glucose monitoring system that links to a smart mobile device. J Diabet Sci Technol. 2017;11(4):736–43.CrossRef Bailey TS, Wallace JF, Pardo S, et al. Accuracy and user performance evaluation of a new, wireless-enabled blood glucose monitoring system that links to a smart mobile device. J Diabet Sci Technol. 2017;11(4):736–43.CrossRef
14.
go back to reference Jendrike N, Baumstark A, Pleus S, et al. Accuracy of five systems for self-monitoring of blood glucose in the hands of adult lay-users and professionals applying ISO 15197:2013 accuracy criteria and potential insulin dosing errors. Curr Med Res Opin. 2019;35(2):301–11.CrossRefPubMed Jendrike N, Baumstark A, Pleus S, et al. Accuracy of five systems for self-monitoring of blood glucose in the hands of adult lay-users and professionals applying ISO 15197:2013 accuracy criteria and potential insulin dosing errors. Curr Med Res Opin. 2019;35(2):301–11.CrossRefPubMed
15.
go back to reference Baumstark A, Jendrike N, Liebing C, Haug C, Freckmann G. System accuracy and user performance evaluation of an improved system for self-monitoring of blood glucose. J Diabet Sci Technol. 2018;12(2):407–11.CrossRef Baumstark A, Jendrike N, Liebing C, Haug C, Freckmann G. System accuracy and user performance evaluation of an improved system for self-monitoring of blood glucose. J Diabet Sci Technol. 2018;12(2):407–11.CrossRef
16.
go back to reference Freckmann G, Jendrike N, Baumstark A, Pleus S, Liebing C, Haug C. User performance evaluation of four blood glucose monitoring systems applying ISO 15197:2013 accuracy criteria and calculation of insulin dosing errors. Diabetes Ther. 2018;9(2):683–97.CrossRefPubMedPubMedCentral Freckmann G, Jendrike N, Baumstark A, Pleus S, Liebing C, Haug C. User performance evaluation of four blood glucose monitoring systems applying ISO 15197:2013 accuracy criteria and calculation of insulin dosing errors. Diabetes Ther. 2018;9(2):683–97.CrossRefPubMedPubMedCentral
17.
go back to reference Christiansen M, Greene C, Pardo S, et al. A new, wireless-enabled blood glucose monitoring system that links to a smart mobile device: accuracy and user performance evaluation. J Diabet Sci Technol. 2017;11(3):567–73.CrossRef Christiansen M, Greene C, Pardo S, et al. A new, wireless-enabled blood glucose monitoring system that links to a smart mobile device: accuracy and user performance evaluation. J Diabet Sci Technol. 2017;11(3):567–73.CrossRef
18.
go back to reference Caswell M, Frank J, Viggiani MT, et al. Accuracy and user performance evaluation of a blood glucose monitoring system. Diabet Technol Ther. 2015;17(3):152–8.CrossRef Caswell M, Frank J, Viggiani MT, et al. Accuracy and user performance evaluation of a blood glucose monitoring system. Diabet Technol Ther. 2015;17(3):152–8.CrossRef
19.
go back to reference Yoo EH, Lee SY. Glucose biosensors: an overview of use in clinical practice. Sensors (Basel). 2010;10(5):4558–76.CrossRefPubMedADS Yoo EH, Lee SY. Glucose biosensors: an overview of use in clinical practice. Sensors (Basel). 2010;10(5):4558–76.CrossRefPubMedADS
20.
go back to reference Vanavanan S, Santanirand P, Chaichanajarernkul U, et al. Performance of a new interference-resistant glucose meter. Clin Biochem. 2010;43(1–2):186–92.CrossRefPubMed Vanavanan S, Santanirand P, Chaichanajarernkul U, et al. Performance of a new interference-resistant glucose meter. Clin Biochem. 2010;43(1–2):186–92.CrossRefPubMed
21.
go back to reference Teodorczyk M, Cardosi M, Setford S. Hematocrit compensation in electrochemical blood glucose monitoring systems. J Diabet Sci Technol. 2012;6(3):648–55.CrossRef Teodorczyk M, Cardosi M, Setford S. Hematocrit compensation in electrochemical blood glucose monitoring systems. J Diabet Sci Technol. 2012;6(3):648–55.CrossRef
22.
go back to reference Nerhus K, Rustad P, Sandberg S. Effect of ambient temperature on analytical performance of self-monitoring blood glucose systems. Diabet Technol Ther. 2011;13(9):883–92.CrossRef Nerhus K, Rustad P, Sandberg S. Effect of ambient temperature on analytical performance of self-monitoring blood glucose systems. Diabet Technol Ther. 2011;13(9):883–92.CrossRef
23.
go back to reference Deakin S, Steele D, Clarke S, et al. Cook and chill: effect of temperature on the performance of nonequilibrated blood glucose meters. J Diabet Sci Technol. 2015;9(6):1260–9.CrossRef Deakin S, Steele D, Clarke S, et al. Cook and chill: effect of temperature on the performance of nonequilibrated blood glucose meters. J Diabet Sci Technol. 2015;9(6):1260–9.CrossRef
24.
go back to reference Fortwaengler K, Campos-Nanez E, Parkin CG, Breton MD. The financial impact of inaccurate blood glucose monitoring systems. J Diabetes Sci Technol. 2018;12(2):318–24.CrossRefPubMed Fortwaengler K, Campos-Nanez E, Parkin CG, Breton MD. The financial impact of inaccurate blood glucose monitoring systems. J Diabetes Sci Technol. 2018;12(2):318–24.CrossRefPubMed
25.
go back to reference Klonoff DC, Parkes JL, Kovatchev BP, et al. Investigation of the accuracy of 18 marketed blood glucose monitors. Diabetes Care. 2018;41(8):1681–8.CrossRefPubMed Klonoff DC, Parkes JL, Kovatchev BP, et al. Investigation of the accuracy of 18 marketed blood glucose monitors. Diabetes Care. 2018;41(8):1681–8.CrossRefPubMed
Metadata
Title
Evaluation of System Accuracy, Precision, Hematocrit Influence, and User Performance of Two Blood Glucose Monitoring Systems Based on ISO 15197:2013/EN ISO 15197:2015
Authors
Stefan Pleus
Nina Jendrike
Annette Baumstark
Jochen Mende
Stephanie Wehrstedt
Cornelia Haug
Guido Freckmann
Publication date
15-12-2023
Publisher
Springer Healthcare
Published in
Diabetes Therapy / Issue 2/2024
Print ISSN: 1869-6953
Electronic ISSN: 1869-6961
DOI
https://doi.org/10.1007/s13300-023-01517-y

Other articles of this Issue 2/2024

Diabetes Therapy 2/2024 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine