Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research Article

Meta-analytic estimation of measurement variability and assessment of its impact on decision-making: the case of perioperative haemoglobin concentration monitoring

Authors: Emmanuel Charpentier, Vincent Looten, Björn Fahlgren, Alexandre Barna, Loïc Guillevin

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

As a part of a larger Health Technology Assessment (HTA), the measurement error of a device used to monitor the hemoglobin concentration of a patient undergoing surgery, as well as its decision consequences, were to be estimated from published data.

Methods

A Bayesian hierarchical model of measurement error, allowing the meta-analytic estimation of both central and dispersion parameters (under the assumption of normality of measurement errors) is proposed and applied to published data; the resulting potential decision errors are deduced from this estimation. The same method is used to assess the impact of an initial calibration.

Results

The posterior distributions are summarized as mean ± sd (credible interval). The fitted model exhibits a modest mean expected error (0.24 ± 0.73 (−1.23 1.59) g/dL) and a large variability (mean absolute expected error 1.18 ± 0.92 (0.05 3.36) g/dL). The initial calibration modifies the bias (−0.20 ± 0.87 (−1.99 1.49) g/dL), but the variability remains almost as large (mean absolute expected error 1.05 ± 0.87 (0.04 3.21) g/dL). This entails a potential decision error (“false positive” or “false negative”) for about one patient out of seven.

Conclusions

The proposed hierarchical model allows the estimation of the variability from published aggregates, and allows the modeling of the consequences of this variability in terms of decision errors. For the device under assessment, these potential decision errors are clinically problematic.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kim SH, Lilot M, Murphy LS-L, Sidhu KS, Yu Z, Rinehart J, et al. Accuracy of continuous noninvasive hemoglobin monitoring: a systematic review and meta-analysis. Anesth Analg. 2014; 119(2):332–46. doi:ANE.0000000000000272.CrossRefPubMed Kim SH, Lilot M, Murphy LS-L, Sidhu KS, Yu Z, Rinehart J, et al. Accuracy of continuous noninvasive hemoglobin monitoring: a systematic review and meta-analysis. Anesth Analg. 2014; 119(2):332–46. doi:ANE.​0000000000000272​.CrossRefPubMed
4.
6.
7.
go back to reference Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Anal. 2006; 1(3):515–33.CrossRef Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Anal. 2006; 1(3):515–33.CrossRef
8.
go back to reference Gelman A, Jakulin A, Pittau MG, Su YS. A weakly informative default prior distribution for logistic and other regression models. Ann Appl Stat. 2008; 2(4):1360–83. doi:10.1214/08-AOAS191 Accessed 2015-04-13.CrossRef Gelman A, Jakulin A, Pittau MG, Su YS. A weakly informative default prior distribution for logistic and other regression models. Ann Appl Stat. 2008; 2(4):1360–83. doi:10.​1214/​08-AOAS191 Accessed 2015-04-13.CrossRef
9.
go back to reference Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. Bayesian Data Analysis, Third Edition, 3rd. Boca Raton: Chapman and Hall/CRC; 2013. Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. Bayesian Data Analysis, Third Edition, 3rd. Boca Raton: Chapman and Hall/CRC; 2013.
10.
15.
go back to reference Lamhaut L, Apriotesei R, Combes X, Lejay M, Carli P, Vivien B. Comparison of the accuracy of noninvasive hemoglobin monitoring by spectrophotometry (SpHb) and HemoCue Ⓡ with automated laboratory hemoglobin measurement. Anesthesiology. 2011; 115(3):548–54. doi:10.1097/ALN.0b013e3182270c22.CrossRefPubMed Lamhaut L, Apriotesei R, Combes X, Lejay M, Carli P, Vivien B. Comparison of the accuracy of noninvasive hemoglobin monitoring by spectrophotometry (SpHb) and HemoCue with automated laboratory hemoglobin measurement. Anesthesiology. 2011; 115(3):548–54. doi:10.​1097/​ALN.​0b013e3182270c22​.CrossRefPubMed
21.
go back to reference Vos JJ, Kalmar AF, Struys MMRF, Porte RJ, Wietasch JKG, Scheeren TWL, et al. Accuracy of non-invasive measurement of haemoglobin concentration by pulse co-oximetry during steady-state and dynamic conditions in liver surgery. Br J Anaesth. 2012; 109(4):522–8. doi:10.1093/bja/aes234.CrossRefPubMed Vos JJ, Kalmar AF, Struys MMRF, Porte RJ, Wietasch JKG, Scheeren TWL, et al. Accuracy of non-invasive measurement of haemoglobin concentration by pulse co-oximetry during steady-state and dynamic conditions in liver surgery. Br J Anaesth. 2012; 109(4):522–8. doi:10.​1093/​bja/​aes234.CrossRefPubMed
22.
go back to reference Dewhirst E, Naguib A, Winch P, Rice J, Galantowicz M, McConnell P, et al. Accuracy of noninvasive and continuous hemoglobin measurement by pulse co-oximetry during preoperative phlebotomy. J Intensive Care Med. 2013; 29(4):238–42. doi:10.1177/0885066613485355.CrossRefPubMed Dewhirst E, Naguib A, Winch P, Rice J, Galantowicz M, McConnell P, et al. Accuracy of noninvasive and continuous hemoglobin measurement by pulse co-oximetry during preoperative phlebotomy. J Intensive Care Med. 2013; 29(4):238–42. doi:10.​1177/​0885066613485355​.CrossRefPubMed
24.
go back to reference Isosu T, Obara S, Hosono A, Ohashi S, Nakano Y, Imaizumi T, et al. Validation of continuous and noninvasive hemoglobin monitoring by pulse CO-oximetry in Japanese surgical patients. J Clin Monit Comput. 2013; 27(1):55–60. doi:10.1007/s10877-012-9397-2.CrossRefPubMed Isosu T, Obara S, Hosono A, Ohashi S, Nakano Y, Imaizumi T, et al. Validation of continuous and noninvasive hemoglobin monitoring by pulse CO-oximetry in Japanese surgical patients. J Clin Monit Comput. 2013; 27(1):55–60. doi:10.​1007/​s10877-012-9397-2.CrossRefPubMed
26.
go back to reference Kim SH, Choi JM, Kim HJ, Choi SS, Choi IC. Continuous noninvasive hemoglobin measurement is useful in patients undergoing double-jaw surgery. J Oral Maxillofac Surg: Official J Am Assoc Oral Maxillofacial Surgeons. 2014; 72(9):1813–9. doi:10.1016/j.joms.2014.03.011.CrossRef Kim SH, Choi JM, Kim HJ, Choi SS, Choi IC. Continuous noninvasive hemoglobin measurement is useful in patients undergoing double-jaw surgery. J Oral Maxillofac Surg: Official J Am Assoc Oral Maxillofacial Surgeons. 2014; 72(9):1813–9. doi:10.​1016/​j.​joms.​2014.​03.​011.CrossRef
28.
go back to reference Patino M, Schultz L, Hossain M, Moeller J, Mahmoud M, Gunter J, et al. Trending and accuracy of noninvasive hemoglobin monitoring in pediatric perioperative patients. Anesth Analg. 2014; 119(4):920–5. doi:ANE.0000000000000369.CrossRefPubMed Patino M, Schultz L, Hossain M, Moeller J, Mahmoud M, Gunter J, et al. Trending and accuracy of noninvasive hemoglobin monitoring in pediatric perioperative patients. Anesth Analg. 2014; 119(4):920–5. doi:ANE.​0000000000000369​.CrossRefPubMed
30.
31.
go back to reference Awada WN, Mohmoued MF, Radwan TM, Hussien GZ, Elkady HW. Continuous and noninvasive hemoglobin monitoring reduces red blood cell transfusion during neurosurgery: a prospective cohort study. J Clin Monit Comput. 2015. doi:10.1007/s10877-015-9660-4. Awada WN, Mohmoued MF, Radwan TM, Hussien GZ, Elkady HW. Continuous and noninvasive hemoglobin monitoring reduces red blood cell transfusion during neurosurgery: a prospective cohort study. J Clin Monit Comput. 2015. doi:10.​1007/​s10877-015-9660-4.
32.
go back to reference Frasca D, Mounios H, Giraud B, Boisson M, Debaene B, Mimoz O. Continuous monitoring of haemoglobin concentration after in-vivo adjustment in patients undergoing surgery with blood loss. Anaesthesia. 2015. doi:10.1111/anae.13028. Frasca D, Mounios H, Giraud B, Boisson M, Debaene B, Mimoz O. Continuous monitoring of haemoglobin concentration after in-vivo adjustment in patients undergoing surgery with blood loss. Anaesthesia. 2015. doi:10.​1111/​anae.​13028.
33.
go back to reference Saito J, Kitayama M, Oishi M, Kudo T, Sawada M, Hashimoto H, et al. The accuracy of non-invasively continuous total hemoglobin measurement by pulse CO-Oximetry undergoing acute normovolemic hemodilution and reinfusion of autologous blood. J Anesthesia. 2015; 29(1):29–34. doi:10.1007/s00540-014-1863-1.CrossRef Saito J, Kitayama M, Oishi M, Kudo T, Sawada M, Hashimoto H, et al. The accuracy of non-invasively continuous total hemoglobin measurement by pulse CO-Oximetry undergoing acute normovolemic hemodilution and reinfusion of autologous blood. J Anesthesia. 2015; 29(1):29–34. doi:10.​1007/​s00540-014-1863-1.CrossRef
34.
go back to reference Nakagawa S, Poulin R, Mengersen K, Reinhold K, Engqvist L, Lagisz M, Senior AM. Meta-analysis of variation: ecological and evolutionary applications and beyond. Methods Ecol Evol. 2015; 6(2):143–52. doi:10.1111/2041-210X.12309.CrossRef Nakagawa S, Poulin R, Mengersen K, Reinhold K, Engqvist L, Lagisz M, Senior AM. Meta-analysis of variation: ecological and evolutionary applications and beyond. Methods Ecol Evol. 2015; 6(2):143–52. doi:10.​1111/​2041-210X.​12309.CrossRef
Metadata
Title
Meta-analytic estimation of measurement variability and assessment of its impact on decision-making: the case of perioperative haemoglobin concentration monitoring
Authors
Emmanuel Charpentier
Vincent Looten
Björn Fahlgren
Alexandre Barna
Loïc Guillevin
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0107-5

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue