Skip to main content
Top
Published in: Current Anesthesiology Reports 4/2017

Open Access 01-12-2017 | Advances in Monitoring for Anesthesia (LAH Critchley, Section Editor)

Cardiac Output Monitoring: Validation Studies–how Results Should be Presented

Authors: Peter M. Odor, Sohail Bampoe, Maurizio Cecconi

Published in: Current Anesthesiology Reports | Issue 4/2017

Login to get access

Abstract

Purpose of Review

Cardiac output monitors can be assessed by a variety of techniques, but a common principle is quantifying agreement between a reference standard and new monitor. The current standard analysis technique is a Bland-Altman plot. The Bland-Altman plot evaluates bias between mean differences of cardiac output, from which an agreement interval is derived. These limits are, however, statistical limits of agreement and the clinical acceptability will depend upon context and application. This article provides suggestions for understanding and presenting the results of cardiac output validation, using standard metrology alongside proposals for criteria used to accept new techniques.

Recent Findings

Confusion about the appropriate way to report “precision” in method comparison studies stem from a lack of clarity on how single or repeated measurements should be interpreted. During serial measurements of cardiac output the true value changes, thus measurement should be considered as serial rather than repeated. Method agreement based upon precision achieved by cardiac output monitors needs to consider each method’s general variability around true values obtained and this data should be generated and presented as part of each study design.

Summary

Studies should report serial measurements from two techniques for cardiac output monitoring. Results of similar techniques from other studies may not always be transferred and compared. Bias and intervals of agreement should be presented as Bland-Altman plots with dynamic cardiac output trends in polar plots. Percentage error should be calculated to allow appropriate comparison of techniques for study populations with different expected cardiac output values.
Literature
2.
go back to reference Squara P, Denjean D, Estagnasie P, Brusset A, Dib JC, Dubois C. Noninvasive cardiac output monitoring (NICOM): a clinical validation. Intensive Care Med. 2007;33(7):1191–4.CrossRefPubMed Squara P, Denjean D, Estagnasie P, Brusset A, Dib JC, Dubois C. Noninvasive cardiac output monitoring (NICOM): a clinical validation. Intensive Care Med. 2007;33(7):1191–4.CrossRefPubMed
3.
go back to reference Scolletta S, Franchi F, Romagnoli S, Carlà R, Donati A, Fabbri LP, et al. Pulse wave analysis cardiac output validation (PulseCOval) group. Comparison between Doppler-echocardiography and uncalibrated pulse contour method for cardiac output measurement: a multicenter observational study. Crit Care Med. 2016;44(7):1370–9. https://doi.org/10.1097/CCM.0000000000001663. CrossRefPubMed Scolletta S, Franchi F, Romagnoli S, Carlà R, Donati A, Fabbri LP, et al. Pulse wave analysis cardiac output validation (PulseCOval) group. Comparison between Doppler-echocardiography and uncalibrated pulse contour method for cardiac output measurement: a multicenter observational study. Crit Care Med. 2016;44(7):1370–9. https://​doi.​org/​10.​1097/​CCM.​0000000000001663​.​ CrossRefPubMed
7.
go back to reference • Saugel B, Cecconi M, Wagner JY, Reuter DA. Noninvasive continuous cardiac output monitoring in perioperative and intensive care medicine. Br J Anaesth. 2015;114(4):562–75. https://doi.org/10.1093/bja/aeu447. General overview of the principles and validation data for multiple noninvasive cardiac output monitoring technologies. CrossRefPubMed • Saugel B, Cecconi M, Wagner JY, Reuter DA. Noninvasive continuous cardiac output monitoring in perioperative and intensive care medicine. Br J Anaesth. 2015;114(4):562–75. https://​doi.​org/​10.​1093/​bja/​aeu447. General overview of the principles and validation data for multiple noninvasive cardiac output monitoring technologies. CrossRefPubMed
9.
go back to reference de Wilde RB, Schreuder JJ, van den Berg PC, Jansen JR. An evaluation of cardiac output by five arterial pulse contour techniques during cardiac surgery. Anaesthesia. 2007;62:760–8.CrossRefPubMed de Wilde RB, Schreuder JJ, van den Berg PC, Jansen JR. An evaluation of cardiac output by five arterial pulse contour techniques during cardiac surgery. Anaesthesia. 2007;62:760–8.CrossRefPubMed
10.
go back to reference Sakka SG, Reinhart K, Meier-Hellmann A. Comparison of pulmonary artery and arterial thermodilution cardiac output in critically ill patients. Intensive Care Med. 1999;25(8):843–6.CrossRefPubMed Sakka SG, Reinhart K, Meier-Hellmann A. Comparison of pulmonary artery and arterial thermodilution cardiac output in critically ill patients. Intensive Care Med. 1999;25(8):843–6.CrossRefPubMed
11.
go back to reference Ganz W, Donoso R, Marcus HS, Forrester JS, Swan HJ. A new technique for measurement of cardiac output by thermodilution in man. Am J Cardiol. 1971;27(4):392–6.CrossRefPubMed Ganz W, Donoso R, Marcus HS, Forrester JS, Swan HJ. A new technique for measurement of cardiac output by thermodilution in man. Am J Cardiol. 1971;27(4):392–6.CrossRefPubMed
13.
go back to reference Fick A (1870) Ueber die Messung des Blutquantums in den Herzventrikeln. Würzburg. Fick A (1870) Ueber die Messung des Blutquantums in den Herzventrikeln. Würzburg.
15.
go back to reference • Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10. Original report of the Bland-Altman plot. CrossRefPubMed • Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10. Original report of the Bland-Altman plot. CrossRefPubMed
16.
go back to reference Bland JM, Altman DG. Comparing methods of measurement: why plotting difference against standard method is misleading. Lancet. 1995;346:1085–7.CrossRefPubMed Bland JM, Altman DG. Comparing methods of measurement: why plotting difference against standard method is misleading. Lancet. 1995;346:1085–7.CrossRefPubMed
17.
go back to reference Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.CrossRefPubMed Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.CrossRefPubMed
20.
go back to reference Myles PS, Cui JI. Using the Bland-Altman method to measure agreement with repeated measures. Br J Anaesth. 2007;99(3):309–11.CrossRefPubMed Myles PS, Cui JI. Using the Bland-Altman method to measure agreement with repeated measures. Br J Anaesth. 2007;99(3):309–11.CrossRefPubMed
21.
go back to reference Stöckl D, Rodriguez Cabaleiro D, Van Uytfanghe K, Thienpont LM. Interpreting method comparison studies by use of the Bland-Altman plot: reflecting the importance of sample size by incorporating confidence limits and predefined error limits in the graphic. Clin Chem. 2004;50(11):2216–8.CrossRefPubMed Stöckl D, Rodriguez Cabaleiro D, Van Uytfanghe K, Thienpont LM. Interpreting method comparison studies by use of the Bland-Altman plot: reflecting the importance of sample size by incorporating confidence limits and predefined error limits in the graphic. Clin Chem. 2004;50(11):2216–8.CrossRefPubMed
22.
go back to reference •• Abu-Arafeh A, Jordan H, Drummond G. Reporting of method comparison studies: a review of advice, an assessment of current practice, and specific suggestions for future reports. Br J Anaesth. 2016;117(5):569–75. Most recent systematic review of Bland-Altman studies to produce a list of recommended minimum reporting requirements. CrossRefPubMed •• Abu-Arafeh A, Jordan H, Drummond G. Reporting of method comparison studies: a review of advice, an assessment of current practice, and specific suggestions for future reports. Br J Anaesth. 2016;117(5):569–75. Most recent systematic review of Bland-Altman studies to produce a list of recommended minimum reporting requirements. CrossRefPubMed
23.
go back to reference •• Critchley LA, Critchley JA. A meta-analysis of studies using bias and precision statistics to compare cardiac output measurement techniques. J Clin Monit Comput. 1999;15:85–91. Meta-analysis of 25 cardiac output validation studies and critical review to produce recommendations for presentation of data. CrossRefPubMed •• Critchley LA, Critchley JA. A meta-analysis of studies using bias and precision statistics to compare cardiac output measurement techniques. J Clin Monit Comput. 1999;15:85–91. Meta-analysis of 25 cardiac output validation studies and critical review to produce recommendations for presentation of data. CrossRefPubMed
24.
go back to reference •• Cecconi M, Rhodes A, Poloniecki J, Della Rocca G, Grounds RM. Bench-to-bedside review: the importance of the precision of the reference technique in method comparison studies--with specific reference to the measurement of cardiac output. Crit Care. 2009;13(1):201. https://doi.org/10.1186/cc7129. Explanation of how poor precision of method of the reference device may lead to the rejection of a new, more precise device. CrossRefPubMedPubMedCentral •• Cecconi M, Rhodes A, Poloniecki J, Della Rocca G, Grounds RM. Bench-to-bedside review: the importance of the precision of the reference technique in method comparison studies--with specific reference to the measurement of cardiac output. Crit Care. 2009;13(1):201. https://​doi.​org/​10.​1186/​cc7129. Explanation of how poor precision of method of the reference device may lead to the rejection of a new, more precise device. CrossRefPubMedPubMedCentral
25.
go back to reference Le Manach Y, Collins GS. Disagreement between cardiac output measurement devices: which device is the gold standard? Br J Anaesth. 2016;116(4):453–5.CrossRef Le Manach Y, Collins GS. Disagreement between cardiac output measurement devices: which device is the gold standard? Br J Anaesth. 2016;116(4):453–5.CrossRef
26.
go back to reference •• Critchley LA, Yang XX, Lee A. Assessment of trending ability of cardiac output monitors by polar plot methodology. J Cardiothorac Vasc Anesth. 2011;25(3):536–46. https://doi.org/10.1053/j.jvca.2011.01.003. First demonstration of polar plots to graphically represent cardiac output trending comparisons and overcome the deficiencies of concordance analysis. CrossRefPubMed •• Critchley LA, Yang XX, Lee A. Assessment of trending ability of cardiac output monitors by polar plot methodology. J Cardiothorac Vasc Anesth. 2011;25(3):536–46. https://​doi.​org/​10.​1053/​j.​jvca.​2011.​01.​003. First demonstration of polar plots to graphically represent cardiac output trending comparisons and overcome the deficiencies of concordance analysis. CrossRefPubMed
Metadata
Title
Cardiac Output Monitoring: Validation Studies–how Results Should be Presented
Authors
Peter M. Odor
Sohail Bampoe
Maurizio Cecconi
Publication date
01-12-2017
Publisher
Springer US
Published in
Current Anesthesiology Reports / Issue 4/2017
Electronic ISSN: 2167-6275
DOI
https://doi.org/10.1007/s40140-017-0239-0

Other articles of this Issue 4/2017

Current Anesthesiology Reports 4/2017 Go to the issue

Geriatric Anesthesia (S Akhtar, Section Editor)

Postoperative Cognitive Dysfunction

Geriatric Anesthesia (S Akhtar, Section Editor)

Regional Versus General Anesthesia in the Elderly: New Insights

Patient Safety in Anesthesia (A Barbeito, Section Editor)

Transitions of Care in the Perioperative Period

Patient Safety in Anesthesia (A Barbeito, Section Editor)

Improvement Science in Anaesthesia

Geriatric Anesthesia (S Akhtar, Section Editor)

Fluid Management in the Elderly