Top

Published in:

01-11-2007 | Short Communication

Intraclass correlation metrics for the accuracy of algorithmic definitions in a computerized decision support system for supportive cancer care

Authors: Matti Aapro, Ivo Abraham, Karen MacDonald, Pierre Soubeyran, Jan Foubert, Carsten Bokemeyer, Michael Muenzberg, Joanna Van Erps, Matthew Turner

Published in: Supportive Care in Cancer | Issue 11/2007

Abstract

As part of the development of a computerized clinical decision support system for anemia management in cancer patients, we applied psychometric principles and techniques to assess the accuracy of the algorithmic operationalizations of a set of evidence-based practice guidelines. In an iterative rating process, five medical and nursing experts rated 27 algorithmic sets derived from 18 guidelines, the objective being an intraclass coefficient (ICC) exceeding 0.90. The first round of review yielded an ICC of 1.00 for 22 sets. After revision and resubmission to the expert panel, an ICC of 1.00 was obtained for the additional five sets. The evolving decision support system is based on algorithms that accurately specify evidence-based guidelines for anemia management in cancer patients.

Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk I et al (2003) Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 10:523–530PubMedCrossRef

Bokemeyer C, Aapro MS, Courdi A, Foubert J, Link H, Ősterborg A et al (2004) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer. Eur J Cancer 40:2201–2216PubMedCrossRef

Bokemeyer C, Aapro MS, Courdi A, Foubert J, Link H, Ősterborg A et al (2006) EORTC guidelines for the use of erythropoietic proteins in anaemic patients with cancer: 2006 update. Eur J Cancer 43(2):258–270PubMedCrossRef

Cella D (1998) Factors influencing quality of life in cancer patients: anemia and fatigue. Sem Oncol 25(3 Suppl 7):43–46

Eddy DM (2005) Evidence-based medicine: a unified approach. Health Aff 24:9–17CrossRef

Kawamoto K, Houlihan CA, Balas EA, Lobach DF (2005) Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Br Med J 330:775–782CrossRef

Ludwig H, Van Belle S, Barrett-Lee P, Birgegard G, Bokemeyer C, Gascon P et al (2004) The European Cancer Anaemia Study (ECAS): a large, multinational, prospective study defining the prevalence, incidence, and treatment of anaemia in cancer patients. Eur J Cancer 40:2293–2306PubMedCrossRef

Nunnally JC, Bernstein I (1994) Psychometric theory, 3rd ed. McGraw-Hill, New York

Park HM, Jung HW (2003) Evaluating interrater agreement with intraclass correlation coefficient in SPICE-based software process assessment. In: IEEE proceedings of the third international conference on quality software. IEEE, Washington, DC

10.

Rizzo JD, Lichtin AE, Woolf SH, Seidenfeld J, Bennett CL, Cella D et al (2002) Use of epoetin in patients with cancer: evidence-based clinical practice guidelines of the American Society of Clinical Oncology and the American Society of Hematology. J Clin Oncol 20:4083–4107PubMedCrossRef

11.

Shiffman RN, Brandt CA, Liaw Y, Corb GJ (1999) A design model for computer-based guideline implementation based on information management services. J Am Med Inform Assoc 6:99–103PubMed

12.

Sim I, Gorman P, Greenes RA, Haynes RB, Kaplan B, Lehmann H et al (2001) Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc 8:527–534PubMed

13.

Timmermans S, Mauck A (2005) The promises and pitfalls of evidence-based medicine. Health Aff 24:18–28CrossRef

Title: Intraclass correlation metrics for the accuracy of algorithmic definitions in a computerized decision support system for supportive cancer care
Authors: Matti Aapro
Ivo Abraham
Karen MacDonald
Pierre Soubeyran
Jan Foubert
Carsten Bokemeyer
Michael Muenzberg
Joanna Van Erps
Matthew Turner
Publication date: 01-11-2007
Publisher: Springer-Verlag
Published in: Supportive Care in Cancer / Issue 11/2007
Print ISSN: 0941-4355
Electronic ISSN: 1433-7339
DOI: https://doi.org/10.1007/s00520-007-0246-7

Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Watch now

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras

Prof. Fabrice Barlesi

Developed by: Springer Medicine

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 11/2007

Measurement of oral mucositis in children: a review of the literature

Association of complementary methods with quality of life and life satisfaction in patients with gynecologic and breast malignancies

Effectiveness of bisphosphonates on bone pain and quality of life in breast cancer patients with metastatic bone disease: a review

Evaluation of the memorial delirium assessment scale (MDAS) for the screening of delirium by means of simulated cases by palliative care health professionals

A phase II trial of olanzapine, dexamethasone, and palonosetron for the prevention of chemotherapy-induced nausea and vomiting: a Hoosier oncology group study

Adjunct dipyrone in association with oral morphine for cancer-related pain: the sooner the better

Keynote webinar | Spotlight on antibody–drug conjugates in cancer