Top

Health Services and Outcomes Research Methodology

Open Access 15-09-2023 | Pathology

Emergency department pathology order support tool (ED POST): a protocol using qualitative inquiry to inform design and development of a prototype to reduce low value care

Authors: Judith Thomas, Julie Li, Craig Scowen, Alex Eigenstetter, Andrew Georgiou

Published in: Health Services and Outcomes Research Methodology

Abstract

Laboratory tests have an important role in informing diagnosis and aiding in the determination of appropriate courses of management and/or treatment in the Emergency Department setting. Over-ordering of laboratory tests can lead to increased costs and/or unnecessary patient procedures, whilst under-ordering can lead to patient safety concerns and/or diagnostic error. Reducing over/under ordering through appropriate use of pathology has the potential to improve patient safety and/or reduce healthcare costs. As a dynamic electronic decision support tool, the Emergency Department Pathology Order Support Tool (ED POST) aims to facilitate effective ordering of pathology tests. This protocol details the methodological approach to be undertaken during the design and development of ED POST, commencing from the outset of the initial development of a prototype design. The research will undertake qualitative methods (interviews, focus group, and think-aloud observations) to develop business process models through collaboration with Emergency Department clinicians. The pre-development research will constitute stage 1 of the approach, with stage 2 focussed on evaluating the utility, usability and business process impact of the prototype to refine the prototype’s design. The collaborative and qualitative multi-method approach aims to elucidate an in-depth understanding of existing laboratory test ordering and decision-making processes in the Emergency Department, serving to inform the development of a relevant and practicable solution. Health researchers and digital health developers can draw on this approach to inform research planning activities for health information technology intervention design projects and can follow the developmental journey of ED POST as its outcomes are reported in the literature.

Beltrão, G., Paramonova, I., Sousa, S.: User interface design for AI-based clinical decision-support system: preliminary study, In: 2022 17th Iberian Conference on Information Systems and Technologies (CISTI).' 22–25 June 2022. (2022). https://ieeexplore.ieee.org/document/9820378/https://doi.org/10.23919/CISTI54924.2022.9820378

Birt, L., Scott, S., Cavers, D., Campbell, C., Walter, F.: Member checking: a tool to enhance trustworthiness or merely a nod to validation? Qual. Health Res. 26(13), 1802–1811 (2016). https://doi.org/10.1177/1049732316654870CrossRefPubMed

Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006). https://doi.org/10.1191/1478088706qp063oaCrossRef

Breth-Petersen, M., Bell, K., Pickles, K., McGain, F., McAlister, S., Barratt, A.: Health, financial and environmental impacts of unnecessary vitamin D testing: a triple bottom line assessment adapted for healthcare. BMJ Open 12(8), e056997 (2022). https://doi.org/10.1136/bmjopen-2021-056997CrossRefPubMedPubMedCentral

Bureau of Health Information.: https://www.bhi.nsw.gov.au/data-portal Accessed 10 August 2023, (2023).

Busetto, L., Wick, W., Gumbinger, C.: How to use and assess qualitative research methods. Neurol. Res. Pract. 2(1), 14 (2020). https://doi.org/10.1186/s42466-020-00059-zCrossRefPubMedPubMedCentral

Charters, E.: The Use of think-aloud methods in qualitative research an introduction to think-aloud methods. Brock Edu. J. (2003). https://doi.org/10.26522/BROCKED.V12I2.38CrossRef

Coleman, P.: Validity and reliability within qualitative research for the caring sciences. Int. J. Caring Sci. 14(3), 2041–2045 (2022)

DePorre, A.G., Hall, M., Puls, H.T., Daly, A., Gay, J.C., Bettenhausen, J.L., Markham, J.L.: Variation in care and clinical outcomes among infants hospitalized with hyperbilirubinemia. Hosp. Pediatr. 10(10), 844–850 (2020). https://doi.org/10.1542/hpeds.2020-0161CrossRefPubMed

El-Kareh, R., Hasan, O., Schiff, G.D.: Use of health information technology to reduce diagnostic errors. BMJ Qual. Saf. 22(Suppl 2), 40–51 (2013). https://doi.org/10.1136/bmjqs-2013-001884CrossRefPubMedPubMedCentral

Elo, S., Kyngäs, H.: The qualitative content analysis process. J. Adv. Nurs. 62(1), 107–115 (2008). https://doi.org/10.1111/j.1365-2648.2007.04569.xCrossRefPubMed

Etikan, I., Musa, S.A., Alkassim, R.S.: Comparison of convenience sampling and purposive sampling. Am. J. Theor. Appl. Stat. 5(1), 1–4 (2016)CrossRef

Florin, T.A., French, B., Zorc, J.J., Alpern, E.R., Shah, S.S.: Variation in emergency department diagnostic testing and disposition outcomes in pneumonia. Pediatrics 132(2), 237–244 (2013). https://doi.org/10.1542/peds.2013-0179CrossRefPubMed

Frutos, E.L., Muñoz, A.M., Rovegno, L., Pedretti, A.S., Otero, C.M., Gimenez, C., Luna, D.R., Grande Ratti, M.F., Martinez, B.J.: ’Can CPOE based on electronic order sets cause unintended consequences (expensive and unnecessary tests) at the emergency department? Stud. Health Technol. Inform. (2022). https://doi.org/10.3233/shti220059CrossRefPubMed

Gion, M., Cardinali, G., Guzzinati, S., Morandi, P., Trevisiol, C., Fabricio, A.S.C., Rugge, M., Zorzi, M.: Use of routine health datasets to assess the appropriateness of diagnostic tests in the follow-up of breast cancer patients: a population-based study on 3930 patients. Risk Manag. Healthc. Polic. 15, 1087–1100 (2022). https://doi.org/10.2147/rmhp.s342072CrossRef

Given, L.: The SAGE encyclopedia of qualitative research methods: semi-structured interview. SAGE Publ. Inc Thousand Oaks Calif. (2008a). https://doi.org/10.4135/9781412963909CrossRef

Given, L.: The SAGE encyclopedia of qualitative research methods: triangulation. SAGE Publ. Inc Thousand Oaks Calif. (2008b). https://doi.org/10.4135/9781412963909CrossRef

Hak, F., Guimarães, T., Santos, M.: Towards effective clinical decision support systems: a systematic review. PLoS ONE 17(8), e0272846 (2022). https://doi.org/10.1371/journal.pone.0272846CrossRefPubMedPubMedCentral

Hayashi, P., Jr., Abib, G., Hoppen, N., Wolff, L.D.G.: Processual validity in qualitative research in healthcare. Inq. J. Health Care Organ. Provis. Financ. 58, 00469580211060750 (2021)

Hernandez, B., Ming, D., Ho, C., Quang, H.N., Phuoc, A.L., Thi, H.T.D., Minh, T.N., Hai, D.H.T., Diem, P.D., Hue, T.L.T., Hoang, C.B., Kim, H.T., Trung, T.H., Paton, C., Holmes, A., Yacoub, S., Georgiou, P.: A human-centred design approach towards development of a digital clinical decision-support system for management of hospitalised patients with dengue. Int. J. Infect. Dis. 130, S87–S88 (2023). https://doi.org/10.1016/j.ijid.2023.04.217CrossRef

Hofmann, B., Welch, H.G.: New diagnostic tests: more harm than good. BMJ. 358, j3314 (2017). https://doi.org/10.1136/bmj.j3314CrossRefPubMed

Hughes, A.E.O., Jackups, R., Jr.: Clinical decision support for laboratory testing. Clin. Chem. 68(3), 402–412 (2022). https://doi.org/10.1093/clinchem/hvab201CrossRefPubMed

Jacobsohn, G.C., Leaf, M., Liao, F., Maru, A.P., Engstrom, C.J., Salwei, M.E., Pankratz, G.T., Eastman, A., Carayon, P., Wiegmann, D.A., Galang, J.S., Smith, M.A., Shah, M.N., Patterson, B.W.: Collaborative design and implementation of a clinical decision support system for automated fall-risk identification and referrals in emergency departments. Healthcare 10(1), 100598 (2022). https://doi.org/10.1016/j.hjdsi.2021.100598CrossRefPubMed

Janssens, P.M., van de Wijngaart, D.J., van Dijk, N.: Sensible use of laboratory testing requires active laboratory involvement. Clin. Chem. Lab. Med. 52(7), e131–e132 (2014). https://doi.org/10.1515/cclm-2013-1097CrossRefPubMed

Khairat, S., Marc, D., Crosby, W., Al Sanousi, A.: Reasons for physicians not adopting clinical decision support systems: critical analysis. JMIR Med. Inform. 6(2), e24 (2018). https://doi.org/10.2196/medinform.8912CrossRefPubMedPubMedCentral

Kouri, A., Yamada, J., Lam Shin Cheung, J., Van de Velde, S., Gupta, S.: Do providers use computerized clinical decision support systems? a systematic review and meta-regression of clinical decision support uptake. Implement. Sci. 17(1), 21 (2022). https://doi.org/10.1186/s13012-022-01199-3CrossRefPubMedPubMedCentral

Krolikowski, K.A., Bi, M., Baggott, C.M., Khorzad, R., Holl, J.L., Kruser, J.M.: Design thinking to improve healthcare delivery in the intensive care unit: promise, pitfalls, and lessons learned. J. Crit. Care 69, 153999 (2022). https://doi.org/10.1016/j.jcrc.2022.153999CrossRefPubMedPubMedCentral

Li, J., Dahm, M.R., Thomas, J., Wabe, N., Smith, P., Georgiou, A.: Why is there variation in test ordering practices for patients presenting to the emergency department with undifferentiated chest pain? A qualitative study. Emerg. Med. J. 38(11), 820–824 (2021). https://doi.org/10.1136/emermed-2020-211075CrossRefPubMed

Maguire, M.: Methods to support human-centred design. Int. J. Hum. Comput. Stud. 55(4), 587–634 (2001). https://doi.org/10.1006/ijhc.2001.0503CrossRef

Medford-Davis, L., Park, E., Shlamovitz, G., Suliburk, J., Meyer, A.N., Singh, H.: Diagnostic errors related to acute abdominal pain in the emergency department. Emerg. Med. J. 33(4), 253–259 (2016). https://doi.org/10.1136/emermed-2015-204754CrossRefPubMed

Melles, M., Albayrak, A., Goossens, R.: Innovating health care: key characteristics of human-centered design. Int. J. Qual. Health Care 33(Supplement_1), 37–44 (2021). https://doi.org/10.1093/intqhc/mzaa127CrossRefPubMed

Micheli, P., Wilner, S.J.S., Bhatti, S.H., Mura, M., Beverland, M.B.: Doing design thinking: conceptual review, synthesis, and research Agenda. J. Prod. Innov. Manag. 36(2), 124–148 (2019). https://doi.org/10.1111/jpim.12466CrossRef

Morse, J.M.: Critical analysis of strategies for determining rigor in qualitative inquiry. Qual. Health Res. 25(9), 1212–1222 (2015). https://doi.org/10.1177/1049732315588501CrossRefPubMed

Mthuli, S.A., Ruffin, F., Singh, N.: Define, explain, justify, apply (DEJA): an analytic tool for guiding qualitative research sample size. Int. J. Soc. Res. Methodol. 25(6), 809–821 (2022)CrossRef

Ngo, A., Gandhi, P., Miller, W.G.: Frequency that laboratory tests influence medical decisions. J. Appl. Lab. Med. 1(4), 410–414 (2017). https://doi.org/10.1373/jalm.2016.021634CrossRefPubMed

Noteboom, C., Behrens, A., Crandall, K., Zeng, D.: People, process, and technology in clinical decision support systems: a meta-analysis. SAIS 2022 Proceedings. 4. (2022)

NPS MedicineWise 2021 Choosing Wisely Annual Report: Reducing low-value care for a sustainable healthcare system. https://www.choosingwisely.org.au/assets/CWA2459_CW_2021_Annual_Report.pdf. (2021)

Object Management Group.: Business process model and notation (BPMN) version 2.0.2.' https://www.omg.org/spec/BPMN/2.0.2/ Accessed 16 February 2023 (2014)

Patterson, B.W., Pulia, M.S., Ravi, S., Hoonakker, P.L.T., Schoofs Hundt, A., Wiegmann, D., Wirkus, E.J., Johnson, S., Carayon, P.: Scope and influence of electronic health record-integrated clinical decision support in the emergency department: a systematic review. Ann. Emerg. Med. 74(2), 285–296 (2019). https://doi.org/10.1016/j.annemergmed.2018.10.034CrossRefPubMedPubMedCentral

Ray, J.M., Ahmed, O.M., Solad, Y., Maleska, M., Martel, S., Jeffery, M.M., Platts-Mills, T.F., Hess, E.P., D’Onofrio, G., Melnick, E.R.: Computerized clinical decision support system for emergency department-initiated buprenorphine for opioid use disorder: user-centered design. JMIR Hum. Fact. 6(1), e13121 (2019). https://doi.org/10.2196/13121CrossRef

Rendle, K.A., Abramson, C.M., Garrett, S.B., Halley, M.C., Dohan, D.: Beyond exploratory: a tailored framework for designing and assessing qualitative health research. BMJ Open 9(8), e030123 (2019). https://doi.org/10.1136/bmjopen-2019-030123CrossRefPubMedPubMedCentral

Roberts, J.P., Fisher, T.R., Trowbridge, M.J., Bent, C.: A design thinking framework for healthcare management and innovation. Healthc (amst) 4(1), 11–14 (2016). https://doi.org/10.1016/j.hjdsi.2015.12.002CrossRefPubMed

Rojo, M.G., Rolón, E., Calahorra, L., García, F.O., Sánchez, R.P., Ruiz, F., Ballester, N., Armenteros, M., Rodríguez, T., Espartero, R.M.: Implementation of the business process modelling notation (BPMN) in the modelling of anatomic pathology processes. Diagn. Pathol. 3(Suppl 1), S22 (2008). https://doi.org/10.1186/1746-1596-3-s1-s22CrossRefPubMedPubMedCentral

Salwei, M.E., Hoonakker, P., Carayon, P., Wiegmann, D., Pulia, M., Patterson, B.W.: Usability of a human factors-based clinical decision support in the emergency department: lessons learned for design and implementation. Hum. Factors (2022). https://doi.org/10.1177/00187208221078625CrossRefPubMed

Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., Jinks, C.: Saturation in qualitative research: exploring its conceptualization and operationalization. Qual. Quant. 52(4), 1893–1907 (2018). https://doi.org/10.1007/s11135-017-0574-8CrossRefPubMed

Scowen, C., Wabe, N., Eigenstetter, A., Lindeman, R., Miao, M., Westbrook, J.I., Georgiou, A.: Evaluating the long-term effects of a data-driven approach to reduce variation in emergency department pathology investigations: study protocol for evaluation of the NSW health pathology atlas of variation. BMJ Open 10(10), e039437 (2020). https://doi.org/10.1136/bmjopen-2020-039437CrossRefPubMedPubMedCentral

Sofaer, S.: Qualitative methods: what are they and why use them? Health Serv. Res. 34(5 Pt 2), 1101–1118 (1999)PubMedPubMedCentral

Tamburrano, A., Vallone, D., Carrozza, C., Urbani, A., Sanguinetti, M., Nicolotti, N., Cambieri, A., Laurenti, P.: Evaluation and cost estimation of laboratory test overuse in 43 commonly ordered parameters through a computerized clinical decision support system (CCDSS) in a large university hospital. PLoS ONE 15(8), e0237159 (2020). https://doi.org/10.1371/journal.pone.0237159CrossRefPubMedPubMedCentral

Thomas, J., Dahm, M.R., Li, J., Westbrook, J.I., Georgiou, A.A.: comparative study of the utilisation of an electronic test–result management system in emergency and intensive care settings. Health Inform. J. (2019). https://doi.org/10.1177/1460458219889223CrossRef

Vogel, S., Reiswich, A., Ritter, Z., Schmucker, M., Fuchs, A., Pischek-Koch, K., Wache, S., Esslinger, K., Dietrich, M., Kesztyüs, T., Krefting, D., Haag, M., Blaschke, S.: Development of a clinical decision support system for smart algorithms in emergency medicine. Stud. Health Technol. Inform. 289, 224–227 (2022). https://doi.org/10.3233/shti210900CrossRefPubMed

Wabe, N., Dahm, M.R., Li, L., Lindeman, R., Eigenstetter, A., Westbrook, J.I., Georgiou, A.: An evaluation of variation in pathology investigations and associated factors for adult patients presenting to emergency departments with chest pain: an observational study. Int. J. Clin. Pract. 73(3), e13305 (2019). https://doi.org/10.1111/ijcp.13305CrossRef

Wabe, N., Scowen, C., Eigenstetter, A., Lindeman, R., Georgiou, A.: The NSW pathology atlas of variation: part II—the association of variation in emergency department laboratory investigations with outcomes for patients presenting with chest pain. Ann. Emerg. Med. (2021a). https://doi.org/10.1016/j.annemergmed.2021.01.006CrossRefPubMed

Wabe, N., Thomas, J., Scowen, C., Eigenstetter, A., Lindeman, R., Georgiou, A.: The NSW pathology atlas of variation: part I—identifying emergency departments with outlying laboratory test-ordering practices. Ann. Emerg. Med. (2021b). https://doi.org/10.1016/j.annemergmed.2021.01.013CrossRefPubMed

Zare, S., Meidani, Z., Shirdeli, M., Nabovati, E.: Laboratory test ordering in inpatient hospitals: a systematic review on the effects and features of clinical decision support systems. BMC Med. Inform. Decis. Mak. 21(1), 20 (2021). https://doi.org/10.1186/s12911-020-01384-8CrossRefPubMedPubMedCentral

Title: Emergency department pathology order support tool (ED POST): a protocol using qualitative inquiry to inform design and development of a prototype to reduce low value care
Authors: Judith Thomas
Julie Li
Craig Scowen
Alex Eigenstetter
Andrew Georgiou
Publication date: 15-09-2023
Publisher: Springer US
Keyword: Pathology
Published in: Health Services and Outcomes Research Methodology
Print ISSN: 1387-3741
Electronic ISSN: 1572-9400
DOI: https://doi.org/10.1007/s10742-023-00314-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Emergency department pathology order support tool (ED POST): a protocol using qualitative inquiry to inform design and development of a prototype to reduce low value care

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content