Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

A qualitative exploration of early assessment of innovative medical technologies

Authors: Iben Fasterholdt, Anne Lee, Kristian Kidholm, Knud Bonnet Yderstræde, Kjeld Møller Pedersen

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

Hospitals increasingly make decisions about early development of and investment in innovative medical technologies (IMTs), but at present often without an early assessment of their potential to ensure selection of the most promising candidates for further development. This paper explores how early assessment is carried out in different health organisations and then discusses relevant learning points for hospitals.

Methods

A qualitative study design with a structured interview guide covering four themes was used. Content analyses of interview notes were performed covering four predetermined themes: context, basis for decision-making, process and structure, and perceptions. A fifth theme, handling cognitive bias, was identified during data analysis.

Results

A total of 11 organisations participated; eight from the private health industry and three public hospitals. The interviews identified four areas in which early assessment is performed in similar manner across the studied organisations and four areas where differences exist between public hospitals and private organisations. Public hospitals indicate a lower degree of formalised early assessment and less satisfaction with how early assessment is performed, compared to private organisations. Based on the above findings, two learning points may carry promise for hospitals. First, having dedicated prioritising committees for IMTs making stop/go decisions. This committee is separate from the IMT development processes and involved staff. Secondly, the committee should base decisions on a transparent early assessment decision-support tool, which include a broad set of domains, is iterative, describes uncertainty, and minimise cognitive biases.

Conclusions

Similarities and differences in the way early assessment is done in different health organisations were identified. These findings suggest promising learning points for the development of an early assessment model for hospitals.
Appendix
Available only for authorised users
Literature
3.
go back to reference Danbjørg DB, Wagner L, Clemensen J. Designing, developing, and testing an app for parents being discharged early postnatally. The Journal for Nurse Practitioners. 2014;10(10):794–802.CrossRef Danbjørg DB, Wagner L, Clemensen J. Designing, developing, and testing an app for parents being discharged early postnatally. The Journal for Nurse Practitioners. 2014;10(10):794–802.CrossRef
5.
go back to reference Rosenbek Minet L, Hansen LW, Pedersen CD, Titlestad IL, Christensen JK, Kidholm K, Rayce K, Bowes A, Møllegård L. Early telemedicine training and counselling after hospitalization in patients with severe chronic obstructive pulmonary disease: a feasibility study. BMC Med Inform Decis Mak. 2015;15(1):3.CrossRef Rosenbek Minet L, Hansen LW, Pedersen CD, Titlestad IL, Christensen JK, Kidholm K, Rayce K, Bowes A, Møllegård L. Early telemedicine training and counselling after hospitalization in patients with severe chronic obstructive pulmonary disease: a feasibility study. BMC Med Inform Decis Mak. 2015;15(1):3.CrossRef
6.
go back to reference Rasmussen BSB, Froekjaer J, Joergensen LB, Halekoh U, Yderstraede KB. Validation of a new imaging device for telemedical ulcer monitoring. Skin Res Technol. 2015;21(4):485–92.CrossRef Rasmussen BSB, Froekjaer J, Joergensen LB, Halekoh U, Yderstraede KB. Validation of a new imaging device for telemedical ulcer monitoring. Skin Res Technol. 2015;21(4):485–92.CrossRef
7.
go back to reference Ijzerman M. Evaluation of new technology in health care: in need of guidance for relevant evidence. Amsterdam: KNAW; 2014. Ijzerman M. Evaluation of new technology in health care: in need of guidance for relevant evidence. Amsterdam: KNAW; 2014.
8.
go back to reference Gallouj F M-BC, Provost A: Public-private partnerships in hospital innovation: what lessons for hospital management? In: Research Report. France: University Lille1, CLERSE.; 2010. Gallouj F M-BC, Provost A: Public-private partnerships in hospital innovation: what lessons for hospital management? In: Research Report. France: University Lille1, CLERSE.; 2010.
9.
go back to reference Bartelmes M, Neumann U, Lühmann D, Schönermark MP, Hagen A. Methods for assessment of innovative medical technologies during early stages of development. GMS Health Technol Assess. 2009;5:Doc15.PubMedPubMedCentral Bartelmes M, Neumann U, Lühmann D, Schönermark MP, Hagen A. Methods for assessment of innovative medical technologies during early stages of development. GMS Health Technol Assess. 2009;5:Doc15.PubMedPubMedCentral
10.
go back to reference Lehoux P, Miller F, Daudelin G, Denis J. Providing value to new health technology: the early contribution of entrepreneurs, investors, and regulatory agencies. Int J Health Policy Manag. 2017;6(9):509–18.CrossRef Lehoux P, Miller F, Daudelin G, Denis J. Providing value to new health technology: the early contribution of entrepreneurs, investors, and regulatory agencies. Int J Health Policy Manag. 2017;6(9):509–18.CrossRef
11.
go back to reference Dias C, Escoval A. Improvement of hospital performance through innovation: toward the value of hospital care. Health Care Manag. 2013;32(2):129–40. Dias C, Escoval A. Improvement of hospital performance through innovation: toward the value of hospital care. Health Care Manag. 2013;32(2):129–40.
12.
go back to reference Kahneman D. Thinking, fast and slow. London: Allen Lane; 2011. Kahneman D. Thinking, fast and slow. London: Allen Lane; 2011.
13.
go back to reference Steuten LM, Ramsey SD. Improving early cycle economic evaluation of diagnostic technologies. Expert Rev Pharmacoecon Outcomes Res. 2014;14(4):491–8.CrossRef Steuten LM, Ramsey SD. Improving early cycle economic evaluation of diagnostic technologies. Expert Rev Pharmacoecon Outcomes Res. 2014;14(4):491–8.CrossRef
14.
go back to reference Vallejo-Torres L, Steuten LMG, Buxton MJ, Girling AJ, Lilford RJ, Young T. Integrating health economics modeling in the product development cycle of medical devices: a Bayesian approach. Int J Technol Assess Health Care. 2008;24(04):459–64.CrossRef Vallejo-Torres L, Steuten LMG, Buxton MJ, Girling AJ, Lilford RJ, Young T. Integrating health economics modeling in the product development cycle of medical devices: a Bayesian approach. Int J Technol Assess Health Care. 2008;24(04):459–64.CrossRef
15.
go back to reference Commission E. G. Technology readiness levels (TRL), HORIZON 2020 – WORK PROGRAMME 2014–2015 General Annexes. In: Extract from Part 19 - Commission Decision C(2014)4995; 2014. Commission E. G. Technology readiness levels (TRL), HORIZON 2020 – WORK PROGRAMME 2014–2015 General Annexes. In: Extract from Part 19 - Commission Decision C(2014)4995; 2014.
16.
go back to reference Singh K. Quantitative social research methods. New Delhi: SAGE Publications; 2007. Singh K. Quantitative social research methods. New Delhi: SAGE Publications; 2007.
17.
go back to reference Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health Ment Health Serv Res. 2015;42(5):533–44.CrossRef Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health Ment Health Serv Res. 2015;42(5):533–44.CrossRef
18.
go back to reference Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2015. Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2015.
19.
go back to reference Hartz S, John J. Contribution of economic evaluation to decision making in early phases of product development: a methodological and empirical review. Int J Technol Assess Health Care. 2008;24(04):465–72.CrossRef Hartz S, John J. Contribution of economic evaluation to decision making in early phases of product development: a methodological and empirical review. Int J Technol Assess Health Care. 2008;24(04):465–72.CrossRef
20.
go back to reference Yao GL, Novielli N, Manaseki-Holland S, Chen Y-F, van der Klink M, Barach P, Chilton PJ, Lilford RJ. Evaluation of a predevelopment service delivery intervention: an application to improve clinical handovers. BMJ Qual Saf. 2012;21(Suppl 1):i29–38.CrossRef Yao GL, Novielli N, Manaseki-Holland S, Chen Y-F, van der Klink M, Barach P, Chilton PJ, Lilford RJ. Evaluation of a predevelopment service delivery intervention: an application to improve clinical handovers. BMJ Qual Saf. 2012;21(Suppl 1):i29–38.CrossRef
21.
go back to reference Miles MB, Huberman AM, Saldana J. Qualitative data analysis: a methods sourcebook. 3rd ed. Los Angeles, London, New Delhi, Singapore, Washington DC: SAGE Publications; 2014. Miles MB, Huberman AM, Saldana J. Qualitative data analysis: a methods sourcebook. 3rd ed. Los Angeles, London, New Delhi, Singapore, Washington DC: SAGE Publications; 2014.
22.
go back to reference Fasterholdt I, Krahn M, Kidholm K, Yderstræde KB, Pedersen KM. Review of early assessment models of innovative medical technologies. Health Policy. 2017;121(8):870–9.CrossRef Fasterholdt I, Krahn M, Kidholm K, Yderstræde KB, Pedersen KM. Review of early assessment models of innovative medical technologies. Health Policy. 2017;121(8):870–9.CrossRef
23.
go back to reference EuroScan_International_Network. A toolkit for the identification and assessment of new and emerging health technologies. Birmingham: EuroScan International Network; 2014. EuroScan_International_Network. A toolkit for the identification and assessment of new and emerging health technologies. Birmingham: EuroScan International Network; 2014.
24.
go back to reference Pham B, Tu HA, Han D, Pechlivanoglou P, Miller F, Rac V, Chin W, Tricco A, Paulden M, Bielecki J, et al. Early economic evaluation of emerging health technologies: protocol of a systematic review. Syst Rev. 2014;3(1):81.CrossRef Pham B, Tu HA, Han D, Pechlivanoglou P, Miller F, Rac V, Chin W, Tricco A, Paulden M, Bielecki J, et al. Early economic evaluation of emerging health technologies: protocol of a systematic review. Syst Rev. 2014;3(1):81.CrossRef
25.
go back to reference Fasterholdt I. Early realistic assessment of innovative medical technologies in hospitals (EARTH). Odense: Syddansk Universitet; 2018. Fasterholdt I. Early realistic assessment of innovative medical technologies in hospitals (EARTH). Odense: Syddansk Universitet; 2018.
26.
go back to reference Brinkmann S, Kvale S. Interviews: learning the craft of qualitative research interviewing. 3rd ed. Los Angeles: Sage; 2014. Brinkmann S, Kvale S. Interviews: learning the craft of qualitative research interviewing. 3rd ed. Los Angeles: Sage; 2014.
27.
go back to reference Olsson JR, Ahrengot N. Power in projects, programs and portfolios: achieve project excellence and create change with strategic impact, 1. Edn. Kbh.: Jurist- og Økonomforbundet; 2015. Olsson JR, Ahrengot N. Power in projects, programs and portfolios: achieve project excellence and create change with strategic impact, 1. Edn. Kbh.: Jurist- og Økonomforbundet; 2015.
28.
go back to reference Schnotz W, Kürschner C. A reconsideration of cognitive load theory. Educ Psychol Rev. 2007;19(4):469–508.CrossRef Schnotz W, Kürschner C. A reconsideration of cognitive load theory. Educ Psychol Rev. 2007;19(4):469–508.CrossRef
29.
go back to reference Besner C, Hobbs B. Discriminating contexts and project management best practices on innovative and noninnovative projects. Proj Manag J. 2008;39(S1):S123–34.CrossRef Besner C, Hobbs B. Discriminating contexts and project management best practices on innovative and noninnovative projects. Proj Manag J. 2008;39(S1):S123–34.CrossRef
30.
go back to reference Pinto JK. Project management: achieving competitive advantage. Harlow: Pearson; 2016. Pinto JK. Project management: achieving competitive advantage. Harlow: Pearson; 2016.
31.
go back to reference Ballini L, Minozzi S, Negro A, Pirini G, Grilli R. A method for addressing research gaps in HTA, developed whilst evaluating robotic-assisted surgery: a proposal. Health Res Policy Syst. 2010;8(1):27.CrossRef Ballini L, Minozzi S, Negro A, Pirini G, Grilli R. A method for addressing research gaps in HTA, developed whilst evaluating robotic-assisted surgery: a proposal. Health Res Policy Syst. 2010;8(1):27.CrossRef
32.
go back to reference Bonabeau E, Bodick N, Armstrong RW. A more rational approach to new-product development. Harv Bus Rev. 2008;86(3):96–102 134.PubMed Bonabeau E, Bodick N, Armstrong RW. A more rational approach to new-product development. Harv Bus Rev. 2008;86(3):96–102 134.PubMed
33.
go back to reference Åstebro T, Elhedhli S. The effectiveness of simple decision heuristics: forecasting commercial success for early-stage ventures. Manag Sci. 2006;52(3):395–409.CrossRef Åstebro T, Elhedhli S. The effectiveness of simple decision heuristics: forecasting commercial success for early-stage ventures. Manag Sci. 2006;52(3):395–409.CrossRef
34.
go back to reference Cook AG: Forecasting for the pharmaceutical industry : models for new product and in-market forecasting and how to use them. Abingdon, Oxon, GBR: Ashgate publishing Group; 2006. Cook AG: Forecasting for the pharmaceutical industry : models for new product and in-market forecasting and how to use them. Abingdon, Oxon, GBR: Ashgate publishing Group; 2006.
35.
go back to reference Flyvbjerg B. Fem misforståelser om casestudiet. In: Brinkmann S, Tanggaard L, editors. Kvalitative metoder: en grundbog. København: Hans Reitzel Forlag; 2010. Flyvbjerg B. Fem misforståelser om casestudiet. In: Brinkmann S, Tanggaard L, editors. Kvalitative metoder: en grundbog. København: Hans Reitzel Forlag; 2010.
37.
go back to reference Zacharakis AL, Meyer GD. The potential of actuarial decision models: can they improve the venture capital investment decision? J Bus Ventur. 2000;15(4):323–46.CrossRef Zacharakis AL, Meyer GD. The potential of actuarial decision models: can they improve the venture capital investment decision? J Bus Ventur. 2000;15(4):323–46.CrossRef
Metadata
Title
A qualitative exploration of early assessment of innovative medical technologies
Authors
Iben Fasterholdt
Anne Lee
Kristian Kidholm
Knud Bonnet Yderstræde
Kjeld Møller Pedersen
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3647-z

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue