Skip to main content
Top
Published in: BMC Health Services Research 1/2020

01-12-2020 | Care | Research article

Measuring the effectiveness of digital nursing technologies: development of a comprehensive digital nursing technology outcome framework based on a scoping review

Authors: Tobias Krick, Kai Huter, Kathrin Seibert, Dominik Domhoff, Karin Wolf-Ostermann

Published in: BMC Health Services Research | Issue 1/2020

Login to get access

Abstract

Background

Digital nursing technologies (DNT) comprise an expanding, highly diverse field of research, explored using a wide variety of methods and tools. Study results are therefore difficult to compare, which raises the question how effectiveness of DNT can be adequately measured. Methods currently used might not be sufficient for certain specific nursing contexts. A comprehensive outcome framework that shows the multitude of possible outcome areas could be useful to generate more comparable results. The aim of the present study is to develop an outcome framework for DNT and to indicate which outcome areas have been most frequently evaluated in previous studies and how this has been done.

Methods

We combined an inductive and deductive approach to develop the framework. The numerical analysis is based on a scoping review focussing on the effectiveness of DNT for persons in need of care, formal or informal caregivers or care institutions. Nine databases were included in the screening: Medline, Scopus, CINAHL, Cochrane Library, ACM Digital Library, IEEE Xplore, the Collection of Computer Science Bibliographies, GeroLit and CareLit. Additional literature searches and expert interviews were included.

Results

The developed framework comprises four outcome target groups and 47 outcome areas. There are considerable differences in the researched outcome areas for the individual outcome target groups. Persons in need of care were by far the most frequently surveyed, particularly with respect to their psychological health. There are much fewer studies on formal and informal caregivers, and it is particularly noticeable that the quality of life of both groups has rarely been investigated. Care process quality was most frequently researched for organisations.

Conclusion

We were able to provide a comprehensive DNT outcome framework, thereby identifying the outcome tools used and the less researched outcome areas. We recommend a detailed investigation of all areas and tools in future research projects with a view to initiating a discussion on the differing importance of existing outcome areas and on a standardisation of outcome tools. We also recommend the development of outcome areas for the macro level of effectiveness assessment.
Appendix
Available only for authorised users
Literature
1.
go back to reference Krick T, Huter K, Domhoff D, Schmidt A, Rothgang H, Wolf-Ostermann K. Digital technology and nursing care: a scoping review on acceptance, effectiveness and efficiency studies of informal and formal care technologies. BMC Health Serv Res. 2019;19:400.PubMedPubMedCentralCrossRef Krick T, Huter K, Domhoff D, Schmidt A, Rothgang H, Wolf-Ostermann K. Digital technology and nursing care: a scoping review on acceptance, effectiveness and efficiency studies of informal and formal care technologies. BMC Health Serv Res. 2019;19:400.PubMedPubMedCentralCrossRef
2.
go back to reference Rouleau G, Gagnon MP, Côté J, Payne-Gagnon J, Hudson E, Dubois CA. Impact of information and communication technologies on nursing care: Results of an overview of systematic reviews. J Med Internet Res. 2017;19:4.CrossRef Rouleau G, Gagnon MP, Côté J, Payne-Gagnon J, Hudson E, Dubois CA. Impact of information and communication technologies on nursing care: Results of an overview of systematic reviews. J Med Internet Res. 2017;19:4.CrossRef
3.
go back to reference Lau F. Kuziemsky C (eds.): handbook of eHealth evaluation: an evidence-based approach. Victoria: University of Victoria; 2016. Lau F. Kuziemsky C (eds.): handbook of eHealth evaluation: an evidence-based approach. Victoria: University of Victoria; 2016.
4.
go back to reference EUnetHTA. EUnetHTA Joint Action 2, Work Package 8. HTA Core Model ® version 3.0. In; 2016. p. 410. EUnetHTA. EUnetHTA Joint Action 2, Work Package 8. HTA Core Model ® version 3.0. In; 2016. p. 410.
5.
go back to reference Bemelmans R, Gelderblom GJ, Jonker P, de Witte L. Socially Assistive Robots in Elderly Care: A Systematic Review into Effects and Effectiveness. J Am Med Directors Assoc. 2012;13(2):114–20 e111.CrossRef Bemelmans R, Gelderblom GJ, Jonker P, de Witte L. Socially Assistive Robots in Elderly Care: A Systematic Review into Effects and Effectiveness. J Am Med Directors Assoc. 2012;13(2):114–20 e111.CrossRef
6.
go back to reference Capurro D, Ganzinger M, Perez-Lu J, Knaup P. Effectiveness of eHealth interventions and information needs in palliative care: a systematic literature review. J Med Internet Res. 2014;16(3) e72. Capurro D, Ganzinger M, Perez-Lu J, Knaup P. Effectiveness of eHealth interventions and information needs in palliative care: a systematic literature review. J Med Internet Res. 2014;16(3) e72.
7.
go back to reference Fleming R, Sum S. Empirical studies on the effectiveness of assistive technology in the care of people with dementia: a systematic review. J Assist Technol. 2014;8(1):14–34.CrossRef Fleming R, Sum S. Empirical studies on the effectiveness of assistive technology in the care of people with dementia: a systematic review. J Assist Technol. 2014;8(1):14–34.CrossRef
8.
go back to reference Van der Roest HG, Wenborn J, Pastink C, Droes RM, Orrell M. Assistive technology for memory support in dementia. Cochrane Database Syst Rev. 2017;6:Cd009627.PubMed Van der Roest HG, Wenborn J, Pastink C, Droes RM, Orrell M. Assistive technology for memory support in dementia. Cochrane Database Syst Rev. 2017;6:Cd009627.PubMed
9.
go back to reference Khosravi P, Ghapanchi AH. Investigating the effectiveness of technologies applied to assist seniors: a systematic literature review. Int J Med Inform. 2016;85(1):17–26.PubMedCrossRef Khosravi P, Ghapanchi AH. Investigating the effectiveness of technologies applied to assist seniors: a systematic literature review. Int J Med Inform. 2016;85(1):17–26.PubMedCrossRef
10.
go back to reference Peretz D, Arnaert A, Ponzoni NN. Determining the cost of implementing and operating a remote patient monitoring programme for the elderly with chronic conditions: a systematic review of economic evaluations. J Telemed Telecare. 2018;24(1):13–21.PubMedCrossRef Peretz D, Arnaert A, Ponzoni NN. Determining the cost of implementing and operating a remote patient monitoring programme for the elderly with chronic conditions: a systematic review of economic evaluations. J Telemed Telecare. 2018;24(1):13–21.PubMedCrossRef
11.
go back to reference Calvaresi D, Cesarini D, Sernani P, Marinoni M, Dragoni AF, Sturm A. Exploring the ambient assisted living domain: a systematic review. J Ambient Intell Humaniz Comput. 2017;8(2):239–57.CrossRef Calvaresi D, Cesarini D, Sernani P, Marinoni M, Dragoni AF, Sturm A. Exploring the ambient assisted living domain: a systematic review. J Ambient Intell Humaniz Comput. 2017;8(2):239–57.CrossRef
12.
go back to reference Bemelmans R, Gelderblom GJ, Jonker P, de Witte L. Effectiveness of robot Paro in intramural psychogeriatric care: a multicenter quasi-experimental study. J Am Med Dir Assoc. 2015;16(11):946–50.PubMedCrossRef Bemelmans R, Gelderblom GJ, Jonker P, de Witte L. Effectiveness of robot Paro in intramural psychogeriatric care: a multicenter quasi-experimental study. J Am Med Dir Assoc. 2015;16(11):946–50.PubMedCrossRef
13.
go back to reference Yusofa MM, Kuljis J, Papazafeiropouloub A, Stergioulasb LK. An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Informatics. 2008;77:386–98.CrossRef Yusofa MM, Kuljis J, Papazafeiropouloub A, Stergioulasb LK. An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Informatics. 2008;77:386–98.CrossRef
14.
go back to reference Sockolow P, Crawford P, Lehmann HP. Health services research evaluation principles. Methods Inf Med. 2012;51(02):122–30.PubMedCrossRef Sockolow P, Crawford P, Lehmann HP. Health services research evaluation principles. Methods Inf Med. 2012;51(02):122–30.PubMedCrossRef
15.
go back to reference Information CIfH. A performance measurement framework for the Canadian health system. In. Ontario: Canadian Institute for Health Information; 2012. Information CIfH. A performance measurement framework for the Canadian health system. In. Ontario: Canadian Institute for Health Information; 2012.
16.
go back to reference Carinci F, Van Gool K, Mainz J, Veillard J, Pichora EC, Januel JM, Arispe I, Kim SM, Klazinga NS. Group aoBoTOHCQIE et al: towards actionable international comparisons of health system performance: expert revision of the OECD framework and quality indicators. Int J Qual Health Care. 2015;27(2):137–46.PubMed Carinci F, Van Gool K, Mainz J, Veillard J, Pichora EC, Januel JM, Arispe I, Kim SM, Klazinga NS. Group aoBoTOHCQIE et al: towards actionable international comparisons of health system performance: expert revision of the OECD framework and quality indicators. Int J Qual Health Care. 2015;27(2):137–46.PubMed
17.
go back to reference Francis Lau F, Hagens S, Muttitt S. A Proposed Benefits Evaluation Framework for Health Information Systems in Canada. Healthcare Quarterly. 2007;10:1. Francis Lau F, Hagens S, Muttitt S. A Proposed Benefits Evaluation Framework for Health Information Systems in Canada. Healthcare Quarterly. 2007;10:1.
18.
go back to reference Kidhom K, Bowes A, Dyrehauge S, Ekeland AG, Flottorp SA, Jensen LK, Pedersen CD, Rasmussen J. The MAST Manual. MAST - Model for ASsessment of Telemedicine. In: MethoTelemed team; 2010. Kidhom K, Bowes A, Dyrehauge S, Ekeland AG, Flottorp SA, Jensen LK, Pedersen CD, Rasmussen J. The MAST Manual. MAST - Model for ASsessment of Telemedicine. In: MethoTelemed team; 2010.
19.
go back to reference Schulz R, Wahl H-W, Matthews JT. Advancing the aging and technology agenda in gerontology. Gerontologist. 2015;55(5):724–34.PubMedCrossRef Schulz R, Wahl H-W, Matthews JT. Advancing the aging and technology agenda in gerontology. Gerontologist. 2015;55(5):724–34.PubMedCrossRef
20.
go back to reference Lang RLN. Evaluating the effectiveness of nurse-focused computerized clinical decision support on urinary catheter practice guidelines: Gardner-Webb University; 2012. Lang RLN. Evaluating the effectiveness of nurse-focused computerized clinical decision support on urinary catheter practice guidelines: Gardner-Webb University; 2012.
21.
go back to reference Hattink BJJ, Meiland FJM, Overmars-Marx T, de Boer M, Ebben PWG, van Blanken M, Verhaeghe S, Stalpers-Croeze I, Jedlitschka A, Flick SE, et al. The electronic, personalizable Rosetta system for dementia care: exploring the user-friendliness, usefulness and impact. Disabil Rehabil. 2016;11(1):61–71. Hattink BJJ, Meiland FJM, Overmars-Marx T, de Boer M, Ebben PWG, van Blanken M, Verhaeghe S, Stalpers-Croeze I, Jedlitschka A, Flick SE, et al. The electronic, personalizable Rosetta system for dementia care: exploring the user-friendliness, usefulness and impact. Disabil Rehabil. 2016;11(1):61–71.
22.
go back to reference Broadbent E, Orejana JR, Ahn HS, Xie J, Rouse P, MacDonald BA. The cost-effectiveness of a robot measuring vital signs in a rural medical practice. In: 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN): Aug. 31 2015-Sept. 4 2015 2015; 2015. p. 577–81.CrossRef Broadbent E, Orejana JR, Ahn HS, Xie J, Rouse P, MacDonald BA. The cost-effectiveness of a robot measuring vital signs in a rural medical practice. In: 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN): Aug. 31 2015-Sept. 4 2015 2015; 2015. p. 577–81.CrossRef
23.
go back to reference Kunkel C, Kopp W, Hanson M. A matter of life and death: end-of-life simulation to develop confidence in nursing students. Nurs Education Perspectives (Wolters Kluwer Health). 2016;37(5):285–6.CrossRef Kunkel C, Kopp W, Hanson M. A matter of life and death: end-of-life simulation to develop confidence in nursing students. Nurs Education Perspectives (Wolters Kluwer Health). 2016;37(5):285–6.CrossRef
24.
go back to reference Scott R, Saeed A. Global eHealth - measuring outcomes: why, what, and how a report commissioned by the World Health Organization's global observatory for eHealth. In. Bellagio: World Health Organization’s Global Observatory for eHealth; 2008. Scott R, Saeed A. Global eHealth - measuring outcomes: why, what, and how a report commissioned by the World Health Organization's global observatory for eHealth. In. Bellagio: World Health Organization’s Global Observatory for eHealth; 2008.
25.
go back to reference Scott RE, McCarthy FG, Jennett PA, Perverseff T, Lorenzetti D, Saeed A, Rush B, Yeo M. Telehealth outcomes: a synthesis of the literature and recommendations for outcome indicators. J Telemed Telecare. 2007;13(Suppl 2):1–38.PubMedCrossRef Scott RE, McCarthy FG, Jennett PA, Perverseff T, Lorenzetti D, Saeed A, Rush B, Yeo M. Telehealth outcomes: a synthesis of the literature and recommendations for outcome indicators. J Telemed Telecare. 2007;13(Suppl 2):1–38.PubMedCrossRef
26.
go back to reference Gartlehnera G, Hansenb RA, Nissmanc D, Lohrd KN, Careye TS. A simple and valid tool distinguished efficacy from effectiveness studies. J Clin Epidemiol. 2006;59:1040e1048. Gartlehnera G, Hansenb RA, Nissmanc D, Lohrd KN, Careye TS. A simple and valid tool distinguished efficacy from effectiveness studies. J Clin Epidemiol. 2006;59:1040e1048.
27.
go back to reference Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef
29.
go back to reference Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematicreviews of complex evidence: audit of primary sources. BMJ. 2005;331:1064–5.PubMedPubMedCentralCrossRef Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematicreviews of complex evidence: audit of primary sources. BMJ. 2005;331:1064–5.PubMedPubMedCentralCrossRef
30.
go back to reference Maas M, Swanson E, Herrmann M, Moorhead S, Johnson M, Aquilino M. Pflegeergebnisklassifikation (NOC) vol. 2., vollst. überarb. und erw. Aufl. Bern: Huber; 2013. Maas M, Swanson E, Herrmann M, Moorhead S, Johnson M, Aquilino M. Pflegeergebnisklassifikation (NOC) vol. 2., vollst. überarb. und erw. Aufl. Bern: Huber; 2013.
31.
go back to reference Nabbout R, Auvin S, Chiron C, Irwin J, Mistry A, Bonner N, Williamson N, Bennett B. Development and content validation of a preliminary core set of patient- and caregiver-relevant outcomes for inclusion in a potential composite endpoint for Dravet syndrome. Epilepsy Behav. 2018;78:232–42.PubMedCrossRef Nabbout R, Auvin S, Chiron C, Irwin J, Mistry A, Bonner N, Williamson N, Bennett B. Development and content validation of a preliminary core set of patient- and caregiver-relevant outcomes for inclusion in a potential composite endpoint for Dravet syndrome. Epilepsy Behav. 2018;78:232–42.PubMedCrossRef
32.
go back to reference Schwartz S, Laura Darlak L, Whitlatch CJ. Selected caregiver Assessment measures: a resource inventory for practitioners. In., vol. 2nd edition. Cleveland: Margaret Blenkner Research Institute of the Benjamin Rose Institute on Aging; 2012. Schwartz S, Laura Darlak L, Whitlatch CJ. Selected caregiver Assessment measures: a resource inventory for practitioners. In., vol. 2nd edition. Cleveland: Margaret Blenkner Research Institute of the Benjamin Rose Institute on Aging; 2012.
33.
go back to reference Zendjidjian XY, Boyer L. Challenges in measuring outcomes for caregivers of people with mental health problems. Dialogues Clin Neurosci. 2014;16(2):159–69.PubMedPubMedCentral Zendjidjian XY, Boyer L. Challenges in measuring outcomes for caregivers of people with mental health problems. Dialogues Clin Neurosci. 2014;16(2):159–69.PubMedPubMedCentral
34.
go back to reference Henriksson A, Arestedt K. Exploring factors and caregiver outcomes associated with feelings of preparedness for caregiving in family caregivers in palliative care: a correlational, cross-sectional study. Palliat Med. 2013;27(7):639–46.PubMedCrossRef Henriksson A, Arestedt K. Exploring factors and caregiver outcomes associated with feelings of preparedness for caregiving in family caregivers in palliative care: a correlational, cross-sectional study. Palliat Med. 2013;27(7):639–46.PubMedCrossRef
35.
go back to reference Deeken JF, Taylor KL, Mangan P, Yabroff KR, Ingham JM. Care for the caregivers: a review of self-report instruments developed to measure the burden, needs, and quality of life of informal caregivers. J Pain Symptom Manag. 2003;26(4):922–53.CrossRef Deeken JF, Taylor KL, Mangan P, Yabroff KR, Ingham JM. Care for the caregivers: a review of self-report instruments developed to measure the burden, needs, and quality of life of informal caregivers. J Pain Symptom Manag. 2003;26(4):922–53.CrossRef
36.
go back to reference Son J, Erno A, Shea DG, Femia EE, Zarit SH, Stephens MA. The caregiver stress process and health outcomes. J Aging Health. 2007;19(6):871–87.PubMedCrossRef Son J, Erno A, Shea DG, Femia EE, Zarit SH, Stephens MA. The caregiver stress process and health outcomes. J Aging Health. 2007;19(6):871–87.PubMedCrossRef
37.
go back to reference Hoefman R, Al-Janabi H, McCaffrey N, Currow D, Ratcliffe J. Measuring caregiver outcomes in palliative care: a construct validation study of two instruments for use in economic evaluations. Qual Life Res. 2015;24(5):1255–73.PubMedCrossRef Hoefman R, Al-Janabi H, McCaffrey N, Currow D, Ratcliffe J. Measuring caregiver outcomes in palliative care: a construct validation study of two instruments for use in economic evaluations. Qual Life Res. 2015;24(5):1255–73.PubMedCrossRef
38.
go back to reference Carod-Artal FJ, Mesquita HM, Ziomkowski S, Martinez-Martin P. Burden and health-related quality of life among caregivers of Brazilian Parkinson's disease patients. Parkinsonism Relat Disord. 2013;19(11):943–8.PubMedCrossRef Carod-Artal FJ, Mesquita HM, Ziomkowski S, Martinez-Martin P. Burden and health-related quality of life among caregivers of Brazilian Parkinson's disease patients. Parkinsonism Relat Disord. 2013;19(11):943–8.PubMedCrossRef
39.
go back to reference Sim J, Crookes P, Walsh K, Halcomb E. Measuring the outcomes of nursing practice: a Delphi study. J Clin Nurs. 2018;27(1–2):e368–78.PubMedCrossRef Sim J, Crookes P, Walsh K, Halcomb E. Measuring the outcomes of nursing practice: a Delphi study. J Clin Nurs. 2018;27(1–2):e368–78.PubMedCrossRef
40.
go back to reference Epstein MJ, Rejc A. Evaluating performance in information technology. In. Canada: The Society of Management Accountants of Canada; 2005. Epstein MJ, Rejc A. Evaluating performance in information technology. In. Canada: The Society of Management Accountants of Canada; 2005.
41.
go back to reference Trierweiller AC, Peixe BC, Tezza R, Pereira VL, Pacheco W Jr, Bornia AC, de Andrade DF. Measuring organizational effectiveness in information and communication technology companies using item response theory. Work. 2012;41(Suppl 1):2795–802.PubMedCrossRef Trierweiller AC, Peixe BC, Tezza R, Pereira VL, Pacheco W Jr, Bornia AC, de Andrade DF. Measuring organizational effectiveness in information and communication technology companies using item response theory. Work. 2012;41(Suppl 1):2795–802.PubMedCrossRef
42.
go back to reference Jain R, Shermon G. Creating an optimized organisation key opportunities and challenges. In. India: KPMG; 2012. Jain R, Shermon G. Creating an optimized organisation key opportunities and challenges. In. India: KPMG; 2012.
43.
go back to reference Cascio W, Montealegre R. How technology is changing work and organizations. Ann Rev Org Psychol Organizational Behav. 2016;3:349–75.CrossRef Cascio W, Montealegre R. How technology is changing work and organizations. Ann Rev Org Psychol Organizational Behav. 2016;3:349–75.CrossRef
44.
go back to reference Damberg CL, Sorbero ME, Lovejoy SL, Martsolf GR, Raaen L, Mandel D. Measuring success in health care value-based purchasing programs: findings from an environmental scan, literature review, and expert panel discussions. Rand Health Quarterly. 2014;4(3):9.PubMedPubMedCentral Damberg CL, Sorbero ME, Lovejoy SL, Martsolf GR, Raaen L, Mandel D. Measuring success in health care value-based purchasing programs: findings from an environmental scan, literature review, and expert panel discussions. Rand Health Quarterly. 2014;4(3):9.PubMedPubMedCentral
45.
go back to reference Jalagat R. Amur said Al-Habsi N: evaluating the impacts of IT usage on organizational performance. Eur Acad Res. 2017;5:5111–64. Jalagat R. Amur said Al-Habsi N: evaluating the impacts of IT usage on organizational performance. Eur Acad Res. 2017;5:5111–64.
46.
go back to reference Organisation WH: Innovative Care for Chronic Conditions: Building Blocks for Action In.: World Health Organisation; 2002. Organisation WH: Innovative Care for Chronic Conditions: Building Blocks for Action In.: World Health Organisation; 2002.
47.
go back to reference Lazarou I, Karakostas A, Stavropoulos TG, Tsompanidis T, Meditskos G, Kompatsiaris I, Tsolaki M. A novel and intelligent home monitoring system for care support of elders with cognitive impairment. J Alzheimers Dis. 2016;54(4):1561–91.PubMedCrossRef Lazarou I, Karakostas A, Stavropoulos TG, Tsompanidis T, Meditskos G, Kompatsiaris I, Tsolaki M. A novel and intelligent home monitoring system for care support of elders with cognitive impairment. J Alzheimers Dis. 2016;54(4):1561–91.PubMedCrossRef
48.
go back to reference Zaccarelli C, Cirillo G, Passuti S, Annicchiarico R, Barban F. Computer-based cognitive intervention for dementia Sociable: motivating platform for elderly networking, mental reinforcement and social interaction. In: 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops: 5–8 May 2013 2013; 2013. p. 430–5. Zaccarelli C, Cirillo G, Passuti S, Annicchiarico R, Barban F. Computer-based cognitive intervention for dementia Sociable: motivating platform for elderly networking, mental reinforcement and social interaction. In: 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops: 5–8 May 2013 2013; 2013. p. 430–5.
49.
go back to reference Florczak B, Scheurich A, Croghan J, Sheridan P Jr, Kurtz D, McGill W, McClain B. An observational study to assess an electronic point-of-care wound documentation and reporting system regarding user satisfaction and potential for improved care. Ostomy Wound Manag. 2012;58(3):46–51. Florczak B, Scheurich A, Croghan J, Sheridan P Jr, Kurtz D, McGill W, McClain B. An observational study to assess an electronic point-of-care wound documentation and reporting system regarding user satisfaction and potential for improved care. Ostomy Wound Manag. 2012;58(3):46–51.
50.
go back to reference Appari A, Johnson EM, Anthony DL. Information technology and hospital patient safety: a cross-sectional study of US acute care hospitals. Am J Managed Care. 2014;20(17):eSP39–47. Appari A, Johnson EM, Anthony DL. Information technology and hospital patient safety: a cross-sectional study of US acute care hospitals. Am J Managed Care. 2014;20(17):eSP39–47.
51.
go back to reference Mitchell S, Yaylacicegi U. EHR prescription for small, medium, and large hospitals: an exploratory study of Texas acute care hospitals. Int J Electron Healthc. 2012;7(2):125–40.PubMedCrossRef Mitchell S, Yaylacicegi U. EHR prescription for small, medium, and large hospitals: an exploratory study of Texas acute care hospitals. Int J Electron Healthc. 2012;7(2):125–40.PubMedCrossRef
52.
go back to reference Bennett CC, Sabanovic S, Piatt JA, Nagata S, Eldridge L, Randall N. A Robot a Day Keeps the Blues Away. In: 2017 IEEE International Conference on Healthcare Informatics (ICHI): 23–26 Aug. 2017 2017; 2017. p. 536–40.CrossRef Bennett CC, Sabanovic S, Piatt JA, Nagata S, Eldridge L, Randall N. A Robot a Day Keeps the Blues Away. In: 2017 IEEE International Conference on Healthcare Informatics (ICHI): 23–26 Aug. 2017 2017; 2017. p. 536–40.CrossRef
53.
go back to reference Lexis M. Activity monitoring technology to support homecare delivery to frail and psychogeriatric elderly persons living at home alone. Technol Disabil. 2013;25(3):189–97.CrossRef Lexis M. Activity monitoring technology to support homecare delivery to frail and psychogeriatric elderly persons living at home alone. Technol Disabil. 2013;25(3):189–97.CrossRef
54.
go back to reference Sahota O, Drummond A, Kendrick D, Grainge MJ, Vass C, Sach T, Gladman J, Avis M. REFINE (REducing falls in in-patieNt elderly) using bed and bedside chair pressure sensors linked to radio-pagers in acute hospital care: a randomised controlled trial. Age Ageing. 2014;43(2):247–53.PubMedCrossRef Sahota O, Drummond A, Kendrick D, Grainge MJ, Vass C, Sach T, Gladman J, Avis M. REFINE (REducing falls in in-patieNt elderly) using bed and bedside chair pressure sensors linked to radio-pagers in acute hospital care: a randomised controlled trial. Age Ageing. 2014;43(2):247–53.PubMedCrossRef
55.
go back to reference Mierlo L, Meiland F, Ven P, Hout H, Dröes R. Evaluation of DEM-DISC, customized e-advice on health and social support services for informal carers and case managers of people with dementia; a cluster randomized trial.In. Int Psychogeriatrics. 2015;27:1365–78.CrossRef Mierlo L, Meiland F, Ven P, Hout H, Dröes R. Evaluation of DEM-DISC, customized e-advice on health and social support services for informal carers and case managers of people with dementia; a cluster randomized trial.In. Int Psychogeriatrics. 2015;27:1365–78.CrossRef
56.
go back to reference Angst CM, Devaraj S, D'Arcy J. Dual role of IT-assisted communication in patient care: a validated structure-process-outcome framework. J Manag Inf Syst. 2012;29(2):257–92.CrossRef Angst CM, Devaraj S, D'Arcy J. Dual role of IT-assisted communication in patient care: a validated structure-process-outcome framework. J Manag Inf Syst. 2012;29(2):257–92.CrossRef
57.
go back to reference Restuccia JD, Cohen AB, Horwitt JN, Shwartz M. Hospital implementation of health information technology and quality of care: Are they related? BMC Med Informatics Decision Making. 2012;12(1). Restuccia JD, Cohen AB, Horwitt JN, Shwartz M. Hospital implementation of health information technology and quality of care: Are they related? BMC Med Informatics Decision Making. 2012;12(1).
58.
go back to reference Marek K, Stetzer F, Ryan P, Bub L, Adams S, Schlidt A, Lancaster R, O'Brien A. Nurse care coordination and technology effects on health status of frail older adults via enhanced self-management of medication: randomized clinical trial to test efficacy In. Nursing Res. 2013;62:269–78.CrossRef Marek K, Stetzer F, Ryan P, Bub L, Adams S, Schlidt A, Lancaster R, O'Brien A. Nurse care coordination and technology effects on health status of frail older adults via enhanced self-management of medication: randomized clinical trial to test efficacy In. Nursing Res. 2013;62:269–78.CrossRef
59.
go back to reference Broadbent E, Kerse N, Peri K, Robinson H, Jayawardena C, Kuo T, Datta C, Stafford R, Butler H, Jawalkar P, et al. Benefits and problems of health-care robots in aged care settings: a comparison trial. Australasian J Ageing. 2016;35(1):23–9.CrossRef Broadbent E, Kerse N, Peri K, Robinson H, Jayawardena C, Kuo T, Datta C, Stafford R, Butler H, Jawalkar P, et al. Benefits and problems of health-care robots in aged care settings: a comparison trial. Australasian J Ageing. 2016;35(1):23–9.CrossRef
60.
go back to reference Moyle W, Cooke M, Beattie E, Jones C, Klein B, Cook G, Gray C. Exploring the effect of companion robots on emotional expression in older adults with dementia: a pilot randomized controlled trial In. J Gerontological Nurs. 2013;39:46–53.CrossRef Moyle W, Cooke M, Beattie E, Jones C, Klein B, Cook G, Gray C. Exploring the effect of companion robots on emotional expression in older adults with dementia: a pilot randomized controlled trial In. J Gerontological Nurs. 2013;39:46–53.CrossRef
61.
go back to reference Nordheim J, Hamm S, Kuhlmey A, Suhr R. Tablet computers and their benefits for nursing home residents with dementia: results of a qualitative pilot study. Zeitschrift fur Gerontologie und Geriatrie. 2015;48(6):543–9.PubMedCrossRef Nordheim J, Hamm S, Kuhlmey A, Suhr R. Tablet computers and their benefits for nursing home residents with dementia: results of a qualitative pilot study. Zeitschrift fur Gerontologie und Geriatrie. 2015;48(6):543–9.PubMedCrossRef
62.
go back to reference Robinson H, MacDonald B, Kerse N, Broadbent E. The psychosocial effects of a companion robot: a randomized controlled trial. J Am Med Dir Assoc. 2013;14(9):661–7.PubMedCrossRef Robinson H, MacDonald B, Kerse N, Broadbent E. The psychosocial effects of a companion robot: a randomized controlled trial. J Am Med Dir Assoc. 2013;14(9):661–7.PubMedCrossRef
63.
go back to reference Lazar A, Demiris G, Thompson HJ. Evaluation of a multifunctional technology system in a memory care unit: opportunities for innovation in dementia care. Informatics Health Soc Care. 2016;41(4):373–86.CrossRef Lazar A, Demiris G, Thompson HJ. Evaluation of a multifunctional technology system in a memory care unit: opportunities for innovation in dementia care. Informatics Health Soc Care. 2016;41(4):373–86.CrossRef
64.
go back to reference Portela FR, Correia RJC, Fonseca JA, Andrade JM. Wiitherapy on seniors - effects on physical and metal domains. In: 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH): 16–18 Nov. 2011 2011; 2011. p. 1–5. Portela FR, Correia RJC, Fonseca JA, Andrade JM. Wiitherapy on seniors - effects on physical and metal domains. In: 2011 IEEE 1st International Conference on Serious Games and Applications for Health (SeGAH): 16–18 Nov. 2011 2011; 2011. p. 1–5.
66.
go back to reference Miller K, Rodger S, Kipping B, Kimble RM. A novel technology approach to pain management in children with burns: A prospective randomized controlled trial. Burns (03054179). 2011;37(3):395–405.CrossRef Miller K, Rodger S, Kipping B, Kimble RM. A novel technology approach to pain management in children with burns: A prospective randomized controlled trial. Burns (03054179). 2011;37(3):395–405.CrossRef
67.
go back to reference Gustafsson C, Svanberg C, Müllersdorf M. Using a robotic cat in dementia care. J Gerontol Nurs. 2015;41(10):46–56.PubMedCrossRef Gustafsson C, Svanberg C, Müllersdorf M. Using a robotic cat in dementia care. J Gerontol Nurs. 2015;41(10):46–56.PubMedCrossRef
68.
go back to reference Jøranson N, Pedersen I, Rokstad AMM, Ihlebæk C. Change in quality of life in older people with dementia participating in Paro-activity: a cluster-randomized controlled trial. J Adv Nurs. 2016;72(12):3020–33.PubMedCrossRef Jøranson N, Pedersen I, Rokstad AMM, Ihlebæk C. Change in quality of life in older people with dementia participating in Paro-activity: a cluster-randomized controlled trial. J Adv Nurs. 2016;72(12):3020–33.PubMedCrossRef
69.
go back to reference Valenti SM, Aguera-Ortiz L, Olazaran RJ, Mendoza RC, Perez MA, Rodriguez PI, Osa RE, Barrios SA, Herrero CV, Carrasco CL, et al. Social robots in advanced dementia. In: Frontiers in aging neuroscience, vol. 7; 2015. Valenti SM, Aguera-Ortiz L, Olazaran RJ, Mendoza RC, Perez MA, Rodriguez PI, Osa RE, Barrios SA, Herrero CV, Carrasco CL, et al. Social robots in advanced dementia. In: Frontiers in aging neuroscience, vol. 7; 2015.
70.
go back to reference Trukeschitz BSC, Ring-Dimitriou S. Smartes Betreutes Wohnen: Nutzung, Systemakzeptanz und Wirkungen von “meinZentrAAL”. Norderstedt: Deutschland; 2018. Trukeschitz BSC, Ring-Dimitriou S. Smartes Betreutes Wohnen: Nutzung, Systemakzeptanz und Wirkungen von “meinZentrAAL”. Norderstedt: Deutschland; 2018.
71.
go back to reference Rantz M, Phillips LJ, Galambos C, Lane K, Alexander GL, Despins L, Koopman RJ, Skubic M, Hicks L, Miller S, et al. Randomized trial of intelligent sensor system for early illness alerts in senior housing. J Am Med Dir Assoc. 2017;18(10):860–70.PubMedPubMedCentralCrossRef Rantz M, Phillips LJ, Galambos C, Lane K, Alexander GL, Despins L, Koopman RJ, Skubic M, Hicks L, Miller S, et al. Randomized trial of intelligent sensor system for early illness alerts in senior housing. J Am Med Dir Assoc. 2017;18(10):860–70.PubMedPubMedCentralCrossRef
72.
go back to reference Chen ST, Huang YGL, Chiang IT. Using Somatosensory Video Games to Promote Quality of Life for the Elderly with Disabilities. In: 2012 IEEE Fourth International Conference On Digital Game And Intelligent Toy Enhanced Learning: 27–30 March 2012 2012; 2012. p. 258–62.CrossRef Chen ST, Huang YGL, Chiang IT. Using Somatosensory Video Games to Promote Quality of Life for the Elderly with Disabilities. In: 2012 IEEE Fourth International Conference On Digital Game And Intelligent Toy Enhanced Learning: 27–30 March 2012 2012; 2012. p. 258–62.CrossRef
73.
go back to reference Kipping B, Rodger S, Miller K, Kimble RM. Virtual reality for acute pain reduction in adolescents undergoing burn wound care: a prospective randomized controlled trial. Burns (03054179). 2012;38(5):650–7.CrossRef Kipping B, Rodger S, Miller K, Kimble RM. Virtual reality for acute pain reduction in adolescents undergoing burn wound care: a prospective randomized controlled trial. Burns (03054179). 2012;38(5):650–7.CrossRef
74.
go back to reference Liang A, Piroth I, Robinson H, MacDonald B, Fisher M, Nater UM, Skoluda N, Broadbent E. A pilot randomized trial of a companion robot for people with dementia living in the community. J Am Med Dir Assoc. 2017;18(10):871–8.PubMedCrossRef Liang A, Piroth I, Robinson H, MacDonald B, Fisher M, Nater UM, Skoluda N, Broadbent E. A pilot randomized trial of a companion robot for people with dementia living in the community. J Am Med Dir Assoc. 2017;18(10):871–8.PubMedCrossRef
75.
go back to reference Petersen S, Houston S, Qin H, Tague C, Studley J. The utilization of robotic pets in dementia care In. J Alzheimer's Dis. 2017;55:569–74.CrossRef Petersen S, Houston S, Qin H, Tague C, Studley J. The utilization of robotic pets in dementia care In. J Alzheimer's Dis. 2017;55:569–74.CrossRef
76.
go back to reference Subramaniam P, Woods B. Digital life storybooks for people with dementia living in care homes: an evaluation In. Clinical Interventions Aging. 2016;11:1263–76.CrossRef Subramaniam P, Woods B. Digital life storybooks for people with dementia living in care homes: an evaluation In. Clinical Interventions Aging. 2016;11:1263–76.CrossRef
77.
go back to reference Jøranson N, Pedersen I, Rokstad AMM, Ihlebæk C. Effects on symptoms of agitation and depression in persons with dementia participating in robot-assisted activity: a cluster-randomized controlled trial. J Am Med Dir Assoc. 2015;16(10):867–73.PubMedCrossRef Jøranson N, Pedersen I, Rokstad AMM, Ihlebæk C. Effects on symptoms of agitation and depression in persons with dementia participating in robot-assisted activity: a cluster-randomized controlled trial. J Am Med Dir Assoc. 2015;16(10):867–73.PubMedCrossRef
78.
go back to reference Moyle W, Jones CJ, Murfield JE, Thalib L, Beattie ERA, Shum DKH, O'Dwyer ST, Mervin MC, Draper BM. Use of a robotic seal as a therapeutic tool to improve dementia symptoms: a cluster-randomized controlled trial. J Am Med Dir Assoc. 2017;18(9):766–73.PubMedCrossRef Moyle W, Jones CJ, Murfield JE, Thalib L, Beattie ERA, Shum DKH, O'Dwyer ST, Mervin MC, Draper BM. Use of a robotic seal as a therapeutic tool to improve dementia symptoms: a cluster-randomized controlled trial. J Am Med Dir Assoc. 2017;18(9):766–73.PubMedCrossRef
79.
go back to reference Patterson D, Soltani M, Teeley A, Morse D, Wiechman S, Gibran N. Hypnosis delivered through immersive virtual reality for wound care: a randomized, controlled study. In. J Burn Care Res. 2012;33:S70.CrossRef Patterson D, Soltani M, Teeley A, Morse D, Wiechman S, Gibran N. Hypnosis delivered through immersive virtual reality for wound care: a randomized, controlled study. In. J Burn Care Res. 2012;33:S70.CrossRef
80.
go back to reference Wagemaker E, Dekkers TJ. Agelink van Rentergem JA, Volkers KM, Huizenga HM: advances in mental health care: five N = 1 studies on the effects of the robot seal Paro in adults with severe intellectual disabilities. J Ment Health Res Intellect Disabil. 2017;10(4):309–20.CrossRef Wagemaker E, Dekkers TJ. Agelink van Rentergem JA, Volkers KM, Huizenga HM: advances in mental health care: five N = 1 studies on the effects of the robot seal Paro in adults with severe intellectual disabilities. J Ment Health Res Intellect Disabil. 2017;10(4):309–20.CrossRef
81.
go back to reference van der Heide LA, Willems CG, Spreeuwenberg MD, Rietman J, de Witte LP. Implementation of CareTV in care for the elderly: the effects on feelings of loneliness and safety and future challenges. Technol Disabil. 2012;24(4):283–91.CrossRef van der Heide LA, Willems CG, Spreeuwenberg MD, Rietman J, de Witte LP. Implementation of CareTV in care for the elderly: the effects on feelings of loneliness and safety and future challenges. Technol Disabil. 2012;24(4):283–91.CrossRef
82.
go back to reference Zhuang J, Fang R, Feng X, Xu X, Liu L, Bai Q, Tang H, Zhao Z, Chen S. The impact of human-computer interaction-based comprehensive training on the cognitive functions of cognitive impairment elderly individuals in a nursing home In. J Alzheimer's Dis. 2013;36:245–51.CrossRef Zhuang J, Fang R, Feng X, Xu X, Liu L, Bai Q, Tang H, Zhao Z, Chen S. The impact of human-computer interaction-based comprehensive training on the cognitive functions of cognitive impairment elderly individuals in a nursing home In. J Alzheimer's Dis. 2013;36:245–51.CrossRef
83.
go back to reference White C, McIlfatrick S, Dunwoody L, Watson M. Supporting and improving community health services-a prospective evaluation of ECHO technology in community palliative care nursing teams. BMJ Support Palliat Care. 2015;0:1–7. Published online first: 01.12.2015. White C, McIlfatrick S, Dunwoody L, Watson M. Supporting and improving community health services-a prospective evaluation of ECHO technology in community palliative care nursing teams. BMJ Support Palliat Care. 2015;0:1–7. Published online first: 01.12.2015.
84.
go back to reference Shukla J, Barreda-Ángeles M, Oliver J, Puig D. Effectiveness of socially assistive robotics during cognitive stimulation interventions: Impact on caregivers. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN): Aug. 28 2017-Sept. 1 2017 2017; 2017. p. 62–7.CrossRef Shukla J, Barreda-Ángeles M, Oliver J, Puig D. Effectiveness of socially assistive robotics during cognitive stimulation interventions: Impact on caregivers. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN): Aug. 28 2017-Sept. 1 2017 2017; 2017. p. 62–7.CrossRef
85.
go back to reference Hicken BL, Daniel C, Luptak M, Grant M, Kilian S, Rupper RW. Supporting caregivers of rural veterans electronically (SCORE). J Rural Health. 2017;33(3):305–13.PubMedCrossRef Hicken BL, Daniel C, Luptak M, Grant M, Kilian S, Rupper RW. Supporting caregivers of rural veterans electronically (SCORE). J Rural Health. 2017;33(3):305–13.PubMedCrossRef
86.
go back to reference Wakefield BJ, Vaughan-Sarrazin M. Home Telehealth and caregiving appraisal in chronic illness. Telemedicine E-Health. 2017;23(4):282–9.PubMedCrossRef Wakefield BJ, Vaughan-Sarrazin M. Home Telehealth and caregiving appraisal in chronic illness. Telemedicine E-Health. 2017;23(4):282–9.PubMedCrossRef
87.
go back to reference Wieck M, Blake B, Sellick C, Kenron D, DeVries D, Terry S, Krishnaswami S. Utilizing technology to improve intraoperative family communication. In. Am J Surg (no pagination). 2017; vol. Date of Publication: January 10; 2017. Wieck M, Blake B, Sellick C, Kenron D, DeVries D, Terry S, Krishnaswami S. Utilizing technology to improve intraoperative family communication. In. Am J Surg (no pagination). 2017; vol. Date of Publication: January 10; 2017.
88.
go back to reference Pot AM, Willemse BM, Horjus S. A pilot study on the use of tracking technology: feasibility, acceptability, and benefits for people in early stages of dementia and their informal caregivers. Aging Ment Health. 2012;16(1):127–34.PubMedCrossRef Pot AM, Willemse BM, Horjus S. A pilot study on the use of tracking technology: feasibility, acceptability, and benefits for people in early stages of dementia and their informal caregivers. Aging Ment Health. 2012;16(1):127–34.PubMedCrossRef
89.
go back to reference Ching JM, Williams BL, Idemoto LM, Blackmore CC. Using lean 'Automation with a human Touch' to improve medication safety: a step closer to the 'Perfect Dose'. Joint Commission J Qual Patient Safety. 2014;40(8):341–50.CrossRef Ching JM, Williams BL, Idemoto LM, Blackmore CC. Using lean 'Automation with a human Touch' to improve medication safety: a step closer to the 'Perfect Dose'. Joint Commission J Qual Patient Safety. 2014;40(8):341–50.CrossRef
90.
go back to reference Bettinelli M, Lei Y, Beane M, Mackey C, Liesching T. Does robotic Telerounding enhance nurse-physician collaboration satisfaction about care decisions? In. Telemedicine J E-Health. 2015;21:637–43.CrossRef Bettinelli M, Lei Y, Beane M, Mackey C, Liesching T. Does robotic Telerounding enhance nurse-physician collaboration satisfaction about care decisions? In. Telemedicine J E-Health. 2015;21:637–43.CrossRef
91.
go back to reference Gartlehner G, Hansen R, Nissman D, Lohr K, Carey T. Criteria for distinguishing effectiveness from efficacy trials in systematic reviews. Technical review 12. In., vol. no. 06–0046. Rockville: Agency for Healthcare Research and Quality; 2006. Gartlehner G, Hansen R, Nissman D, Lohr K, Carey T. Criteria for distinguishing effectiveness from efficacy trials in systematic reviews. Technical review 12. In., vol. no. 06–0046. Rockville: Agency for Healthcare Research and Quality; 2006.
92.
go back to reference Dal-Ré R, Rosendaal F. Efficacy and effectiveness: the wrong use of different terms. Eur J Internal Med. 2018;54:e17–8.CrossRef Dal-Ré R, Rosendaal F. Efficacy and effectiveness: the wrong use of different terms. Eur J Internal Med. 2018;54:e17–8.CrossRef
93.
go back to reference Ekelanda AG, Bowes A, Flottorp S. Effectiveness of telemedicine: A systematic review of reviews. Int J Med Informatics. 2010;79:736–71.CrossRef Ekelanda AG, Bowes A, Flottorp S. Effectiveness of telemedicine: A systematic review of reviews. Int J Med Informatics. 2010;79:736–71.CrossRef
94.
go back to reference Ommen O, Ullrich B, Janssen C, Pfaff H. The ambulatory-stationary interface in medical health care: problems, model of explanation, and possible solutions. Medizinische Klinik (Munich, Germany : 1983). 2007;102(11):913–7.CrossRef Ommen O, Ullrich B, Janssen C, Pfaff H. The ambulatory-stationary interface in medical health care: problems, model of explanation, and possible solutions. Medizinische Klinik (Munich, Germany : 1983). 2007;102(11):913–7.CrossRef
95.
go back to reference Sundmacher L, Fischbach D, Schuettig W, Naumann C, Augustin U, Faisst C. Which hospitalisations are ambulatory care-sensitive, to what degree, and how could the rates be reduced? Results of a group consensus study in Germany. Health Pol (Amsterdam, Netherlands). 2015;119(11):1415–23.CrossRef Sundmacher L, Fischbach D, Schuettig W, Naumann C, Augustin U, Faisst C. Which hospitalisations are ambulatory care-sensitive, to what degree, and how could the rates be reduced? Results of a group consensus study in Germany. Health Pol (Amsterdam, Netherlands). 2015;119(11):1415–23.CrossRef
96.
go back to reference Busse R, Blümel M. Germany: health system review. Health Syst Transition. 2014;16(2):1–296. Busse R, Blümel M. Germany: health system review. Health Syst Transition. 2014;16(2):1–296.
97.
go back to reference Auer S, Graessel E, Viereckl C, Kienberger U, Span E, Luttenberger K. Professional care team burden (PCTB) scale – reliability, validity and factor analysis. Health Qual Life Outcomes. 2015;13(1):17.PubMedPubMedCentralCrossRef Auer S, Graessel E, Viereckl C, Kienberger U, Span E, Luttenberger K. Professional care team burden (PCTB) scale – reliability, validity and factor analysis. Health Qual Life Outcomes. 2015;13(1):17.PubMedPubMedCentralCrossRef
98.
go back to reference Health EEPoewoii. Assessing the Impact of digital transformation of health service - Expert Panel on effective ways of investing in Health (EXPH). Luxembourg: European Union; 2018. Health EEPoewoii. Assessing the Impact of digital transformation of health service - Expert Panel on effective ways of investing in Health (EXPH). Luxembourg: European Union; 2018.
99.
go back to reference Wiskow C, Albreht T. Pietro cd: how to create an attractive and supportive working environment for health professionals. In: Policy Brief. Copenhagen: World Health Organization; 2010. Wiskow C, Albreht T. Pietro cd: how to create an attractive and supportive working environment for health professionals. In: Policy Brief. Copenhagen: World Health Organization; 2010.
Metadata
Title
Measuring the effectiveness of digital nursing technologies: development of a comprehensive digital nursing technology outcome framework based on a scoping review
Authors
Tobias Krick
Kai Huter
Kathrin Seibert
Dominik Domhoff
Karin Wolf-Ostermann
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Care
Published in
BMC Health Services Research / Issue 1/2020
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-020-05106-8

Other articles of this Issue 1/2020

BMC Health Services Research 1/2020 Go to the issue