Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Research article

Experts’ perceptions on the use of visual analytics for complex mental healthcare planning: an exploratory study

Authors: Erin I. Walsh, Younjin Chung, Nicolas Cherbuin, Luis Salvador-Carulla

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

Health experts including planners and policy-makers face complex decisions in diverse and constantly changing healthcare systems. Visual analytics may play a critical role in supporting analysis of complex healthcare data and decision-making. The purpose of this study was to examine the real-world experience that experts in mental healthcare planning have with visual analytics tools, investigate how well current visualisation techniques meet their needs, and suggest priorities for the future development of visual analytics tools of practical benefit to mental healthcare policy and decision-making.

Methods

Health expert experience was assessed by an online exploratory survey consisting of a mix of multiple choice and open-ended questions. Health experts were sampled from an international pool of policy-makers, health agency directors, and researchers with extensive and direct experience of using visual analytics tools for complex mental healthcare systems planning. We invited them to the survey, and the experts’ responses were analysed using statistical and text mining approaches.

Results

The forty respondents who took part in the study recognised the complexity of healthcare systems data, but had most experience with and preference for relatively simple and familiar visualisations such as bar charts, scatter plots, and geographical maps. Sixty-five percent rated visual analytics as important to their field for evidence-informed decision-making processes. Fifty-five percent indicated that more advanced visual analytics tools were needed for their data analysis, and 67.5% stated their willingness to learn new tools. This was reflected in text mining and qualitative synthesis of open-ended responses.

Conclusions

This exploratory research provides readers with the first self-report insight into expert experience with visual analytics in mental healthcare systems research and policy. In spite of the awareness of their importance for complex healthcare planning, the majority of experts use simple, readily available visualisation tools. We conclude that co-creation and co-development strategies will be required to support advanced visual analytics tools and skills, which will become essential in the future of healthcare.

Graphical abstract

Appendix
Available only for authorised users
Literature
1.
go back to reference Ola O, Sedig K. Beyond simple charts: design of visualizations for big health data. Online J Public Health Inform. 2016;8(3):e195. Ola O, Sedig K. Beyond simple charts: design of visualizations for big health data. Online J Public Health Inform. 2016;8(3):e195.
2.
go back to reference Caban JJ, Gotz D. Visual analytics in healthcare–opportunities and research challenges. Journal of the American Medical Informatics Association. 2015;22(2):260–62. Caban JJ, Gotz D. Visual analytics in healthcare–opportunities and research challenges. Journal of the American Medical Informatics Association. 2015;22(2):260–62.
3.
go back to reference Keim D, Andrienko G, Fekete J-D, Görg C, Kohlhammer J, Melançon G. Visual analytics: definition, process, and challenges. Berlin: Information visualization: Springer; 2008. p. 154–75. Keim D, Andrienko G, Fekete J-D, Görg C, Kohlhammer J, Melançon G. Visual analytics: definition, process, and challenges. Berlin: Information visualization: Springer; 2008. p. 154–75.
4.
go back to reference Gibert K, García-Alonso C, Salvador-Carulla L. Integrating clinicians, knowledge and data: expert-based cooperative analysis in healthcare decision support. Health Res Policy Syst. 2010;8(1):28.PubMedPubMedCentralCrossRef Gibert K, García-Alonso C, Salvador-Carulla L. Integrating clinicians, knowledge and data: expert-based cooperative analysis in healthcare decision support. Health Res Policy Syst. 2010;8(1):28.PubMedPubMedCentralCrossRef
5.
go back to reference Preim B, Lawonn K. A survey of visual analytics for public health. Computer graphics forum: Eurographics; 2019;39(3):1–35. Preim B, Lawonn K. A survey of visual analytics for public health. Computer graphics forum: Eurographics; 2019;39(3):1–35.
6.
go back to reference Alemzadeh S, Hielscher T, Niemann U, Cibulski L, Ittermann T, Völzke H, et al. Subpopulation discovery and validation in epidemiological dataEuroVA@EuroVis; 2017. Alemzadeh S, Hielscher T, Niemann U, Cibulski L, Ittermann T, Völzke H, et al. Subpopulation discovery and validation in epidemiological dataEuroVA@EuroVis; 2017.
7.
go back to reference Chung Y, Salvador-Carulla L, Salinas-Pérez JA, Uriarte-Uriarte JJ, Iruin-Sanz A, García-Alonso CR. Use of the self-organising map network (SOMNet) as a decision support system for regional mental health planning. Health Res Policy Syst. 2018;16(1):35.PubMedPubMedCentralCrossRef Chung Y, Salvador-Carulla L, Salinas-Pérez JA, Uriarte-Uriarte JJ, Iruin-Sanz A, García-Alonso CR. Use of the self-organising map network (SOMNet) as a decision support system for regional mental health planning. Health Res Policy Syst. 2018;16(1):35.PubMedPubMedCentralCrossRef
8.
go back to reference Chishtie JA, Babineau J, Bielska IA, Cepoiu-Martin M, Irvine M, Koval A, et al. Visual analytic tools and techniques in population health and health services research: protocol for a scoping review. JMIR Res Protoc. 2019;8(10):e14019.PubMedPubMedCentralCrossRef Chishtie JA, Babineau J, Bielska IA, Cepoiu-Martin M, Irvine M, Koval A, et al. Visual analytic tools and techniques in population health and health services research: protocol for a scoping review. JMIR Res Protoc. 2019;8(10):e14019.PubMedPubMedCentralCrossRef
9.
go back to reference Chung Y, Bagheri N, Salinas-Perez JA, Smurthwaite K, Walsh E, Furst M, et al. Role of visual analytics in supporting mental healthcare systems research and policy: a systematic scoping review. Int J Inf Manag. 2020;50:17–27.CrossRef Chung Y, Bagheri N, Salinas-Perez JA, Smurthwaite K, Walsh E, Furst M, et al. Role of visual analytics in supporting mental healthcare systems research and policy: a systematic scoping review. Int J Inf Manag. 2020;50:17–27.CrossRef
10.
go back to reference O’Donoughue Jenkins L, Kelly PM, Cherbuin N, Anstey KJ. Evaluating and using observational evidence: the contrasting views of policy makers and epidemiologists. Front Public Health. 2016;4:267.PubMedPubMedCentralCrossRef O’Donoughue Jenkins L, Kelly PM, Cherbuin N, Anstey KJ. Evaluating and using observational evidence: the contrasting views of policy makers and epidemiologists. Front Public Health. 2016;4:267.PubMedPubMedCentralCrossRef
11.
go back to reference Benjamin Martz Jr W, Shepherd MM. Testing for the transfer of tacit knowledge: making a case for implicit learning. Decis Sci J Innov Educ. 2003;1(1):41–56.CrossRef Benjamin Martz Jr W, Shepherd MM. Testing for the transfer of tacit knowledge: making a case for implicit learning. Decis Sci J Innov Educ. 2003;1(1):41–56.CrossRef
13.
go back to reference Morisset C, Sanchez D. On building a visualisation tool for access control policies. Cham: International Conference on Information Systems Security and Privacy: Springer; 2018. Morisset C, Sanchez D. On building a visualisation tool for access control policies. Cham: International Conference on Information Systems Security and Privacy: Springer; 2018.
14.
go back to reference Team RC. R: a language and environment for statistical computing; 2013. Team RC. R: a language and environment for statistical computing; 2013.
15.
go back to reference Feinerer I. Introduction to the tm package text Mining in RRetrieved March. 2018;1; 2019. Feinerer I. Introduction to the tm package text Mining in RRetrieved March. 2018;1; 2019.
16.
go back to reference Wickham H. Stringr: modern, consistent string processing. R J. 2010;2(2):38–40.CrossRef Wickham H. Stringr: modern, consistent string processing. R J. 2010;2(2):38–40.CrossRef
17.
go back to reference Günther F, Dudschig C, Kaup B. LSAfun-an R package for computations based on latent semantic analysis. Behav Res Methods. 2015;47(4):930–44.PubMedCrossRef Günther F, Dudschig C, Kaup B. LSAfun-an R package for computations based on latent semantic analysis. Behav Res Methods. 2015;47(4):930–44.PubMedCrossRef
18.
go back to reference Wickham H. ggplot2: elegant graphics for data analysis: springer; 2016. Wickham H. ggplot2: elegant graphics for data analysis: springer; 2016.
19.
go back to reference VanVoorhis CW, Morgan BL. Understanding power and rules of thumb for determining sample sizes. Tutor Quant Methods Psychol. 2007;3(2):43–50.CrossRef VanVoorhis CW, Morgan BL. Understanding power and rules of thumb for determining sample sizes. Tutor Quant Methods Psychol. 2007;3(2):43–50.CrossRef
20.
go back to reference Hope AC. A simplified Monte Carlo significance test procedure. J R Stat Soc Ser B Methodol. 1968;30(3):582–98. Hope AC. A simplified Monte Carlo significance test procedure. J R Stat Soc Ser B Methodol. 1968;30(3):582–98.
21.
22.
go back to reference Cohen J. Statistical power analysis for the behavioral sciences: Routledge; 2013.CrossRef Cohen J. Statistical power analysis for the behavioral sciences: Routledge; 2013.CrossRef
23.
go back to reference Willett P. The porter stemming algorithm: then and now. Program. 2006;40(3):219–23.CrossRef Willett P. The porter stemming algorithm: then and now. Program. 2006;40(3):219–23.CrossRef
24.
go back to reference Bravata DM, Shojania KG, Olkin I, Raveh A. CoPlot: a tool for visualizing multivariate data in medicine. Stat Med. 2008;27(12):2234–47.PubMedCrossRef Bravata DM, Shojania KG, Olkin I, Raveh A. CoPlot: a tool for visualizing multivariate data in medicine. Stat Med. 2008;27(12):2234–47.PubMedCrossRef
25.
go back to reference Hannus M, Hyönä J. Utilization of illustrations during learning of science textbook passages among low-and high-ability children. Contemp Educ Psychol. 1999;24(2):95–123.PubMedCrossRef Hannus M, Hyönä J. Utilization of illustrations during learning of science textbook passages among low-and high-ability children. Contemp Educ Psychol. 1999;24(2):95–123.PubMedCrossRef
26.
go back to reference Herráez A, Costa MJ. Biochemical visual literacy with constructive alignment: outcomes, assessment, and activities; 2013. Herráez A, Costa MJ. Biochemical visual literacy with constructive alignment: outcomes, assessment, and activities; 2013.
27.
go back to reference Freebairn L, Atkinson J-A, Kelly PM, McDonnell G, Rychetnik L. Decision makers’ experience of participatory dynamic simulation modelling: methods for public health policy. BMC Med Inform Decis Mak. 2018;18(1):131.PubMedPubMedCentralCrossRef Freebairn L, Atkinson J-A, Kelly PM, McDonnell G, Rychetnik L. Decision makers’ experience of participatory dynamic simulation modelling: methods for public health policy. BMC Med Inform Decis Mak. 2018;18(1):131.PubMedPubMedCentralCrossRef
28.
go back to reference Fisher B, Green TM, Arias-Hernández R. Visual analytics as a translational cognitive science. Top Cogn Sci. 2011;3(3):609–25.PubMedCrossRef Fisher B, Green TM, Arias-Hernández R. Visual analytics as a translational cognitive science. Top Cogn Sci. 2011;3(3):609–25.PubMedCrossRef
29.
go back to reference Carroll LN, Au AP, Detwiler LT, T-c F, Painter IS, Abernethy NF. Visualization and analytics tools for infectious disease epidemiology: a systematic review. J Biomed Inform. 2014;51:287–98.PubMedPubMedCentralCrossRef Carroll LN, Au AP, Detwiler LT, T-c F, Painter IS, Abernethy NF. Visualization and analytics tools for infectious disease epidemiology: a systematic review. J Biomed Inform. 2014;51:287–98.PubMedPubMedCentralCrossRef
30.
go back to reference Lanters CA, Fantke P. Structuring complex results using network maps and hierarchical charts. Procedia CIRP. 2018;69:441–6.CrossRef Lanters CA, Fantke P. Structuring complex results using network maps and hierarchical charts. Procedia CIRP. 2018;69:441–6.CrossRef
31.
go back to reference Salvador-Carulla L, Haro J, Ayuso-Mateos J. A framework for evidence-based mental health care and policy. Acta Psychiatr Scand. 2006;114:5–11.CrossRef Salvador-Carulla L, Haro J, Ayuso-Mateos J. A framework for evidence-based mental health care and policy. Acta Psychiatr Scand. 2006;114:5–11.CrossRef
32.
go back to reference Furst MA, Gandré C, López-Alberca CR, Salvador-Carulla L. Healthcare ecosystems research in mental health: a scoping review of methods to describe the context of local care delivery. BMC Health Serv Res. 2019;19(1):173.PubMedPubMedCentralCrossRef Furst MA, Gandré C, López-Alberca CR, Salvador-Carulla L. Healthcare ecosystems research in mental health: a scoping review of methods to describe the context of local care delivery. BMC Health Serv Res. 2019;19(1):173.PubMedPubMedCentralCrossRef
33.
go back to reference Mealing NM, Banks E, Jorm LR, Steel DG, Clements MS, Rogers KD. Investigation of relative risk estimates from studies of the same population with contrasting response rates and designs. BMC Med Res Methodol. 2010;10(1):26.PubMedPubMedCentralCrossRef Mealing NM, Banks E, Jorm LR, Steel DG, Clements MS, Rogers KD. Investigation of relative risk estimates from studies of the same population with contrasting response rates and designs. BMC Med Res Methodol. 2010;10(1):26.PubMedPubMedCentralCrossRef
34.
go back to reference Morton SM, Bandara DK, Robinson EM, Carr PEA. In the 21st century, what is an acceptable response rate? Aust N Z J Public Health. 2012;36(2):106–8.PubMedCrossRef Morton SM, Bandara DK, Robinson EM, Carr PEA. In the 21st century, what is an acceptable response rate? Aust N Z J Public Health. 2012;36(2):106–8.PubMedCrossRef
35.
go back to reference Richardson M, Domingos P. Learning with knowledge from multiple experts. Proceedings of the 20th international conference on machine learning (ICML-03); 2003. Richardson M, Domingos P. Learning with knowledge from multiple experts. Proceedings of the 20th international conference on machine learning (ICML-03); 2003.
Metadata
Title
Experts’ perceptions on the use of visual analytics for complex mental healthcare planning: an exploratory study
Authors
Erin I. Walsh
Younjin Chung
Nicolas Cherbuin
Luis Salvador-Carulla
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-00986-0

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue