Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2018

Open Access 01-12-2018 | Software

Timeline representation of clinical data: usability and added value for pharmacovigilance

Authors: Thibault Ledieu, Guillaume Bouzillé, Frantz Thiessard, Karine Berquet, Pascal Van Hille, Eric Renault, Elisabeth Polard, Marc Cuggia

Published in: BMC Medical Informatics and Decision Making | Issue 1/2018

Login to get access

Abstract

Background

Pharmacovigilance consists in monitoring and preventing the occurrence of adverse drug reactions (ADR). This activity requires the collection and analysis of data from the patient record or any other sources to find clues of a causality link between the drug and the ADR. This can be time-consuming because often patient data are heterogeneous and scattered in several files. To facilitate this task, we developed a timeline prototype to gather and classify patient data according to their chronology. Here, we evaluated its usability and quantified its contribution to routine pharmacovigilance using real ADR cases.

Methods

The timeline prototype was assessed using the biomedical data warehouse eHOP (from entrepôt de données biomédicales de l’HOPital) of the Rennes University Hospital Centre. First, the prototype usability was tested by six experts of the Regional Pharmacovigilance Centre of Rennes. Their experience was assessed with the MORAE software and a System and Usability Scale (SUS) questionnaire. Then, to quantify the timeline contribution to pharmacovigilance routine practice, three of them were asked to investigate possible ADR cases with the “Usual method” (analysis of electronic health record data with the DxCare software) or the “Timeline method”. The time to complete the task and the data quality in their reports (using the vigiGrade Completeness score) were recorded and compared between methods.

Results

All participants completed their tasks. The usability could be considered almost excellent with an average SUS score of 82.5/100. The time to complete the assessment was comparable between methods (P = 0.38) as well as the average vigiGrade Completeness of the data collected with the two methods (P = 0.49).

Conclusions

The results showed a good general level of usability for the timeline prototype. Conversely, no difference in terms of the time spent on each ADR case and data quality was found compared with the usual method. However, this absence of difference between the timeline and the usual tools that have been in use for several years suggests a potential use in pharmacovigilance especially because the testers asked to continue using the timeline after the evaluation.
Appendix
Available only for authorised users
Literature
2.
go back to reference Murphy SN, Weber G, Mendis M, Gainer V, Chueh HC, Churchill S, et al. Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2). J Am Med Inform Assoc. 2010;17(2):124–30.CrossRef Murphy SN, Weber G, Mendis M, Gainer V, Chueh HC, Churchill S, et al. Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2). J Am Med Inform Assoc. 2010;17(2):124–30.CrossRef
3.
go back to reference Cuggia M, Garcelon N, Campillo-Gimenez B, Bernicot T, Laurent J-F, Garin E, et al. Roogle: an information retrieval engine for clinical data warehouse. Stud Health Technol Inform. 2011;169:584–8.PubMed Cuggia M, Garcelon N, Campillo-Gimenez B, Bernicot T, Laurent J-F, Garin E, et al. Roogle: an information retrieval engine for clinical data warehouse. Stud Health Technol Inform. 2011;169:584–8.PubMed
4.
go back to reference Cuggia M, Campillo-Gimenez B, Bouzille G, Besana P, Jouini W, Dufour J-C, et al. Automatic selection of clinical trials based on a semantic web approach. Stud Health Technol Inform. 2015;216:564–8.PubMed Cuggia M, Campillo-Gimenez B, Bouzille G, Besana P, Jouini W, Dufour J-C, et al. Automatic selection of clinical trials based on a semantic web approach. Stud Health Technol Inform. 2015;216:564–8.PubMed
6.
go back to reference Polard E, Nowak E, Happe A, Biraben A, Oger E. For the GENEPI study group. Brand name to generic substitution of antiepileptic drugs does not lead to seizure-related hospitalization: a population-based case-crossover study. Pharmacoepidemiol Drug Saf. 2015;24(11):1161–9.CrossRef Polard E, Nowak E, Happe A, Biraben A, Oger E. For the GENEPI study group. Brand name to generic substitution of antiepileptic drugs does not lead to seizure-related hospitalization: a population-based case-crossover study. Pharmacoepidemiol Drug Saf. 2015;24(11):1161–9.CrossRef
8.
go back to reference Gotz D, Wang F, Perer A. A methodology for interactive mining and visual analysis of clinical event patterns using electronic health record data. J Biomed Inform. 2014;48:148–59.CrossRef Gotz D, Wang F, Perer A. A methodology for interactive mining and visual analysis of clinical event patterns using electronic health record data. J Biomed Inform. 2014;48:148–59.CrossRef
9.
go back to reference Alexander Rind SM. VisuExplore: gaining new medical insights from visual exploration. 2010; Alexander Rind SM. VisuExplore: gaining new medical insights from visual exploration. 2010;
10.
go back to reference Monroe M, Meyer TE, Plaisant C, Lan R, Wongsuphasawat K, Coster TS, et al. Visualizing patterns of drug prescriptions with EventFlow: a pilot study of asthma medications in the military health system. 2013CrossRef Monroe M, Meyer TE, Plaisant C, Lan R, Wongsuphasawat K, Coster TS, et al. Visualizing patterns of drug prescriptions with EventFlow: a pilot study of asthma medications in the military health system. 2013CrossRef
11.
go back to reference Gschwandtner T, Aigner W, Kaiser K, Miksch S, Seyfang A. CareCruiser: Exploring and visualizing plans, events, and effects interactively. In: Visualization Symposium (PacificVis), 2011 IEEE Pacific; 2011. p. 43–50.CrossRef Gschwandtner T, Aigner W, Kaiser K, Miksch S, Seyfang A. CareCruiser: Exploring and visualizing plans, events, and effects interactively. In: Visualization Symposium (PacificVis), 2011 IEEE Pacific; 2011. p. 43–50.CrossRef
12.
go back to reference Shahar Y, Goren-Bar D, Boaz D, Tahan G. Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions. Artif Intell Med. 2006;38(2):115–35.CrossRef Shahar Y, Goren-Bar D, Boaz D, Tahan G. Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions. Artif Intell Med. 2006;38(2):115–35.CrossRef
13.
go back to reference Thiessard F, Mougin F, Diallo G, Jouhet V, Cossin S, Garcelon N, et al. RAVEL: retrieval and visualization in ELectronic health records. Stud Health Technol Inform. 2012;180:194–8.PubMed Thiessard F, Mougin F, Diallo G, Jouhet V, Cossin S, Garcelon N, et al. RAVEL: retrieval and visualization in ELectronic health records. Stud Health Technol Inform. 2012;180:194–8.PubMed
15.
go back to reference Lamy J-B, Duclos C, Hamek S, Beuscart-Zéphir M-C, Kerdelhué G, Darmoni S, et al. Towards iconic language for patient records, drug monographs, guidelines and medical search engines. Stud Health Technol Inform. 2010;160(Pt 1):156–60. Lamy J-B, Duclos C, Hamek S, Beuscart-Zéphir M-C, Kerdelhué G, Darmoni S, et al. Towards iconic language for patient records, drug monographs, guidelines and medical search engines. Stud Health Technol Inform. 2010;160(Pt 1):156–60.
17.
go back to reference Rubin J, Chisnell D. Handbook of usability testing: how to plan, design, and conduct effective tests. Indianapolis: Wiley; 2011. p. 353. Rubin J, Chisnell D. Handbook of usability testing: how to plan, design, and conduct effective tests. Indianapolis: Wiley; 2011. p. 353.
19.
go back to reference Nair KM, Malaeekeh R, Schabort I, Taenzer P, Radhakrishnan A, Guenter D. A clinical decision support system for chronic pain Management in Primary Care: usability testing and its relevance. J Innov Health Inform. 2015;22(3):329–32.CrossRef Nair KM, Malaeekeh R, Schabort I, Taenzer P, Radhakrishnan A, Guenter D. A clinical decision support system for chronic pain Management in Primary Care: usability testing and its relevance. J Innov Health Inform. 2015;22(3):329–32.CrossRef
21.
go back to reference Neri PM, Pollard SE, Volk LA, Newmark LP, Varugheese M, Baxter S, et al. Usability of a novel clinician interface for genetic results. J Biomed Inform. 2012 Oct;45(5):950–7.CrossRef Neri PM, Pollard SE, Volk LA, Newmark LP, Varugheese M, Baxter S, et al. Usability of a novel clinician interface for genetic results. J Biomed Inform. 2012 Oct;45(5):950–7.CrossRef
22.
go back to reference Nielsen J. Usability engineering. San Francisco: Morgan Kaufmann Publishers Inc.; 1993.CrossRef Nielsen J. Usability engineering. San Francisco: Morgan Kaufmann Publishers Inc.; 1993.CrossRef
23.
go back to reference Olmsted-Hawala EL, Murphy ED, Hawala S, Ashenfelter KT. Think-aloud protocols: a comparison of three think-aloud protocols for use in testing data-dissemination web sites for usability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems [Internet]. New York: ACM; 2010. p. 2381–90. [cited 2016 Jan 6]. (CHI ‘10). Available from: http://doi.acm.org/10.1145/1753326.1753685. Olmsted-Hawala EL, Murphy ED, Hawala S, Ashenfelter KT. Think-aloud protocols: a comparison of three think-aloud protocols for use in testing data-dissemination web sites for usability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems [Internet]. New York: ACM; 2010. p. 2381–90. [cited 2016 Jan 6]. (CHI ‘10). Available from: http://​doi.​acm.​org/​10.​1145/​1753326.​1753685.
25.
go back to reference Peute LWP, de Keizer NF, Jaspers MWM. The value of retrospective and concurrent think aloud in formative usability testing of a physician data query tool. J Biomed Inform. 2015 Jun;55:1–10.CrossRef Peute LWP, de Keizer NF, Jaspers MWM. The value of retrospective and concurrent think aloud in formative usability testing of a physician data query tool. J Biomed Inform. 2015 Jun;55:1–10.CrossRef
26.
go back to reference Brooke J. SUS: a quick and dirty usability scale. 1996. Brooke J. SUS: a quick and dirty usability scale. 1996.
27.
go back to reference Lewis JR, Sauro J. The factor structure of the system usability scale. In: Proceedings of the 1st International Conference on Human Centered Design: Held As Part of HCI International 2009 [Internet]. Berlin: Springer-Verlag; 2009. p. 94–103. [cited 2016 Jan 6]. (HCD 09). Available from: https://doi.org/10.1007/978-3-642-02806-9_12.CrossRef Lewis JR, Sauro J. The factor structure of the system usability scale. In: Proceedings of the 1st International Conference on Human Centered Design: Held As Part of HCI International 2009 [Internet]. Berlin: Springer-Verlag; 2009. p. 94–103. [cited 2016 Jan 6]. (HCD 09). Available from: https://​doi.​org/​10.​1007/​978-3-642-02806-9_​12.CrossRef
28.
go back to reference Osmont M-N, Cuggia M, Polard E, Riou C, Balusson F, Oger E. Utilisation du PMSI pour la détection d’effets indésirables médicamenteux. Therapie. 2013 Jul 1;68(4):285–95.CrossRef Osmont M-N, Cuggia M, Polard E, Riou C, Balusson F, Oger E. Utilisation du PMSI pour la détection d’effets indésirables médicamenteux. Therapie. 2013 Jul 1;68(4):285–95.CrossRef
29.
31.
go back to reference Martins SB, Shahar Y, Galperin M, Kaizer H, Goren-Bar D, McNaughton D, et al. Evaluation of KNAVE-II: a tool for intelligent query and exploration of patient data. Stud Health Technol Inform. 2004;107(Pt 1):648–52.PubMed Martins SB, Shahar Y, Galperin M, Kaizer H, Goren-Bar D, McNaughton D, et al. Evaluation of KNAVE-II: a tool for intelligent query and exploration of patient data. Stud Health Technol Inform. 2004;107(Pt 1):648–52.PubMed
Metadata
Title
Timeline representation of clinical data: usability and added value for pharmacovigilance
Authors
Thibault Ledieu
Guillaume Bouzillé
Frantz Thiessard
Karine Berquet
Pascal Van Hille
Eric Renault
Elisabeth Polard
Marc Cuggia
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2018
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-018-0667-x

Other articles of this Issue 1/2018

BMC Medical Informatics and Decision Making 1/2018 Go to the issue