Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Research

Data management system for diabetes clinical trials: a pre-post evaluation study

Authors: Aynaz Nourani, Haleh Ayatollahi, Masoud Solaymani-Dodaran

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Data management system for diabetes clinical trials is used to support clinical data management processes. The purpose of this study was to evaluate the quality and usability of this system from the users’ perspectives.

Methods

This study was conducted in 2020, and the pre-post evaluation method was used to examine the quality and usability of the designed system. Initially, a questionnaire was designed and distributed among the researchers who were involved in the diabetes clinical trials (n = 30) to investigate their expectations. Then, the researchers were asked to use the system and explain their perspectives about it by completing two questionnaires.

Results

There was no statistically significant differences between the users’ perspectives about the information quality, service quality, achievements, and communication before and after using the system. However, in terms of the system quality (P = 0.042) and users’ autonomy (P = 0.026), the users’ expectations were greater than the system performance. The system usability was at a good level based on the users’ opinions.

Conclusion

It seems that the designed system largely met the users’ expectations in most areas. However, the system quality and users’ autonomy need further attentions. In addition, the system should be used in multicenter trials and re-evaluated by a larger group of users.
Literature
1.
go back to reference Leroux H, McBride S, Gibson S, editors., editors. On selecting a clinical trial management system for large scale, multi-center, multi-modal clinical research study. In: Proceedings of the Australian national health informatics conference. 2011 Aug 1–4, Brisbane. Leroux H, McBride S, Gibson S, editors., editors. On selecting a clinical trial management system for large scale, multi-center, multi-modal clinical research study. In: Proceedings of the Australian national health informatics conference. 2011 Aug 1–4, Brisbane.
2.
go back to reference Lu Z, Su J. Clinical data management: current status, challenges, and future directions from industry perspectives. Open Access J Clin Trials. 2010;2:93–105.CrossRef Lu Z, Su J. Clinical data management: current status, challenges, and future directions from industry perspectives. Open Access J Clin Trials. 2010;2:93–105.CrossRef
3.
go back to reference Chow SC, Liu JP. Data management of a clinical trial. Design and analysis of clinical trials. Hoboken: Wiley; 2013.CrossRef Chow SC, Liu JP. Data management of a clinical trial. Design and analysis of clinical trials. Hoboken: Wiley; 2013.CrossRef
4.
go back to reference Gazali S, Kaur S, Singh I. Artificial intelligence based clinical data management systems: a review. Inf Med Unlocked. 2017;9:219–29.CrossRef Gazali S, Kaur S, Singh I. Artificial intelligence based clinical data management systems: a review. Inf Med Unlocked. 2017;9:219–29.CrossRef
5.
go back to reference Krishnankutty B, Bellary S, Kumar NBR, Moodahadu LS. Data management in clinical research: an overview. Indian J Pharmacol. 2012;44(2):168–72.CrossRef Krishnankutty B, Bellary S, Kumar NBR, Moodahadu LS. Data management in clinical research: an overview. Indian J Pharmacol. 2012;44(2):168–72.CrossRef
6.
go back to reference Malik N, Jain N, Nagaich U. Clinical data management: tools and regulations. Int J Pharm Life Sci. 2018;9(3):8–15. Malik N, Jain N, Nagaich U. Clinical data management: tools and regulations. Int J Pharm Life Sci. 2018;9(3):8–15.
7.
go back to reference Bryan HE. Web based data management system. Wiley encyclopedia of clinical trials. Hoboken: Wiley; 2007. pp. 1–8. Bryan HE. Web based data management system. Wiley encyclopedia of clinical trials. Hoboken: Wiley; 2007. pp. 1–8.
8.
go back to reference Barr R, Carver V, Green K, Jain N, Omosule A, Owens S, et al. Good Informatics Practices (GIP) module: data management. Chicago: HIMSS; 2013. Barr R, Carver V, Green K, Jain N, Omosule A, Owens S, et al. Good Informatics Practices (GIP) module: data management. Chicago: HIMSS; 2013.
9.
go back to reference Kuchinke W, Karakoyun T. Pathway to improved data management in clinical trials. Clin Investig. 2014;4(6):501–5.CrossRef Kuchinke W, Karakoyun T. Pathway to improved data management in clinical trials. Clin Investig. 2014;4(6):501–5.CrossRef
10.
go back to reference Kruse RL, Mehr DR. Data management for prospective research studies using SAS software. BMC Med Res Methodol. 2008;8(1):61–71.CrossRef Kruse RL, Mehr DR. Data management for prospective research studies using SAS software. BMC Med Res Methodol. 2008;8(1):61–71.CrossRef
11.
go back to reference Orro A, Guffanti G, Salvi E, Macciardi F, Milanesi L. SNPLims: a data management system for genome wide association studies. BMC Bioinform. 2008;9(2):1–8. Orro A, Guffanti G, Salvi E, Macciardi F, Milanesi L. SNPLims: a data management system for genome wide association studies. BMC Bioinform. 2008;9(2):1–8.
12.
go back to reference Yin F, Chen J, Liu H, He Y, Zheng Q. Comparison of paper and electronic data management in clinical trials. Acta Pharm Sin B. 2015;50(11):1461–3. Yin F, Chen J, Liu H, He Y, Zheng Q. Comparison of paper and electronic data management in clinical trials. Acta Pharm Sin B. 2015;50(11):1461–3.
13.
go back to reference Le Jeannic A, Quelen C, Alberti C, Durand-Zaleski I. Comparison of two data collection processes in clinical studies: electronic and paper case report forms. BMC Med Res Methodol. 2014;14(1):1–10.CrossRef Le Jeannic A, Quelen C, Alberti C, Durand-Zaleski I. Comparison of two data collection processes in clinical studies: electronic and paper case report forms. BMC Med Res Methodol. 2014;14(1):1–10.CrossRef
14.
go back to reference Pavlović I, Kern T, Miklavčič D. Comparison of paper-based and electronic data collection process in clinical trials: costs simulation study. Contemp Clin Trials. 2009;30(4):300–16.CrossRef Pavlović I, Kern T, Miklavčič D. Comparison of paper-based and electronic data collection process in clinical trials: costs simulation study. Contemp Clin Trials. 2009;30(4):300–16.CrossRef
15.
go back to reference Fraccaro P, Dentone C, Fenoglio D, Giacomini M. Multicentre clinical trials’ data management: a hybrid solution to exploit the strengths of electronic data capture and electronic health records systems. Inf Health Soc Care. 2013;38(4):313–29.CrossRef Fraccaro P, Dentone C, Fenoglio D, Giacomini M. Multicentre clinical trials’ data management: a hybrid solution to exploit the strengths of electronic data capture and electronic health records systems. Inf Health Soc Care. 2013;38(4):313–29.CrossRef
16.
go back to reference Ngari MM, Waithira N, Chilengi R, Njuguna P, Lang T, Fegan G. Experience of using an open source clinical trials data management software system in Kenya. BMC Res Notes. 2014;7(1):1–8.CrossRef Ngari MM, Waithira N, Chilengi R, Njuguna P, Lang T, Fegan G. Experience of using an open source clinical trials data management software system in Kenya. BMC Res Notes. 2014;7(1):1–8.CrossRef
17.
go back to reference Park JY, Kim DR, Haldar B, Mallick AH, Kim SA, Dey A, et al. Use of the data system for field management of a clinical study conducted in Kolkata, India. BMC Res Notes. 2016;9(1):20–31.CrossRef Park JY, Kim DR, Haldar B, Mallick AH, Kim SA, Dey A, et al. Use of the data system for field management of a clinical study conducted in Kolkata, India. BMC Res Notes. 2016;9(1):20–31.CrossRef
18.
go back to reference Walther B, Hossin S, Townend J, Abernethy N, Parker D, Jeffries D. Comparison of electronic data capture (EDC) with the standard data capture method for clinical trial data. PLoS ONE. 2011;6(9):1–11.CrossRef Walther B, Hossin S, Townend J, Abernethy N, Parker D, Jeffries D. Comparison of electronic data capture (EDC) with the standard data capture method for clinical trial data. PLoS ONE. 2011;6(9):1–11.CrossRef
19.
go back to reference Rosà A, Chen LY, Binder W. Failure analysis and prediction for big-data systems. IEEE Trans Serv Comput. 2016;10(6):984–98.CrossRef Rosà A, Chen LY, Binder W. Failure analysis and prediction for big-data systems. IEEE Trans Serv Comput. 2016;10(6):984–98.CrossRef
20.
go back to reference Park YR, Yoon YJ, Koo H, Yoo S, Choi C-M, Beck S-H, et al. Utilization of a clinical trial management system for the whole clinical trial process as an integrated database: system development. J Med Internet Res. 2018;20(4):1–13.CrossRef Park YR, Yoon YJ, Koo H, Yoo S, Choi C-M, Beck S-H, et al. Utilization of a clinical trial management system for the whole clinical trial process as an integrated database: system development. J Med Internet Res. 2018;20(4):1–13.CrossRef
21.
go back to reference Wilson AS, Bacon PA, Young SP, Carruthers DM. Vasculitis integrated clinical assessment database: a data management system to support studies into systemic vasculitis. J Clin Rheumatol. 2010;16(1):10–4.CrossRef Wilson AS, Bacon PA, Young SP, Carruthers DM. Vasculitis integrated clinical assessment database: a data management system to support studies into systemic vasculitis. J Clin Rheumatol. 2010;16(1):10–4.CrossRef
22.
go back to reference Ayatollahi H, Langarizadeh M, Chenani H. Confirmation of expectations and satisfaction with hospital information systems: a nursing perspective. Healthc Inf Res. 2016;22(4):326–32.CrossRef Ayatollahi H, Langarizadeh M, Chenani H. Confirmation of expectations and satisfaction with hospital information systems: a nursing perspective. Healthc Inf Res. 2016;22(4):326–32.CrossRef
23.
go back to reference Ayatollahi H, Bath PA, Goodacre S, Lo SY, Draegebo M, Khan FA. What factors influence emergency department staff attitudes towards using information technology? Emerg Med J. 2013;30(4):303–7.CrossRef Ayatollahi H, Bath PA, Goodacre S, Lo SY, Draegebo M, Khan FA. What factors influence emergency department staff attitudes towards using information technology? Emerg Med J. 2013;30(4):303–7.CrossRef
24.
go back to reference Ayatollahi H, Bath PA, Goodacre S. IT in the emergency department: what is the impact of technology? In: Proceeding of the 2nd international conference on health informatics; 2009 Jan 14–17; Porto, Portugal. p. 454–457. Ayatollahi H, Bath PA, Goodacre S. IT in the emergency department: what is the impact of technology? In: Proceeding of the 2nd international conference on health informatics; 2009 Jan 14–17; Porto, Portugal. p. 454–457.
25.
go back to reference Lee H, Lee S. An exploratory evaluation framework for e-clinical data management performance. Drug Inf J. 2012;46(5):555–64.CrossRef Lee H, Lee S. An exploratory evaluation framework for e-clinical data management performance. Drug Inf J. 2012;46(5):555–64.CrossRef
26.
go back to reference Hornbaek K, Stage J. The interplay between usability evaluation and user interaction design. Int J Hum Comput Stud. 2006;21(2):117–23.CrossRef Hornbaek K, Stage J. The interplay between usability evaluation and user interaction design. Int J Hum Comput Stud. 2006;21(2):117–23.CrossRef
27.
go back to reference Duftschmid G, Gall W, Eigenbauer E, Dorda W. Management of data from clinical trials using the ArchiMed system. Med Inf Internet Med. 2002;27(2):85–98.CrossRef Duftschmid G, Gall W, Eigenbauer E, Dorda W. Management of data from clinical trials using the ArchiMed system. Med Inf Internet Med. 2002;27(2):85–98.CrossRef
28.
go back to reference Li Z, Wen J, Zhang X, Wu C, Li Z, Liu L, editors., editors. ClinData Express–a metadata driven clinical research data management system for secondary use of clinical data. In: AMIA annual symposium proceedings. 2012. Chicago: American Medical Informatics Association. Li Z, Wen J, Zhang X, Wu C, Li Z, Liu L, editors., editors. ClinData Express–a metadata driven clinical research data management system for secondary use of clinical data. In: AMIA annual symposium proceedings. 2012. Chicago: American Medical Informatics Association.
29.
go back to reference Sedgwick P. Before and after study designs. Br Med J. 2014;349(2):50–74. Sedgwick P. Before and after study designs. Br Med J. 2014;349(2):50–74.
30.
go back to reference Karimi F, Poo DCC, Tan YM. Clinical information systems end user satisfaction: the expectations and needs congruencies effects. J Biomed Inform. 2015;53:342–54.CrossRef Karimi F, Poo DCC, Tan YM. Clinical information systems end user satisfaction: the expectations and needs congruencies effects. J Biomed Inform. 2015;53:342–54.CrossRef
31.
go back to reference Saillour-Glénisson F, Duhamel S, Fourneyron E, Huiart L, Joseph JP, Langlois E, et al. Protocol of a controlled before-after evaluation of a national health information technology-based program to improve healthcare coordination and access to information. BMC Health Serv Res. 2017;17(1):297.CrossRef Saillour-Glénisson F, Duhamel S, Fourneyron E, Huiart L, Joseph JP, Langlois E, et al. Protocol of a controlled before-after evaluation of a national health information technology-based program to improve healthcare coordination and access to information. BMC Health Serv Res. 2017;17(1):297.CrossRef
32.
go back to reference Nourani A, Ayatollahi H, Solaymani-Dodaran M. A clinical data management system for diabetes clinical trials. J Healthc Eng. 2022;2022:1–10.CrossRef Nourani A, Ayatollahi H, Solaymani-Dodaran M. A clinical data management system for diabetes clinical trials. J Healthc Eng. 2022;2022:1–10.CrossRef
33.
go back to reference Norman K, Shneiderman B. Questionnaire for user interaction satisfaction (QUIS 7.0). Baltimore: University of Maryland; 2017. Norman K, Shneiderman B. Questionnaire for user interaction satisfaction (QUIS 7.0). Baltimore: University of Maryland; 2017.
34.
go back to reference Zahiri Esfahani M, Khajouei R, Baneshi MR. Augmentation of the think aloud method with users’ perspectives for the selection of a picture archiving and communication system. J Biomed Inform. 2018;80:43–51.CrossRef Zahiri Esfahani M, Khajouei R, Baneshi MR. Augmentation of the think aloud method with users’ perspectives for the selection of a picture archiving and communication system. J Biomed Inform. 2018;80:43–51.CrossRef
35.
go back to reference Nourani A, Ayatollahi H, Solaymani-Dodaran M. Data management in diabetes clinical trials: A qualitative study.Trials. 2022. Nourani A, Ayatollahi H, Solaymani-Dodaran M. Data management in diabetes clinical trials: A qualitative study.Trials. 2022.
36.
go back to reference Nourani A, Ayatollahi H, Dodaran MS. A review of clinical data management systems used in clinical trials. Rev Recent Clin Trials. 2019;14(1):10–23.CrossRef Nourani A, Ayatollahi H, Dodaran MS. A review of clinical data management systems used in clinical trials. Rev Recent Clin Trials. 2019;14(1):10–23.CrossRef
37.
go back to reference Arab L, Hahn H, Henry J, Chacko S, Winter A, Cambou MC. Using the web for recruitment, screen, tracking, data management, and quality control in a dietary assessment clinical validation trial. Contemp Clin Trials. 2010;31(2):138–46.CrossRef Arab L, Hahn H, Henry J, Chacko S, Winter A, Cambou MC. Using the web for recruitment, screen, tracking, data management, and quality control in a dietary assessment clinical validation trial. Contemp Clin Trials. 2010;31(2):138–46.CrossRef
38.
go back to reference Fu L, Ding S, Chen T. Clinical Data Management System. In: Proceedings of the international conference on biomedical engineering and computer science (ICBECS 2010), 23–25 April 2010, Wuhan, China. Fu L, Ding S, Chen T. Clinical Data Management System. In: Proceedings of the international conference on biomedical engineering and computer science (ICBECS 2010), 23–25 April 2010, Wuhan, China.
39.
go back to reference Gao Q-B, Kong Y, Fu Z, Lu J, Wu C, Jin Z-C, et al. EZ-Entry: a clinical data management system. Comput Biol Med. 2008;38(9):1042–4.CrossRef Gao Q-B, Kong Y, Fu Z, Lu J, Wu C, Jin Z-C, et al. EZ-Entry: a clinical data management system. Comput Biol Med. 2008;38(9):1042–4.CrossRef
40.
go back to reference Micard E, Husson D, Team C-I, Felblinger J. ArchiMed: a data management system for clinical research in imaging. Front ICT. 2016;3:31–42.CrossRef Micard E, Husson D, Team C-I, Felblinger J. ArchiMed: a data management system for clinical research in imaging. Front ICT. 2016;3:31–42.CrossRef
41.
go back to reference Stenzhorn H, Weiler G, Brochhausen M, Schera F, Kritsotakis V, Tsiknakis M et al. The ObTiMA system-ontology-based managing of clinical trials. MedInfo; 12–15 September 2010, Cape Town:IOS Press. Stenzhorn H, Weiler G, Brochhausen M, Schera F, Kritsotakis V, Tsiknakis M et al. The ObTiMA system-ontology-based managing of clinical trials. MedInfo; 12–15 September 2010, Cape Town:IOS Press.
42.
go back to reference Tran V-A, Johnson N, Redline S, Zhang G-Q, OnWARD. Ontology-driven web-based framework for multi-center clinical studies. J Biomed Inform. 2011;44(1):48–53.CrossRef Tran V-A, Johnson N, Redline S, Zhang G-Q, OnWARD. Ontology-driven web-based framework for multi-center clinical studies. J Biomed Inform. 2011;44(1):48–53.CrossRef
43.
go back to reference Ibraigheeth M, Fadzli SA. Core factors for software projects success. Int J Inform Visualization. 2019;3(1):69–74. Ibraigheeth M, Fadzli SA. Core factors for software projects success. Int J Inform Visualization. 2019;3(1):69–74.
44.
go back to reference Hossain MA, Quaddus M. Expectation–confirmation theory in information system research: a review and analysis. Information systems theory. New York: Springer; 2012. pp. 441–69.CrossRef Hossain MA, Quaddus M. Expectation–confirmation theory in information system research: a review and analysis. Information systems theory. New York: Springer; 2012. pp. 441–69.CrossRef
45.
go back to reference Müller J, Heiss KI, Oberhoffer R. Implementation of an open adoption research data management system for clinical studies. BMC Res Notes. 2017;10(1):252–8.CrossRef Müller J, Heiss KI, Oberhoffer R. Implementation of an open adoption research data management system for clinical studies. BMC Res Notes. 2017;10(1):252–8.CrossRef
46.
go back to reference Buchsbaum R, Kaufmann P, Barsdorf AI, Arbing R, Montes J, Thompson JL, et al. Web-based data management for a phase II clinical trial in ALS. Amyotroph Lateral Sc. 2009;10(5–6):374–7.CrossRef Buchsbaum R, Kaufmann P, Barsdorf AI, Arbing R, Montes J, Thompson JL, et al. Web-based data management for a phase II clinical trial in ALS. Amyotroph Lateral Sc. 2009;10(5–6):374–7.CrossRef
47.
go back to reference Cavenaugh JS, Snell P, Jeffries D, Waight PA, McConkey SJ. A relational database for management of flow cytometry and ELISpot clinical trial data. Cytometry B Clin Cytom. 2007;72(1):49–62.CrossRef Cavenaugh JS, Snell P, Jeffries D, Waight PA, McConkey SJ. A relational database for management of flow cytometry and ELISpot clinical trial data. Cytometry B Clin Cytom. 2007;72(1):49–62.CrossRef
48.
go back to reference Cramon P, Rasmussen ÃK, Bonnema SJ, Bjorner JB, Feldt-Rasmussen U, Groenvold M, et al. Development and implementation of PROgmatic: a clinical trial management system for pragmatic multi-centre trials, optimised for electronic data capture and patient-reported outcomes. Clin Trials. 2014;11(3):344–54.CrossRef Cramon P, Rasmussen ÃK, Bonnema SJ, Bjorner JB, Feldt-Rasmussen U, Groenvold M, et al. Development and implementation of PROgmatic: a clinical trial management system for pragmatic multi-centre trials, optimised for electronic data capture and patient-reported outcomes. Clin Trials. 2014;11(3):344–54.CrossRef
49.
go back to reference Das S, Zijdenbos AP, Harlap J, Vins D, Evans AC. LORIS: a web-based data management system for multi-center studies. Front Neuroinform. 2011;5(37):1–11. Das S, Zijdenbos AP, Harlap J, Vins D, Evans AC. LORIS: a web-based data management system for multi-center studies. Front Neuroinform. 2011;5(37):1–11.
50.
go back to reference Durkalski V, Zhao W, Dillon C, Kim J. A web-based clinical trial management system for a sham-controlled multicenter clinical trial in depression. Clin Trials J. 2010;7(2):174–82.CrossRef Durkalski V, Zhao W, Dillon C, Kim J. A web-based clinical trial management system for a sham-controlled multicenter clinical trial in depression. Clin Trials J. 2010;7(2):174–82.CrossRef
51.
go back to reference Lee H, Chapiro J, Schernthaner R, Duran R, Wang Z, Gorodetski B, et al. How I do it: a practical database management system to assist clinical research teams with data collection, organization, and reporting. Acad Radiol. 2015;22(4):527–33.CrossRef Lee H, Chapiro J, Schernthaner R, Duran R, Wang Z, Gorodetski B, et al. How I do it: a practical database management system to assist clinical research teams with data collection, organization, and reporting. Acad Radiol. 2015;22(4):527–33.CrossRef
52.
go back to reference Musick BS, Robb SL, Burns DS, Stegenga K, Yan M, McCorkle KJ, et al. Development and use of a web-based data management system for a randomized clinical trial of adolescents and young adults. Comput Inf Nurs. 2011;29(6):337–43.CrossRef Musick BS, Robb SL, Burns DS, Stegenga K, Yan M, McCorkle KJ, et al. Development and use of a web-based data management system for a randomized clinical trial of adolescents and young adults. Comput Inf Nurs. 2011;29(6):337–43.CrossRef
Metadata
Title
Data management system for diabetes clinical trials: a pre-post evaluation study
Authors
Aynaz Nourani
Haleh Ayatollahi
Masoud Solaymani-Dodaran
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02110-w

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue