Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2024

Open Access 01-12-2024 | Research

An analysis of published study designs in PubMed prisoner health abstracts from 1963 to 2023: a text mining study

Authors: George Karystianis, Wilson Lukmanjaya, Iain Buchan, Paul Simpson, Natasha Ginnivan, Goran Nenadic, Tony Butler

Published in: BMC Medical Research Methodology | Issue 1/2024

Login to get access

Abstract

Background

The challenging nature of studies with incarcerated populations and other offender groups can impede the conduct of research, particularly that involving complex study designs such as randomised control trials and clinical interventions. Providing an overview of study designs employed in this area can offer insights into this issue and how research quality may impact on health and justice outcomes.

Methods

We used a rule-based approach to extract study designs from a sample of 34,481 PubMed abstracts related to epidemiological criminology published between 1963 and 2023. The results were compared against an accepted hierarchy of scientific evidence.

Results

We evaluated our method in a random sample of 100 PubMed abstracts. An F1-Score of 92.2% was returned. Of 34,481 study abstracts, almost 40.0% (13,671) had an extracted study design. The most common study design was observational (37.3%; 5101) while experimental research in the form of trials (randomised, non-randomised) was present in 16.9% (2319). Mapped against the current hierarchy of scientific evidence, 13.7% (1874) of extracted study designs could not be categorised. Among the remaining studies, most were observational (17.2%; 2343) followed by systematic reviews (10.5%; 1432) with randomised controlled trials accounting for 8.7% (1196) of studies and meta-analysis for 1.4% (190) of studies.

Conclusions

It is possible to extract epidemiological study designs from a large-scale PubMed sample computationally. However, the number of trials, systematic reviews, and meta-analysis is relatively small – just 1 in 5 articles. Despite an increase over time in the total number of articles, study design details in the abstracts were missing. Epidemiological criminology still lacks the experimental evidence needed to address the health needs of the marginalized and isolated population that is prisoners and offenders.
Appendix
Available only for authorised users
Literature
2.
go back to reference Akers TA, Potter RH, Hill CV. Epidemiological criminology: a public health approach to crime and violence. Wiley; 2012. Dec 26. Akers TA, Potter RH, Hill CV. Epidemiological criminology: a public health approach to crime and violence. Wiley; 2012. Dec 26.
3.
go back to reference Waltermaurer E, Akers T. Epidemiological criminology: theory to practice. Routledge; 2014. Nov 13. Waltermaurer E, Akers T. Epidemiological criminology: theory to practice. Routledge; 2014. Nov 13.
4.
go back to reference Simpson PL, Guthrie J, Butler T. Prison health service directors’ views on research priorities and organizational issues in conducting research in prison: outcomes of a national deliberative roundtable. Int J Prison Health. 2017;13(2):113–23.CrossRefPubMed Simpson PL, Guthrie J, Butler T. Prison health service directors’ views on research priorities and organizational issues in conducting research in prison: outcomes of a national deliberative roundtable. Int J Prison Health. 2017;13(2):113–23.CrossRefPubMed
5.
go back to reference Lennox C, Leonard S, Senior J, Hendricks C, Rybczynska-Bunt S, Quinn C, Byng R, Shaw J. Conducting randomised controlled trials of complex interventions in prisons: a sisyphean task? Front Psychiatry. 2022;13:839958.CrossRefPubMedPubMedCentral Lennox C, Leonard S, Senior J, Hendricks C, Rybczynska-Bunt S, Quinn C, Byng R, Shaw J. Conducting randomised controlled trials of complex interventions in prisons: a sisyphean task? Front Psychiatry. 2022;13:839958.CrossRefPubMedPubMedCentral
6.
go back to reference Last JM, Spasoff RA, Harris SS, Thuriaux MC. A dictionary of epidemiology. International Epidemiological Association, Inc.; 2001. Last JM, Spasoff RA, Harris SS, Thuriaux MC. A dictionary of epidemiology. International Epidemiological Association, Inc.; 2001.
7.
go back to reference Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The strengthening the reporting of Observational studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7.CrossRef Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The strengthening the reporting of Observational studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7.CrossRef
8.
go back to reference Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2011;9:672–7.CrossRefPubMed Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2011;9:672–7.CrossRefPubMed
9.
go back to reference Chan AW, Tetzlaff JM, Altman DG, Dickersin K, Moher D. SPIRIT 2013: new guidance for content of clinical trial protocols. Lancet. 2013;381:91–2.CrossRefPubMed Chan AW, Tetzlaff JM, Altman DG, Dickersin K, Moher D. SPIRIT 2013: new guidance for content of clinical trial protocols. Lancet. 2013;381:91–2.CrossRefPubMed
10.
go back to reference Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg. 2021;88:105906.CrossRefPubMed Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg. 2021;88:105906.CrossRefPubMed
11.
go back to reference Kinner SA, Young JT. Understanding and improving the health of people who experience incarceration: an overview and synthesis. Epidemiol Rev. 2018;40(1):4–11.CrossRefPubMedPubMedCentral Kinner SA, Young JT. Understanding and improving the health of people who experience incarceration: an overview and synthesis. Epidemiol Rev. 2018;40(1):4–11.CrossRefPubMedPubMedCentral
12.
go back to reference Glasziou P, Vandenbroucke J, Chalmers I. Assessing the quality of research. BMJ: Br Med J. 2004;328(7430):39.CrossRef Glasziou P, Vandenbroucke J, Chalmers I. Assessing the quality of research. BMJ: Br Med J. 2004;328(7430):39.CrossRef
16.
go back to reference Karystianis G, Buchan I, Nenadic G. Mining characteristics of epidemiological studies from Medline: a case study in obesity. J Biomedical Semant. 2014;5(1):1–1.CrossRef Karystianis G, Buchan I, Nenadic G. Mining characteristics of epidemiological studies from Medline: a case study in obesity. J Biomedical Semant. 2014;5(1):1–1.CrossRef
17.
go back to reference Karystianis G, Thayer K, Wolfe M, et al. Evaluation of a rule-based method for epidemiological document classification towards the automation of systematic reviews. J Biomed Inform. 2017;70:27–34.CrossRefPubMed Karystianis G, Thayer K, Wolfe M, et al. Evaluation of a rule-based method for epidemiological document classification towards the automation of systematic reviews. J Biomed Inform. 2017;70:27–34.CrossRefPubMed
20.
go back to reference Tooth L, Ware R, Bain C, Purdie DM, Dobson A. Quality of reporting of observational longitudinal research. Am J Epidemiol. 2005;161(3):280–8.CrossRefPubMed Tooth L, Ware R, Bain C, Purdie DM, Dobson A. Quality of reporting of observational longitudinal research. Am J Epidemiol. 2005;161(3):280–8.CrossRefPubMed
21.
go back to reference Xu R, Garten Y, Supekar KS, Das AK, Altman RB, Garber AM. Extracting subject demographic information from abstracts of randomised clinical trial reports, in: Medinfo 2007: Proceedings of the 12th World Congress on Health (Medical) Informatics; Building Sustainable Health Systems, IOS Press, 2007. Xu R, Garten Y, Supekar KS, Das AK, Altman RB, Garber AM. Extracting subject demographic information from abstracts of randomised clinical trial reports, in: Medinfo 2007: Proceedings of the 12th World Congress on Health (Medical) Informatics; Building Sustainable Health Systems, IOS Press, 2007.
22.
go back to reference De Bruijn B, Carini S, Kiritchenko S, Martin J, Sim I. Automated information extraction of key trial design elements from clinical trial publications, in: AMIA Annual Symposium Proceedings; 2008: American Medical Informatics Association. De Bruijn B, Carini S, Kiritchenko S, Martin J, Sim I. Automated information extraction of key trial design elements from clinical trial publications, in: AMIA Annual Symposium Proceedings; 2008: American Medical Informatics Association.
23.
go back to reference Luo Z, Johnson SB, Lai AM, Weng C. Extracting temporal constraints from clinical research eligibility criteria using conditional random fields. in: AMIA Annu Symp Proc; 2011. Luo Z, Johnson SB, Lai AM, Weng C. Extracting temporal constraints from clinical research eligibility criteria using conditional random fields. in: AMIA Annu Symp Proc; 2011.
24.
go back to reference Luo Z, Miotto R, Weng C. A human–computer collaborative approach to identifying common data elements in clinical trial eligibility criteria. J Biomed Inf. 2013;46(1):33–9.CrossRef Luo Z, Miotto R, Weng C. A human–computer collaborative approach to identifying common data elements in clinical trial eligibility criteria. J Biomed Inf. 2013;46(1):33–9.CrossRef
25.
go back to reference Canese K, Weis S. PubMed: the bibliographic database. The NCBI handbook. 2013. Canese K, Weis S. PubMed: the bibliographic database. The NCBI handbook. 2013.
26.
go back to reference Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6.CrossRefPubMedPubMedCentral
27.
go back to reference Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. BMJ Evidence-Based Med. 2016;21(4):125–7.CrossRef Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. BMJ Evidence-Based Med. 2016;21(4):125–7.CrossRef
28.
go back to reference Simpson PL, Simpson M, Adily A, et al. Prison cell spatial density and infectious and communicable diseases: a systematic review. BMJ open. 2019;9(7):e026806.CrossRefPubMedPubMedCentral Simpson PL, Simpson M, Adily A, et al. Prison cell spatial density and infectious and communicable diseases: a systematic review. BMJ open. 2019;9(7):e026806.CrossRefPubMedPubMedCentral
29.
go back to reference Karystianis G, Lukmanjaya W, Simpson P, et al. An analysis of PubMed abstracts from 1946 to 2021 to identify Organizational affiliations in Epidemiological Criminology: descriptive study. Interact J Med Res. 2022;11(2):e42891.CrossRefPubMedPubMedCentral Karystianis G, Lukmanjaya W, Simpson P, et al. An analysis of PubMed abstracts from 1946 to 2021 to identify Organizational affiliations in Epidemiological Criminology: descriptive study. Interact J Med Res. 2022;11(2):e42891.CrossRefPubMedPubMedCentral
30.
go back to reference Kim JD, Tsujii J. Corpora and their annotations. Text Mining for Biology and Biomedicine. Edited by: Ananiadou S, McNaught J. 2006, Artech House, ISBN 1-5053-984-X. Kim JD, Tsujii J. Corpora and their annotations. Text Mining for Biology and Biomedicine. Edited by: Ananiadou S, McNaught J. 2006, Artech House, ISBN 1-5053-984-X.
32.
go back to reference Tu SW, Carini S, Rector A, Maccallum P, Toujilov I, Harris S, Sim I. OCRe: an ontology of clinical research. In11th International Protege Conference 2009 Jun. Tu SW, Carini S, Rector A, Maccallum P, Toujilov I, Harris S, Sim I. OCRe: an ontology of clinical research. In11th International Protege Conference 2009 Jun.
34.
go back to reference Karystianis G, Simpson P, Lukmanjaya W, Ginnivan N, Nenadic G, Buchan I, Butler T. Automatic extraction of Research themes in Epidemiological Criminology from PubMed abstracts from 1946 to 2020: text mining study. JMIR Formative Res. 2023;7:e49721.CrossRef Karystianis G, Simpson P, Lukmanjaya W, Ginnivan N, Nenadic G, Buchan I, Butler T. Automatic extraction of Research themes in Epidemiological Criminology from PubMed abstracts from 1946 to 2020: text mining study. JMIR Formative Res. 2023;7:e49721.CrossRef
37.
go back to reference Hartley J. Current findings from research on structured abstracts. J Med Libr Association. 2004;92(3):368.ADS Hartley J. Current findings from research on structured abstracts. J Med Libr Association. 2004;92(3):368.ADS
38.
go back to reference Sharma S, Harrison JE. Structured abstracts: do they improve the quality of information in abstracts? Am J Orthod Dentofac Orthop. 2006;130(4):523–30.CrossRef Sharma S, Harrison JE. Structured abstracts: do they improve the quality of information in abstracts? Am J Orthod Dentofac Orthop. 2006;130(4):523–30.CrossRef
39.
go back to reference Martin L, Hutchens M, Hawkins C, Radnov A. How much do clinical trials cost. Nat Rev Drug Discov. 2017;16(6):381–2.CrossRefPubMed Martin L, Hutchens M, Hawkins C, Radnov A. How much do clinical trials cost. Nat Rev Drug Discov. 2017;16(6):381–2.CrossRefPubMed
40.
go back to reference Pocock SJ, Collier TJ, Dandreo KJ, de Stavola BL, Goldman MB, Kalish LA, Kasten LE, McCormack VA. Issues in the reporting of epidemiological studies: a survey of recent practice. BMJ. 2004;329(7471):883.CrossRefPubMedPubMedCentral Pocock SJ, Collier TJ, Dandreo KJ, de Stavola BL, Goldman MB, Kalish LA, Kasten LE, McCormack VA. Issues in the reporting of epidemiological studies: a survey of recent practice. BMJ. 2004;329(7471):883.CrossRefPubMedPubMedCentral
41.
go back to reference Papanikolaou PN, Christidi GD, Ioannidis JP. Comparison of evidence on harms of medical interventions in randomised and nonrandomised studies. CMAJ. 2006;174:635–41.CrossRefPubMedPubMedCentral Papanikolaou PN, Christidi GD, Ioannidis JP. Comparison of evidence on harms of medical interventions in randomised and nonrandomised studies. CMAJ. 2006;174:635–41.CrossRefPubMedPubMedCentral
Metadata
Title
An analysis of published study designs in PubMed prisoner health abstracts from 1963 to 2023: a text mining study
Authors
George Karystianis
Wilson Lukmanjaya
Iain Buchan
Paul Simpson
Natasha Ginnivan
Goran Nenadic
Tony Butler
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2024
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-024-02186-6

Other articles of this Issue 1/2024

BMC Medical Research Methodology 1/2024 Go to the issue