Skip to main content
Top
Published in: Journal of Occupational Rehabilitation 4/2023

21-03-2023

Precision and Recall of Search Strategies for Identifying Studies on Work-Related Psychosocial Risk Factors in PubMed

Authors: Jean-Francois Gehanno, Isabelle Thaon, Carole Pelissier, Laetitia Rollin

Published in: Journal of Occupational Rehabilitation | Issue 4/2023

Login to get access

Abstract

Purpose

This study aims to report on the effectiveness of various search strategies and keywords to find studies on work-related psychosocial risk factors (PRF) in the PubMed bibliographic database.

Methods

We first selected by hand-searching 191articles published on PRF and indexed in PubMed. We extracted 30 relevant MeSH terms and 38 additional textwords. We then searched PubMed combining these 68 keywords and 27 general keywords on work-related factors. Among the 2953 articles published in January 2020, we identified 446 articles concerning exposure to PRF, which were gathered in a Gold Standard database. We then computed the Recall, Precision, and Number Needed to Read of each keyword or combination of keywords.

Results

Overall, 189 search-words alone or in combination were tested. The highest Recall with a single MeSH term or textword was 43% and 35%, respectively. Subsequently, we developed two different search strings, one optimizing Recall while keeping Precision acceptable (Recall 98.2%, Precision 5.9%, NNR 16.9) and one optimizing Precision while keeping Recall acceptable (Recall 73.1%, Precision 25.5%, NNR 9.7).

Conclusions

No single MeSH term is available to identify relevant studies on PRF in PubMed. Locating these types of studies requires the use of various MeSH and non-MeSH terms in combination to obtain a satisfactory Recall. Nevertheless, enhancing the Recall of search strategies may lead to lower Precision, and higher NNR, although with a non-linear trend. This factor must be taken into consideration when searching PubMed.
Literature
1.
go back to reference Niedhammer I, Bertrais S, Witt K. Psychosocial work exposures and health outcomes: a meta-review of 72 literature reviews with meta-analysis. Scand J Work Environ Health. 2021;47:489–508.CrossRefPubMedPubMedCentral Niedhammer I, Bertrais S, Witt K. Psychosocial work exposures and health outcomes: a meta-review of 72 literature reviews with meta-analysis. Scand J Work Environ Health. 2021;47:489–508.CrossRefPubMedPubMedCentral
2.
go back to reference Duchaine CS, Aubé K, Gilbert-Ouimet M, Vézina M, Ndjaboué R, Massamba V, et al. Psychosocial stressors at work and the risk of sickness absence due to a diagnosed mental disorder: a systematic review and meta-analysis. JAMA Psychiat. 2020;77:842–851.CrossRef Duchaine CS, Aubé K, Gilbert-Ouimet M, Vézina M, Ndjaboué R, Massamba V, et al. Psychosocial stressors at work and the risk of sickness absence due to a diagnosed mental disorder: a systematic review and meta-analysis. JAMA Psychiat. 2020;77:842–851.CrossRef
3.
go back to reference European Agency for Safety and Health at Work, Brun E, Milczarek M, editors. Expert forecast on emerging psychosocial risks related to occupational safety and health. Luxembourg: Office for Official Publications of the European Communities; 2007. European Agency for Safety and Health at Work, Brun E, Milczarek M, editors. Expert forecast on emerging psychosocial risks related to occupational safety and health. Luxembourg: Office for Official Publications of the European Communities; 2007.
4.
go back to reference Dunn K, Marshall JG, Wells AL, Backus JEB. Examining the role of MEDLINE as a patient care information resource: an analysis of data from the Value of Libraries study. J Med Libr Assoc. 2017;105:336–346.CrossRefPubMedPubMedCentral Dunn K, Marshall JG, Wells AL, Backus JEB. Examining the role of MEDLINE as a patient care information resource: an analysis of data from the Value of Libraries study. J Med Libr Assoc. 2017;105:336–346.CrossRefPubMedPubMedCentral
5.
go back to reference Sampson M, de Bruijn B, Urquhart C, Shojania K. Complementary approaches to searching MEDLINE may be sufficient for updating systematic reviews. J Clin Epidemiol. 2016;78:108–115.CrossRefPubMed Sampson M, de Bruijn B, Urquhart C, Shojania K. Complementary approaches to searching MEDLINE may be sufficient for updating systematic reviews. J Clin Epidemiol. 2016;78:108–115.CrossRefPubMed
6.
go back to reference Rollin L, Darmoni S, Caillard J-F, Gehanno J-F. Searching for high-quality articles about intervention studies in occupational health–what is really missed when using only the Medline database? Scand J Work Environ Health. 2010;36:484–487.CrossRefPubMed Rollin L, Darmoni S, Caillard J-F, Gehanno J-F. Searching for high-quality articles about intervention studies in occupational health–what is really missed when using only the Medline database? Scand J Work Environ Health. 2010;36:484–487.CrossRefPubMed
7.
go back to reference Halladay CW, Trikalinos TA, Schmid IT, Schmid CH, Dahabreh IJ. Using data sources beyond PubMed has a modest impact on the results of systematic reviews of therapeutic interventions. J Clin Epidemiol. 2015;68:1076–1084.CrossRefPubMed Halladay CW, Trikalinos TA, Schmid IT, Schmid CH, Dahabreh IJ. Using data sources beyond PubMed has a modest impact on the results of systematic reviews of therapeutic interventions. J Clin Epidemiol. 2015;68:1076–1084.CrossRefPubMed
8.
go back to reference Cooper C, Varley-Campbell J, Booth A, Britten N, Garside R. Systematic review identifies six metrics and one method for assessing literature search effectiveness but no consensus on appropriate use. J Clin Epidemiol. 2018;99:53–63.CrossRefPubMed Cooper C, Varley-Campbell J, Booth A, Britten N, Garside R. Systematic review identifies six metrics and one method for assessing literature search effectiveness but no consensus on appropriate use. J Clin Epidemiol. 2018;99:53–63.CrossRefPubMed
9.
go back to reference Mattioli S, Zanardi F, Baldasseroni A, Schaafsma F, Cooke RMT, Mancini G, et al. Search strings for the study of putative occupational determinants of disease. Occup Environ Med. 2010;67:436–443.CrossRefPubMed Mattioli S, Zanardi F, Baldasseroni A, Schaafsma F, Cooke RMT, Mancini G, et al. Search strings for the study of putative occupational determinants of disease. Occup Environ Med. 2010;67:436–443.CrossRefPubMed
10.
go back to reference Mattioli S, Gori D, Di Gregori V, Ricotta L, Baldasseroni A, Farioli A, et al. PubMed search strings for the study of agricultural workers’ diseases. Am J Ind Med. 2013;56:1473–1481.CrossRefPubMed Mattioli S, Gori D, Di Gregori V, Ricotta L, Baldasseroni A, Farioli A, et al. PubMed search strings for the study of agricultural workers’ diseases. Am J Ind Med. 2013;56:1473–1481.CrossRefPubMed
11.
go back to reference Mattioli S, Farioli A, Cooke RMT, Baldasseroni A, Ruotsalainen J, Placidi D, et al. Hidden effectiveness? Results of hand-searching Italian language journals for occupational health interventions. Occup Environ Med. 2012;69:522–524.CrossRefPubMed Mattioli S, Farioli A, Cooke RMT, Baldasseroni A, Ruotsalainen J, Placidi D, et al. Hidden effectiveness? Results of hand-searching Italian language journals for occupational health interventions. Occup Environ Med. 2012;69:522–524.CrossRefPubMed
12.
go back to reference Gehanno J-F, Rollin L, Le Jean T, Louvel A, Darmoni S, Shaw W. Precision and recall of search strategies for identifying studies on return-to-work in Medline. J Occup Rehabil. 2009;19:223–230.CrossRefPubMed Gehanno J-F, Rollin L, Le Jean T, Louvel A, Darmoni S, Shaw W. Precision and recall of search strategies for identifying studies on return-to-work in Medline. J Occup Rehabil. 2009;19:223–230.CrossRefPubMed
13.
go back to reference Verbeek J, Salmi J, Pasternack I, Jauhiainen M, Laamanen I, Schaafsma F, et al. A search strategy for occupational health intervention studies. Occup Environ Med. 2005;62:682–687.CrossRefPubMedPubMedCentral Verbeek J, Salmi J, Pasternack I, Jauhiainen M, Laamanen I, Schaafsma F, et al. A search strategy for occupational health intervention studies. Occup Environ Med. 2005;62:682–687.CrossRefPubMedPubMedCentral
14.
go back to reference Taouk Y, Spittal MJ, LaMontagne AD, Milner AJ. Psychosocial work stressors and risk of all-cause and coronary heart disease mortality: a systematic review and meta-analysis. Scand J Work Environ Health. 2020;46:19–31.CrossRefPubMed Taouk Y, Spittal MJ, LaMontagne AD, Milner AJ. Psychosocial work stressors and risk of all-cause and coronary heart disease mortality: a systematic review and meta-analysis. Scand J Work Environ Health. 2020;46:19–31.CrossRefPubMed
15.
go back to reference van der Molen HF, Nieuwenhuijsen K, Frings-Dresen MHW, de Groene G. Work-related psychosocial risk factors for stress-related mental disorders: an updated systematic review and meta-analysis. BMJ Open. 2020;10:e034849.CrossRefPubMedPubMedCentral van der Molen HF, Nieuwenhuijsen K, Frings-Dresen MHW, de Groene G. Work-related psychosocial risk factors for stress-related mental disorders: an updated systematic review and meta-analysis. BMJ Open. 2020;10:e034849.CrossRefPubMedPubMedCentral
16.
go back to reference Schaafsma F, Hulshof C, Verbeek J, Bos J, Dyserinck H, van Dijk F. Developing search strategies in Medline on the occupational origin of diseases. Am J Ind Med. 2006;49:127–137.CrossRefPubMed Schaafsma F, Hulshof C, Verbeek J, Bos J, Dyserinck H, van Dijk F. Developing search strategies in Medline on the occupational origin of diseases. Am J Ind Med. 2006;49:127–137.CrossRefPubMed
17.
go back to reference Kok R, Verbeek JAHM, Faber B, Dijk FJH, Hoving JL. A search strategy to identify studies on the prognosis of work disability: a diagnostic test framework. BMJ Open. 2015;5:e006315.CrossRefPubMedPubMedCentral Kok R, Verbeek JAHM, Faber B, Dijk FJH, Hoving JL. A search strategy to identify studies on the prognosis of work disability: a diagnostic test framework. BMJ Open. 2015;5:e006315.CrossRefPubMedPubMedCentral
18.
go back to reference van de Glind EMM, van Munster BC, Spijker R, Scholten RJPM, Hooft L. Search filters to identify geriatric medicine in Medline. J Am Med Inform Assoc. 2012;19:468–472.CrossRefPubMed van de Glind EMM, van Munster BC, Spijker R, Scholten RJPM, Hooft L. Search filters to identify geriatric medicine in Medline. J Am Med Inform Assoc. 2012;19:468–472.CrossRefPubMed
19.
go back to reference Wilczynski NL, Haynes RB. Optimal search filters for detecting quality improvement studies in Medline. BMJ Qual Saf. 2010;19:e31–e31.CrossRef Wilczynski NL, Haynes RB. Optimal search filters for detecting quality improvement studies in Medline. BMJ Qual Saf. 2010;19:e31–e31.CrossRef
20.
go back to reference Wilczynski NL. Optimal search strategies for detecting health services research studies in MEDLINE. Can Med Assoc J. 2004;171:1179–1185.CrossRef Wilczynski NL. Optimal search strategies for detecting health services research studies in MEDLINE. Can Med Assoc J. 2004;171:1179–1185.CrossRef
21.
go back to reference Haafkens J, Moerman C, Schuring M, van Dijk F. Searching bibliographic databases for literature on chronic disease and work participation. Occup Med (Lond). 2006;56:39–45.CrossRefPubMed Haafkens J, Moerman C, Schuring M, van Dijk F. Searching bibliographic databases for literature on chronic disease and work participation. Occup Med (Lond). 2006;56:39–45.CrossRefPubMed
22.
go back to reference Gehanno JF, Paris C, Thirion B, Caillard JF. Assessment of bibliographic databases performance in information retrieval for occupational and environmental toxicology. Occup Environ Med. 1998;55:562–566.CrossRefPubMedPubMedCentral Gehanno JF, Paris C, Thirion B, Caillard JF. Assessment of bibliographic databases performance in information retrieval for occupational and environmental toxicology. Occup Environ Med. 1998;55:562–566.CrossRefPubMedPubMedCentral
24.
go back to reference Wagner M, Rosumeck S, Küffmeier C, Döring K, Euler U. A validation study revealed differences in design and performance of MEDLINE search filters for qualitative research. J Clin Epidemiol. 2020;120:17–24.CrossRefPubMed Wagner M, Rosumeck S, Küffmeier C, Döring K, Euler U. A validation study revealed differences in design and performance of MEDLINE search filters for qualitative research. J Clin Epidemiol. 2020;120:17–24.CrossRefPubMed
25.
go back to reference Rice DB, Kloda LA, Levis B, Qi B, Kingsland E, Thombs BD. Are MEDLINE searches sufficient for systematic reviews and meta-analyses of the diagnostic accuracy of depression screening tools? A review of meta-analyses. J Psychosom Res. 2016;87:7–13.CrossRefPubMed Rice DB, Kloda LA, Levis B, Qi B, Kingsland E, Thombs BD. Are MEDLINE searches sufficient for systematic reviews and meta-analyses of the diagnostic accuracy of depression screening tools? A review of meta-analyses. J Psychosom Res. 2016;87:7–13.CrossRefPubMed
Metadata
Title
Precision and Recall of Search Strategies for Identifying Studies on Work-Related Psychosocial Risk Factors in PubMed
Authors
Jean-Francois Gehanno
Isabelle Thaon
Carole Pelissier
Laetitia Rollin
Publication date
21-03-2023
Publisher
Springer US
Published in
Journal of Occupational Rehabilitation / Issue 4/2023
Print ISSN: 1053-0487
Electronic ISSN: 1573-3688
DOI
https://doi.org/10.1007/s10926-023-10110-w

Other articles of this Issue 4/2023

Journal of Occupational Rehabilitation 4/2023 Go to the issue