Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

Methods for conducting systematic reviews of risk factors in low- and middle-income countries

Authors: Yulia Shenderovich, Manuel Eisner, Christopher Mikton, Frances Gardner, Jianghong Liu, Joseph Murray

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Rates of youth violence are disproportionately high in many low- and middle-income countries [LMICs] but existing reviews of risk factors focus almost exclusively on high-income countries. Different search strategies, including non-English language searches, might be required to identify relevant evidence in LMICs. This paper discusses methodological issues in systematic reviews aiming to include evidence from LMICs, using the example of a recent review of risk factors for child conduct problems and youth violence in LMICs.

Methods

We searched the main international databases, such as PsycINFO, Medline and EMBASE in English, as well as 12 regional databases in Arabic, Chinese, English, French, Spanish, Portuguese and Russian. In addition, we used internet search engines and Google Scholar, and contacted over 200 researchers and organizations to identify potentially eligible studies in LMICs.

Results

The majority of relevant studies were identified in the mainstream databases, but additional studies were also found through regional databases, such as CNKI, Wangfang, LILACS and SciELO. Overall, 85 % of eligible studies were in English, and 15 % were reported in Chinese, Spanish, Portuguese, Russian or French. Among eligible studies in languages other than English, two-thirds were identified only by regional databases and one-third was also indexed in the main international databases.

Conclusions

There are many studies on child conduct problems and youth violence in LMICs which have not been included in prior reviews. Most research on these subjects in LMICs has been produced in the last two-three decades and mostly in middle-income countries, such as China, Brazil, Turkey, South Africa and Russia. Based on our findings, it appears that many studies of child conduct problems and youth violence in LMICs are reported in English, Chinese, Spanish and Portuguese, but few such studies are published in French, Arabic or Russian. If non-English language searches and screening had not been conducted in the current review, 15 % of eligible studies would have been missed. Although there are benefits to non-English language searches and the inclusion of non-English studies in meta-analyses, systematic reviewers also need to consider the resources required to incorporate multi-lingual research.
Appendix
Available only for authorised users
Literature
2.
go back to reference Ezzati M, Lopez AD, Rodgers A, Vander Hoorn S, Murray CJ. Selected major risk factors and global and regional burden of disease. Lancet. 2002;360(9343):1347–60.CrossRefPubMed Ezzati M, Lopez AD, Rodgers A, Vander Hoorn S, Murray CJ. Selected major risk factors and global and regional burden of disease. Lancet. 2002;360(9343):1347–60.CrossRefPubMed
3.
go back to reference Kraemer HC, Kraemer-Lowe KK, Kupfer DJ. To your health: How to understand what research tells us about risk. New York: Oxford University Press; 2005. Kraemer HC, Kraemer-Lowe KK, Kupfer DJ. To your health: How to understand what research tells us about risk. New York: Oxford University Press; 2005.
4.
go back to reference Patel V, Flisher AJ, Nikapota A, Malhotra S. Promoting child and adolescent mental health in low and middle income countries. J Child Psychol Psychiatry. 2008;49(3):313–34.CrossRefPubMed Patel V, Flisher AJ, Nikapota A, Malhotra S. Promoting child and adolescent mental health in low and middle income countries. J Child Psychol Psychiatry. 2008;49(3):313–34.CrossRefPubMed
5.
go back to reference Sharan P, Gallo C, Gureje O, Lamberte E, Mari JJ, Mazzotti G, et al. Mental health research priorities in low-and middle-income countries of Africa, Asia, Latin America and the Caribbean. Br J Psychiatry. 2009;195(4):354–63.CrossRefPubMedPubMedCentral Sharan P, Gallo C, Gureje O, Lamberte E, Mari JJ, Mazzotti G, et al. Mental health research priorities in low-and middle-income countries of Africa, Asia, Latin America and the Caribbean. Br J Psychiatry. 2009;195(4):354–63.CrossRefPubMedPubMedCentral
6.
go back to reference Mikton C. Preventing violence and reducing its impact: how development agencies can help. Inj Prev. 2008;14(4):279-.CrossRefPubMed Mikton C. Preventing violence and reducing its impact: how development agencies can help. Inj Prev. 2008;14(4):279-.CrossRefPubMed
7.
go back to reference Murray J, Cerqueira DR, Kahn T. Crime and violence in Brazil: Systematic review of time trends, prevalence rates and risk factors. Aggress Violent Behav. 2013;18(5):471–83.CrossRefPubMedPubMedCentral Murray J, Cerqueira DR, Kahn T. Crime and violence in Brazil: Systematic review of time trends, prevalence rates and risk factors. Aggress Violent Behav. 2013;18(5):471–83.CrossRefPubMedPubMedCentral
8.
go back to reference Haugen GA, Boutros V. The Locust Effect: Why the End of Poverty Requires the End of Violence. New York: Oxford University Press; 2014. Haugen GA, Boutros V. The Locust Effect: Why the End of Poverty Requires the End of Violence. New York: Oxford University Press; 2014.
10.
11.
go back to reference Krug EG et al. eds. World report on violence and health. Geneva: World Health Organization; 2002. Krug EG et al. eds. World report on violence and health. Geneva: World Health Organization; 2002.
12.
go back to reference Fergusson DM, John H,L, Ridder EM. Show me the child at seven: the consequences of conduct problems in childhood for psychosocial functioning in adulthood. J Child Psychol Psychiatry. 2005;46(8):837–49.CrossRefPubMed Fergusson DM, John H,L, Ridder EM. Show me the child at seven: the consequences of conduct problems in childhood for psychosocial functioning in adulthood. J Child Psychol Psychiatry. 2005;46(8):837–49.CrossRefPubMed
13.
go back to reference Colman I, Murray J, Abbott RA, Maughan B, Kuh B, Croudace TJ, et al. Outcomes of conduct problems in adolescence: 40‐year follow‐up of national cohort. BMJ. 2009;338(7688):208–11. doi:10.1136/bmj.a2981. Colman I, Murray J, Abbott RA, Maughan B, Kuh B, Croudace TJ, et al. Outcomes of conduct problems in adolescence: 40‐year follow‐up of national cohort. BMJ. 2009;338(7688):208–11. doi:10.​1136/​bmj.​a2981.
14.
go back to reference Odgers CL, Caspi A, Broadbent JM, Dickson N, Hancox RJ, Harrington H, et al. Prediction of differential adult health burden by conduct problem subtypes in males. Arch Gen Psychiatry. 2007;64(4):476–84.CrossRefPubMed Odgers CL, Caspi A, Broadbent JM, Dickson N, Hancox RJ, Harrington H, et al. Prediction of differential adult health burden by conduct problem subtypes in males. Arch Gen Psychiatry. 2007;64(4):476–84.CrossRefPubMed
15.
go back to reference Farrington DP, Welsh BC. Saving children from a life of crime: Early risk factors and effective interventions. New York: Oxford University Press; 2007. Farrington DP, Welsh BC. Saving children from a life of crime: Early risk factors and effective interventions. New York: Oxford University Press; 2007.
16.
go back to reference Hawkins JD, Herrenkohl T, Farrington DP, Brewer D, Catalano RF, Harachi TW. A review of predictors of youth violence. 1998. Hawkins JD, Herrenkohl T, Farrington DP, Brewer D, Catalano RF, Harachi TW. A review of predictors of youth violence. 1998.
17.
go back to reference Murray J, Farrington DP. Risk factors for conduct disorder and delinquency: key findings from longitudinal studies. Can J Psychiatry. 2010;55(10):633–42.PubMed Murray J, Farrington DP. Risk factors for conduct disorder and delinquency: key findings from longitudinal studies. Can J Psychiatry. 2010;55(10):633–42.PubMed
18.
go back to reference Ellis L, Beaver KM, Wright J. Handbook of crime correlates. San Diego, CA: Academic Press; 2009. Ellis L, Beaver KM, Wright J. Handbook of crime correlates. San Diego, CA: Academic Press; 2009.
19.
go back to reference Mari J, Patel V, Kieling C, Razzouk D, Tyrer P, Herrman H. The 5/95 gap in the indexation of psychiatric journals of low‐and middle‐income countries. Acta Psychiatr Scand. 2010;121(2):152–6.CrossRefPubMedPubMedCentral Mari J, Patel V, Kieling C, Razzouk D, Tyrer P, Herrman H. The 5/95 gap in the indexation of psychiatric journals of low‐and middle‐income countries. Acta Psychiatr Scand. 2010;121(2):152–6.CrossRefPubMedPubMedCentral
21.
go back to reference Xia J, Wright J, Adams CE. Five large Chinese biomedical bibliographic databases: accessibility and coverage. Health Info Libr J. 2008;25(1):55–61.CrossRefPubMed Xia J, Wright J, Adams CE. Five large Chinese biomedical bibliographic databases: accessibility and coverage. Health Info Libr J. 2008;25(1):55–61.CrossRefPubMed
22.
go back to reference Littell JH. Guest Editor’s Introduction to Special Issue: The Science and Practice of Research Synthesis. J Society Social Work Res. 2013;4(4):292–9.CrossRef Littell JH. Guest Editor’s Introduction to Special Issue: The Science and Practice of Research Synthesis. J Society Social Work Res. 2013;4(4):292–9.CrossRef
23.
go back to reference Lefebvre C, Manheimer E, Glanville J. Chapter 6. Searching for studies. In: Higgins J, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. www.cochrane-handbook.org: The Cochrane Collaboration; 2011. Lefebvre C, Manheimer E, Glanville J. Chapter 6. Searching for studies. In: Higgins J, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. www.​cochrane-handbook.​org: The Cochrane Collaboration; 2011.
24.
go back to reference Löhönen J, Isohanni M, Nieminen P, Miettunen J. Coverage of the bibliographic 569 databases in mental health research. Nord J Psychiatry. 2010;64(3):181–8. Löhönen J, Isohanni M, Nieminen P, Miettunen J. Coverage of the bibliographic 569 databases in mental health research. Nord J Psychiatry. 2010;64(3):181–8.
26.
go back to reference Sharan ,Saxena S. World mental health: role of journals edited in developing countries. J Indian Assoc Child Adolesc Ment Health. 2006;2(1):1–8. Sharan ,Saxena S. World mental health: role of journals edited in developing countries. J Indian Assoc Child Adolesc Ment Health. 2006;2(1):1–8.
27.
go back to reference Hughes K, Bellis MA, Hardcastle KA, Butchart A, Dahlberg LL, Mercy JA, et al. Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review. Aggress Violent Behav. 2014;19(6):655–62.CrossRef Hughes K, Bellis MA, Hardcastle KA, Butchart A, Dahlberg LL, Mercy JA, et al. Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review. Aggress Violent Behav. 2014;19(6):655–62.CrossRef
28.
go back to reference Grégoire G, Derderian F, Le Lorier J. Selecting the language of the publications included in a meta-analysis: is there a Tower of Babel bias? J Clin Epidemiol. 1995;48(1):159–63.CrossRefPubMed Grégoire G, Derderian F, Le Lorier J. Selecting the language of the publications included in a meta-analysis: is there a Tower of Babel bias? J Clin Epidemiol. 1995;48(1):159–63.CrossRefPubMed
29.
go back to reference Egger M, Smith GD. Bias in location and selection of studies. Br Med J. 1998;316(7124):61.CrossRef Egger M, Smith GD. Bias in location and selection of studies. Br Med J. 1998;316(7124):61.CrossRef
30.
go back to reference Pham B, Klassen TP, Lawson ML, Moher D. Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary. J Clin Epidemiol. 2005;58(8):769–76. e2.CrossRefPubMed Pham B, Klassen TP, Lawson ML, Moher D. Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary. J Clin Epidemiol. 2005;58(8):769–76. e2.CrossRefPubMed
31.
go back to reference Sterne JA, Egger M, Moher D. Addressing reporting biases. Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. 2008. p. 297–333.CrossRef Sterne JA, Egger M, Moher D. Addressing reporting biases. Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series. 2008. p. 297–333.CrossRef
32.
go back to reference Morrison A, Polisena J, Husereau D, Moulton K, Clark M, Fiander M, et al. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int J Technol Assess Health Care. 2012;28(02):138–44.CrossRefPubMed Morrison A, Polisena J, Husereau D, Moulton K, Clark M, Fiander M, et al. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int J Technol Assess Health Care. 2012;28(02):138–44.CrossRefPubMed
33.
go back to reference Busse JW, Bruno P, Malik K, Connell G, Torrance D, Ngo T, et al. An efficient strategy allowed English-speaking reviewers to identify foreign-language articles eligible for a systematic review. J Clin Epidemiol. 2014;67(5):547–53.CrossRefPubMed Busse JW, Bruno P, Malik K, Connell G, Torrance D, Ngo T, et al. An efficient strategy allowed English-speaking reviewers to identify foreign-language articles eligible for a systematic review. J Clin Epidemiol. 2014;67(5):547–53.CrossRefPubMed
34.
go back to reference McAuley L, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? Lancet. 2000;356(9237):1228–31.CrossRefPubMed McAuley L, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? Lancet. 2000;356(9237):1228–31.CrossRefPubMed
36.
go back to reference Betrán AP, Say L, Gülmezoglu AM, Allen T, Hampson L. Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol. 2005;5(1):6.CrossRefPubMedPubMedCentral Betrán AP, Say L, Gülmezoglu AM, Allen T, Hampson L. Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol. 2005;5(1):6.CrossRefPubMedPubMedCentral
37.
go back to reference Hammerstrøm K, Wade A, Hanz K, Jørgensen A. Searching for studies: Information retrieval methods group policy brief. Information retrieval methods group policy brief Oslo. Norway: The Campbell Collaboration; 2009. doi:10.4073/pb.2009.1. Hammerstrøm K, Wade A, Hanz K, Jørgensen A. Searching for studies: Information retrieval methods group policy brief. Information retrieval methods group policy brief Oslo. Norway: The Campbell Collaboration; 2009. doi:10.​4073/​pb.​2009.​1.
38.
go back to reference Sampson M, Tetzlaff J, Urquhart C. Precision of healthcare systematic review searches in a cross‐sectional sample. Res Synth Methods. 2011;2(2):119–25.CrossRefPubMed Sampson M, Tetzlaff J, Urquhart C. Precision of healthcare systematic review searches in a cross‐sectional sample. Res Synth Methods. 2011;2(2):119–25.CrossRefPubMed
Metadata
Title
Methods for conducting systematic reviews of risk factors in low- and middle-income countries
Authors
Yulia Shenderovich
Manuel Eisner
Christopher Mikton
Frances Gardner
Jianghong Liu
Joseph Murray
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0134-2

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue