Skip to main content
Top
Published in: Child and Adolescent Psychiatry and Mental Health 1/2011

Open Access 01-12-2011 | Research

The strengths and difficulties questionnaire as a screening instrument for norwegian child and adolescent mental health services, application of UK scoring algorithms

Authors: Per Håkan Brøndbo, Børge Mathiassen, Monica Martinussen, Einar Heiervang, Mads Eriksen, Therese Fjeldmo Moe, Guri Sæther, Siv Kvernmo

Published in: Child and Adolescent Psychiatry and Mental Health | Issue 1/2011

Login to get access

Abstract

Background

The use of screening instruments can reduce waiting lists and increase treatment capacity. The aim of this study was to examine the usefulness of the Strengths and Difficulties Questionnaire (SDQ) with the original UK scoring algorithms, when used as a screening instrument to detect mental health disorders among patients in the Norwegian Child and Adolescent Mental Health Services (CAMHS) North Study.

Methods

A total of 286 outpatients, aged 5 to 18 years, from the CAMHS North Study were assigned diagnoses based on a Development and Well-Being Assessment (DAWBA). The main diagnostic groups (emotional, hyperactivity, conduct and other disorders) were then compared to the SDQ scoring algorithms using two dichotomisation levels: 'possible' and 'probable' levels. Sensitivity, specificity, positive predictive value, negative predictive value, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio (ORD) were calculated.

Results

Sensitivity for the diagnostic categories included was 0.47-0.85 ('probable' dichotomisation level) and 0.81-1.00 ('possible' dichotomisation level). Specificity was 0.52-0.87 ('probable' level) and 0.24-0.58 ('possible' level). The discriminative ability, as measured by ORD, was in the interval for potentially useful tests for hyperactivity disorders and conduct disorders when dichotomised on the 'possible' level.

Conclusions

The usefulness of the SDQ UK-based scoring algorithms in detecting mental health disorders among patients in the CAMHS North Study is only partly supported in the present study. They seem best suited to identify children and adolescents who do not require further psychiatric evaluation, although this as well is problematic from a clinical point of view.
Literature
1.
go back to reference Mathiesen KS, Karevold E, Knudsen AK: [Psychiatric impairment among children and adolescents in Norway]. 2009, Nasjonalt folkehelseinstitutt, Oslo. Norwegian Mathiesen KS, Karevold E, Knudsen AK: [Psychiatric impairment among children and adolescents in Norway]. 2009, Nasjonalt folkehelseinstitutt, Oslo. Norwegian
2.
go back to reference Heiervang E, Stormark KM, Lundervold AJ, Heimann M, Goodman R, Posserud MB, Ullebo AK, Plessen KJ, Bjelland I, Lie SA, Gillberg C: Psychiatric disorders in Norwegian 8- to 10-year-olds: an epidemiological survey of prevalence, risk factors, and service use. J Am Acad Child Adolesc Psychiatry. 2007, 46: 438-447. 10.1097/chi.0b013e31803062bf.CrossRefPubMed Heiervang E, Stormark KM, Lundervold AJ, Heimann M, Goodman R, Posserud MB, Ullebo AK, Plessen KJ, Bjelland I, Lie SA, Gillberg C: Psychiatric disorders in Norwegian 8- to 10-year-olds: an epidemiological survey of prevalence, risk factors, and service use. J Am Acad Child Adolesc Psychiatry. 2007, 46: 438-447. 10.1097/chi.0b013e31803062bf.CrossRefPubMed
3.
go back to reference Ministry of Health and Care Services: St.prp.nr. 63. [About escalation of psychiatric health 1999 - 2006. Changes in the 1998 governmental budget]. 1998, Helse- og omsorgsdepartementet, Oslo Ministry of Health and Care Services: St.prp.nr. 63. [About escalation of psychiatric health 1999 - 2006. Changes in the 1998 governmental budget]. 1998, Helse- og omsorgsdepartementet, Oslo
4.
go back to reference WHO: Towards a common language for functioning, disability and health: ICF. 2002, World Health Organisation, Geneva WHO: Towards a common language for functioning, disability and health: ICF. 2002, World Health Organisation, Geneva
5.
go back to reference Mathai J, Anderson P, Bourne A: Comparing psychiatric diagnoses generated by the Strengths and Difficulties Questionnaire with diagnoses made by clinicians. Aust N Z J Psychiatry. 2004, 38: 639-643. 10.1080/j.1440-1614.2004.01428.x.CrossRefPubMed Mathai J, Anderson P, Bourne A: Comparing psychiatric diagnoses generated by the Strengths and Difficulties Questionnaire with diagnoses made by clinicians. Aust N Z J Psychiatry. 2004, 38: 639-643. 10.1080/j.1440-1614.2004.01428.x.CrossRefPubMed
6.
go back to reference York A, Lamb C: Building and Sustaining Specialist CAMHS. Workforce, Capacity and Functions of Tiers 2, 3 and 4 Specialist Child and Adolescent Mental Health Services Across England, Ireland, Northern Ireland, Scotland and Wales. 2005, Royal College of Psychiatrists York A, Lamb C: Building and Sustaining Specialist CAMHS. Workforce, Capacity and Functions of Tiers 2, 3 and 4 Specialist Child and Adolescent Mental Health Services Across England, Ireland, Northern Ireland, Scotland and Wales. 2005, Royal College of Psychiatrists
7.
go back to reference Warner J: Clinicians' guide to evaluating diagnostic and screening tests in psychiatry. Adv Psychiatr Treat. 2004, 10: 446-454. 10.1192/apt.10.6.446.CrossRef Warner J: Clinicians' guide to evaluating diagnostic and screening tests in psychiatry. Adv Psychiatr Treat. 2004, 10: 446-454. 10.1192/apt.10.6.446.CrossRef
8.
go back to reference Goodman R: The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997, 38: 581-586. 10.1111/j.1469-7610.1997.tb01545.x.CrossRefPubMed Goodman R: The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997, 38: 581-586. 10.1111/j.1469-7610.1997.tb01545.x.CrossRefPubMed
9.
go back to reference Goodman R: The extended version of the Strengths and Difficulties Questionnaire as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry. 1999, 40: 791-799. 10.1111/1469-7610.00494.CrossRefPubMed Goodman R: The extended version of the Strengths and Difficulties Questionnaire as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry. 1999, 40: 791-799. 10.1111/1469-7610.00494.CrossRefPubMed
10.
go back to reference Achenbach TM, Becker A, Dopfner M, Heiervang E, Roessner V, Steinhausen HC, Rothenberger A: Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: research findings, applications, and future directions. J Child Psychol Psychiatry. 2008, 49: 251-275. 10.1111/j.1469-7610.2007.01867.x.CrossRefPubMed Achenbach TM, Becker A, Dopfner M, Heiervang E, Roessner V, Steinhausen HC, Rothenberger A: Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: research findings, applications, and future directions. J Child Psychol Psychiatry. 2008, 49: 251-275. 10.1111/j.1469-7610.2007.01867.x.CrossRefPubMed
11.
go back to reference Hawes DJ, Dadds MR: Australian data and psychometric properties of the Strengths and Difficulties Questionnaire. Aust N Z J Psychiatry. 2004, 38: 644-651. 10.1080/j.1440-1614.2004.01427.x.CrossRefPubMed Hawes DJ, Dadds MR: Australian data and psychometric properties of the Strengths and Difficulties Questionnaire. Aust N Z J Psychiatry. 2004, 38: 644-651. 10.1080/j.1440-1614.2004.01427.x.CrossRefPubMed
12.
go back to reference Goodman R: Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001, 40: 1337-1345. 10.1097/00004583-200111000-00015.CrossRefPubMed Goodman R: Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001, 40: 1337-1345. 10.1097/00004583-200111000-00015.CrossRefPubMed
13.
go back to reference Kashala E, Elgen I, Sommerfelt K, Tylleskar T: Teacher ratings of mental health among school children in Kinshasa, Democratic Republic of Congo. Eur Child Adolesc Psychiatry. 2005, 14: 208-215. 10.1007/s00787-005-0446-y.CrossRefPubMed Kashala E, Elgen I, Sommerfelt K, Tylleskar T: Teacher ratings of mental health among school children in Kinshasa, Democratic Republic of Congo. Eur Child Adolesc Psychiatry. 2005, 14: 208-215. 10.1007/s00787-005-0446-y.CrossRefPubMed
14.
go back to reference Marzocchi GM, Capron C, Di Pietro M, Duran Tauleria E, Duyme M, Frigerio A, Gaspar MF, Hamilton H, Pithon G, Simoes A, Therond C: The use of the Strengths and Difficulties Questionnaire (SDQ) in Southern European countries. Eur Child Adolesc Psychiatry. 2004, 13 (Suppl 2): II40-46.CrossRefPubMed Marzocchi GM, Capron C, Di Pietro M, Duran Tauleria E, Duyme M, Frigerio A, Gaspar MF, Hamilton H, Pithon G, Simoes A, Therond C: The use of the Strengths and Difficulties Questionnaire (SDQ) in Southern European countries. Eur Child Adolesc Psychiatry. 2004, 13 (Suppl 2): II40-46.CrossRefPubMed
15.
go back to reference Woerner W, Becker A, Rothenberger A: Normative data and scale properties of the German parent SDQ. Eur Child Adolesc Psychiatry. 2004, 13 (Suppl 2): II3-10.PubMed Woerner W, Becker A, Rothenberger A: Normative data and scale properties of the German parent SDQ. Eur Child Adolesc Psychiatry. 2004, 13 (Suppl 2): II3-10.PubMed
16.
go back to reference Bourdon KH, Goodman R, Rae DS, Simpson G, Koretz DS: The Strengths and Difficulties Questionnaire: U.S. normative data and psychometric properties. J Am Acad Child Adolesc Psychiatry. 2005, 44: 557-564. 10.1097/01.chi.0000159157.57075.c8.CrossRefPubMed Bourdon KH, Goodman R, Rae DS, Simpson G, Koretz DS: The Strengths and Difficulties Questionnaire: U.S. normative data and psychometric properties. J Am Acad Child Adolesc Psychiatry. 2005, 44: 557-564. 10.1097/01.chi.0000159157.57075.c8.CrossRefPubMed
17.
go back to reference Obel C, Heiervang E, Rodriguez A, Heyerdahl S, Smedje H, Sourander A, Guethmundsson OO, Clench-Aas J, Christensen E, Heian F, Mathiesen KS, Magnusson P, Njarethvik U, Koskelainen M, Ronning JA, Stormark KM, Olsen J: The Strengths and Difficulties Questionnaire in the Nordic countries. Eur Child Adolesc Psychiatry. 2004, 13 (Suppl 2): II32-39.PubMed Obel C, Heiervang E, Rodriguez A, Heyerdahl S, Smedje H, Sourander A, Guethmundsson OO, Clench-Aas J, Christensen E, Heian F, Mathiesen KS, Magnusson P, Njarethvik U, Koskelainen M, Ronning JA, Stormark KM, Olsen J: The Strengths and Difficulties Questionnaire in the Nordic countries. Eur Child Adolesc Psychiatry. 2004, 13 (Suppl 2): II32-39.PubMed
18.
go back to reference Goodman R, Ford T, Simmons H, Gatward R, Meltzer H: Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry. 2000, 177: 534-539. 10.1192/bjp.177.6.534.CrossRefPubMed Goodman R, Ford T, Simmons H, Gatward R, Meltzer H: Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry. 2000, 177: 534-539. 10.1192/bjp.177.6.534.CrossRefPubMed
19.
go back to reference Hysing M, Elgen I, Gillberg C, Lie SA, Lundervold AJ: Chronic physical illness and mental health in children. Results from a large-scale population study. J Child Psychol Psychiatry. 2007, 48: 785-792. 10.1111/j.1469-7610.2007.01755.x.CrossRefPubMed Hysing M, Elgen I, Gillberg C, Lie SA, Lundervold AJ: Chronic physical illness and mental health in children. Results from a large-scale population study. J Child Psychol Psychiatry. 2007, 48: 785-792. 10.1111/j.1469-7610.2007.01755.x.CrossRefPubMed
20.
go back to reference Krogh F, Kvello Bukten MI: Activity data for Child and Adolescent Mental Health Services 2010. 2011, Helsedirektoratet, Oslo Krogh F, Kvello Bukten MI: Activity data for Child and Adolescent Mental Health Services 2010. 2011, Helsedirektoratet, Oslo
21.
go back to reference Goodman R, Renfrew D, Mullick M: Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry. 2000, 9: 129-134. 10.1007/s007870050008.CrossRefPubMed Goodman R, Renfrew D, Mullick M: Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry. 2000, 9: 129-134. 10.1007/s007870050008.CrossRefPubMed
22.
go back to reference Goodman R, Ford T, Richards H, Gatward R, Meltzer H: The Development and Well-Being Assessment: Description and Initial Validation of an Integrated Assessment of Child and Adolescent Psychopathology. J Child Psychol Psychiatry. 2000, 41: 645-655. 10.1111/j.1469-7610.2000.tb02345.x.CrossRefPubMed Goodman R, Ford T, Richards H, Gatward R, Meltzer H: The Development and Well-Being Assessment: Description and Initial Validation of an Integrated Assessment of Child and Adolescent Psychopathology. J Child Psychol Psychiatry. 2000, 41: 645-655. 10.1111/j.1469-7610.2000.tb02345.x.CrossRefPubMed
23.
go back to reference Meltzer H, Gatward R, Goodman R, Ford T: Mental health of children and adolescents in Great Britain. Int Rev Psychiatry. 2003, 15: 185-187. 10.1080/0954026021000046155.CrossRefPubMed Meltzer H, Gatward R, Goodman R, Ford T: Mental health of children and adolescents in Great Britain. Int Rev Psychiatry. 2003, 15: 185-187. 10.1080/0954026021000046155.CrossRefPubMed
24.
go back to reference Ford T, Goodman R, Meltzer H: The British Child and Adolescent Mental Health Survey 1999: The Prevalence of DSM-IV Disorders. J Am Acad Child Adolesc Psychiatry. 2003, 42: 1203-1211. 10.1097/00004583-200310000-00011.CrossRefPubMed Ford T, Goodman R, Meltzer H: The British Child and Adolescent Mental Health Survey 1999: The Prevalence of DSM-IV Disorders. J Am Acad Child Adolesc Psychiatry. 2003, 42: 1203-1211. 10.1097/00004583-200310000-00011.CrossRefPubMed
25.
go back to reference Foreman D, Morton S, Ford T: Exploring the clinical utility of the Development And Well Being Assessment (DAWBA) in the detection of hyperkinetic disorders and associated diagnoses in clinical practice. J Child Psychol Psychiatry. 2009, 50: 460-470. 10.1111/j.1469-7610.2008.02017.x.CrossRefPubMed Foreman D, Morton S, Ford T: Exploring the clinical utility of the Development And Well Being Assessment (DAWBA) in the detection of hyperkinetic disorders and associated diagnoses in clinical practice. J Child Psychol Psychiatry. 2009, 50: 460-470. 10.1111/j.1469-7610.2008.02017.x.CrossRefPubMed
26.
go back to reference Foreman D, Ford T: Assessing the diagnostic accuracy of the identification of hyperkinetic disorders following the introduction of government guidelines in England. Child Adolescent Psychiatry and Mental Health. 2008, 2: 32-10.1186/1753-2000-2-32.CrossRef Foreman D, Ford T: Assessing the diagnostic accuracy of the identification of hyperkinetic disorders following the introduction of government guidelines in England. Child Adolescent Psychiatry and Mental Health. 2008, 2: 32-10.1186/1753-2000-2-32.CrossRef
27.
go back to reference Altman DG, Bland JM: Diagnostic tests. 1: Sensitivity and specificity. Br Med J. 1994, 308: 1552.CrossRef Altman DG, Bland JM: Diagnostic tests. 1: Sensitivity and specificity. Br Med J. 1994, 308: 1552.CrossRef
28.
go back to reference Glaros AG, Kline RB: Understanding the accuracy of tests with cutting scores: the sensitivity, specificity, and predictive value model. J Clin Psychol. 1988, 44: 1013-1023. 10.1002/1097-4679(198811)44:6<1013::AID-JCLP2270440627>3.0.CO;2-Z.CrossRefPubMed Glaros AG, Kline RB: Understanding the accuracy of tests with cutting scores: the sensitivity, specificity, and predictive value model. J Clin Psychol. 1988, 44: 1013-1023. 10.1002/1097-4679(198811)44:6<1013::AID-JCLP2270440627>3.0.CO;2-Z.CrossRefPubMed
29.
go back to reference Akobeng AK: Understanding diagnostic tests 1: sensitivity, specificity and predictive values. Acta Paediatr. 2007, 96: 338-341. 10.1111/j.1651-2227.2006.00180.x.CrossRefPubMed Akobeng AK: Understanding diagnostic tests 1: sensitivity, specificity and predictive values. Acta Paediatr. 2007, 96: 338-341. 10.1111/j.1651-2227.2006.00180.x.CrossRefPubMed
30.
go back to reference Deeks JJ, Altman DG: Diagnostic tests 4: likelihood ratios. Br Med J. 2004, 329: 168-169. 10.1136/bmj.329.7458.168.CrossRef Deeks JJ, Altman DG: Diagnostic tests 4: likelihood ratios. Br Med J. 2004, 329: 168-169. 10.1136/bmj.329.7458.168.CrossRef
31.
go back to reference Fischer JE, Bachmann LM, Jaeschke R: A readers' guide to the interpretation of diagnostic test properties: clinical example of sepsis. Intensive Care Med. 2003, 29: 1043-1051. 10.1007/s00134-003-1761-8.CrossRefPubMed Fischer JE, Bachmann LM, Jaeschke R: A readers' guide to the interpretation of diagnostic test properties: clinical example of sepsis. Intensive Care Med. 2003, 29: 1043-1051. 10.1007/s00134-003-1761-8.CrossRefPubMed
33.
go back to reference Heiervang E, Goodman A, Goodman R: The Nordic advantage in child mental health: separating health differences from reporting style in a cross-cultural comparison of psychopathology. J Child Psychol Psychiatry. 2008, 49: 678-685. 10.1111/j.1469-7610.2008.01882.x.CrossRefPubMed Heiervang E, Goodman A, Goodman R: The Nordic advantage in child mental health: separating health differences from reporting style in a cross-cultural comparison of psychopathology. J Child Psychol Psychiatry. 2008, 49: 678-685. 10.1111/j.1469-7610.2008.01882.x.CrossRefPubMed
34.
go back to reference Angold A, Weissman MM, John K, Merikangas KR, Prusoff BA, Wickramaratne P, Gammon GD, Warner V: Parent and child reports of depressive symptoms in children at low and high risk of depression. J Child Psychol Psychiatry. 1987, 28: 901-915. 10.1111/j.1469-7610.1987.tb00678.x.CrossRefPubMed Angold A, Weissman MM, John K, Merikangas KR, Prusoff BA, Wickramaratne P, Gammon GD, Warner V: Parent and child reports of depressive symptoms in children at low and high risk of depression. J Child Psychol Psychiatry. 1987, 28: 901-915. 10.1111/j.1469-7610.1987.tb00678.x.CrossRefPubMed
35.
go back to reference Berg-Nielsen TS, Vika A, Dahl AA: When adolescents disagree with their mothers: CBCL-YSR discrepancies related to maternal depression and adolescent self-esteem. Child Care Health Dev. 2003, 29: 207-213. 10.1046/j.1365-2214.2003.00332.x.CrossRefPubMed Berg-Nielsen TS, Vika A, Dahl AA: When adolescents disagree with their mothers: CBCL-YSR discrepancies related to maternal depression and adolescent self-esteem. Child Care Health Dev. 2003, 29: 207-213. 10.1046/j.1365-2214.2003.00332.x.CrossRefPubMed
36.
go back to reference Lewczyk CM, Garland AF, Hurlburt MS, Gearity J, Hough RL: Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. J Am Acad Child Adolesc Psychiatry. 2003, 42: 349-356. 10.1097/00004583-200303000-00016.CrossRefPubMed Lewczyk CM, Garland AF, Hurlburt MS, Gearity J, Hough RL: Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. J Am Acad Child Adolesc Psychiatry. 2003, 42: 349-356. 10.1097/00004583-200303000-00016.CrossRefPubMed
37.
go back to reference Costello EJ, Egger H, Angold A: 10-Year Research Update Review: The Epidemiology of Child and Adolescent Psychiatric Disorders: I. Methods and Public Health Burden. J Am Acad Child Adolesc Psychiatry. 2005, 44: 972-986. 10.1097/01.chi.0000172552.41596.6f.CrossRefPubMed Costello EJ, Egger H, Angold A: 10-Year Research Update Review: The Epidemiology of Child and Adolescent Psychiatric Disorders: I. Methods and Public Health Burden. J Am Acad Child Adolesc Psychiatry. 2005, 44: 972-986. 10.1097/01.chi.0000172552.41596.6f.CrossRefPubMed
38.
go back to reference Ullebø AK, Posserud MB, Heiervang E, Gillberg C, Obel C: Screening for the Attention Deficit Hyperactivity Disorder Phenotype using the Strength and Difficulties Questionnaire. Eur Child Adolesc Psychiatry. 2011, 20: 451-458. 10.1007/s00787-011-0198-9.CrossRefPubMed Ullebø AK, Posserud MB, Heiervang E, Gillberg C, Obel C: Screening for the Attention Deficit Hyperactivity Disorder Phenotype using the Strength and Difficulties Questionnaire. Eur Child Adolesc Psychiatry. 2011, 20: 451-458. 10.1007/s00787-011-0198-9.CrossRefPubMed
Metadata
Title
The strengths and difficulties questionnaire as a screening instrument for norwegian child and adolescent mental health services, application of UK scoring algorithms
Authors
Per Håkan Brøndbo
Børge Mathiassen
Monica Martinussen
Einar Heiervang
Mads Eriksen
Therese Fjeldmo Moe
Guri Sæther
Siv Kvernmo
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Child and Adolescent Psychiatry and Mental Health / Issue 1/2011
Electronic ISSN: 1753-2000
DOI
https://doi.org/10.1186/1753-2000-5-32

Other articles of this Issue 1/2011

Child and Adolescent Psychiatry and Mental Health 1/2011 Go to the issue