Skip to main content
Top
Published in: BMC Psychiatry 1/2016

Open Access 01-12-2016 | Research article

Detection of unsafety in families with parental and/or child developmental problems at the start of family support

Authors: Claudia E. van der Put, Jo Hermanns, Loes van Rijn-van Gelderen, Frouke Sondeijker

Published in: BMC Psychiatry | Issue 1/2016

Login to get access

Abstract

Background

Risk assessment is crucial in preventing child maltreatment as it can identify high-risk cases in need of child protection intervention. Despite this importance, there have been no validated risk assessment instruments available in the Netherlands for assessing the risk of child maltreatment. Therefore, the predictive validity of the California Family Risk Assessment (CFRA) was examined in Dutch families who received family support. In addition, the added value of a number of experimental items was examined. Finally, it was examined whether the predictive value of the instrument could be improved by modifying the scoring procedure.

Methods

Dutch families who experienced parenting and/or child developmental problems and were referred by the Centres for Youth and Family for family support between July 2009 and March 2011 were included. This led to a sample of 491 families. The predictive validity of the CFRA and the added value of the experimental items were examined by calculating AUC values. A CHAID analysis was performed to examine whether the scoring procedure could be improved.

Results

About half of the individual CFRA items were not related to future reports of child maltreatment. The predictive validity of the CFRA in predicting future reports of child maltreatment was found to be modest (AUC = .693). The addition of some of the experimental items and the modification of the scoring procedure by including only items that were significantly associated with future maltreatment reports resulted in a ‘high’ predictive validity (AUC = .795).

Conclusions

This new set of items might be a valuable instrument that also saves time because only variables that uniquely contribute to the prediction of future reports of child maltreatment are included. Furthermore, items that are perceived as difficult to assess by professionals, such as parental mental health problems or parents’ history of abuse/neglect, could be omitted without compromising predictive validity. However, it is important to examine the psychometric properties of this new set of items in a new dataset.
Appendix
Available only for authorised users
Literature
1.
go back to reference Alink L, Van IJzendoorn M, Bakermans-Kranenburg M, Pannebakker F, Vogels A, Euser S. Kindermishandeling 2010. De tweede nationale prevalentiestudie mishandeling van kinderen en jeugdigen (NPM-2010). Leiden: Leiden University/TNO; 2011. Alink L, Van IJzendoorn M, Bakermans-Kranenburg M, Pannebakker F, Vogels A, Euser S. Kindermishandeling 2010. De tweede nationale prevalentiestudie mishandeling van kinderen en jeugdigen (NPM-2010). Leiden: Leiden University/TNO; 2011.
2.
go back to reference Kuyvenhoven M, Hekkink C, Voorn T. Overlijdingsgevallen onder 0-18 jarigen door vermoede kindermishandeling: naar schatting 40 gevallen in 1996 gebaseerd op een enquête onder huisartsen en kinderartsen. Tijdschr Geneeskd. 1998;1998(142):2515–8. Kuyvenhoven M, Hekkink C, Voorn T. Overlijdingsgevallen onder 0-18 jarigen door vermoede kindermishandeling: naar schatting 40 gevallen in 1996 gebaseerd op een enquête onder huisartsen en kinderartsen. Tijdschr Geneeskd. 1998;1998(142):2515–8.
4.
5.
go back to reference Knoke D, Trocmé N. Reviewing the evidence on assessing risk for child abuse and neglect. Brief Treat Crisis Interv. 2005;5:310–27.CrossRef Knoke D, Trocmé N. Reviewing the evidence on assessing risk for child abuse and neglect. Brief Treat Crisis Interv. 2005;5:310–27.CrossRef
7.
go back to reference Arad-Davidson B, Benbenishty R. The role of workers' attitudes and parent and child wishes in child protection workers' assessments and recommendation regarding removal and reunification. Child Youth Serv Rev. 2008;30:107–21.CrossRef Arad-Davidson B, Benbenishty R. The role of workers' attitudes and parent and child wishes in child protection workers' assessments and recommendation regarding removal and reunification. Child Youth Serv Rev. 2008;30:107–21.CrossRef
8.
go back to reference Baird C, Wagner D. The relative validity of actuarial and consensus based risk assessment systems. Child Youth Serv Rev. 2000;22:839–71.CrossRef Baird C, Wagner D. The relative validity of actuarial and consensus based risk assessment systems. Child Youth Serv Rev. 2000;22:839–71.CrossRef
9.
go back to reference Camasso M, Jagannathan R. Modeling the reliability and predictive validity of risk assessment in child protective services. Child Youth Serv Rev. 2000;22:873–96.CrossRef Camasso M, Jagannathan R. Modeling the reliability and predictive validity of risk assessment in child protective services. Child Youth Serv Rev. 2000;22:873–96.CrossRef
11.
go back to reference DePanfilis D, Girvin H. Investigating child maltreatment in out-of-home care: Barriers to good decision-making. Child Youth Serv Rev. 2005;27:353–74.CrossRef DePanfilis D, Girvin H. Investigating child maltreatment in out-of-home care: Barriers to good decision-making. Child Youth Serv Rev. 2005;27:353–74.CrossRef
12.
go back to reference Dorsey S, Mustillo SA, Farmer EMZ, Elbogen E. Caseworker assessments of risk for recurrent maltreatment: association with case-specific risk factors and re-reports. Child Abuse Negl. 2008;32:377–91.PubMedCentralCrossRefPubMed Dorsey S, Mustillo SA, Farmer EMZ, Elbogen E. Caseworker assessments of risk for recurrent maltreatment: association with case-specific risk factors and re-reports. Child Abuse Negl. 2008;32:377–91.PubMedCentralCrossRefPubMed
13.
go back to reference Lyons P, Doueck HJ, Wodarski JS. Risk assessment for child protective services: A review of the empirical literature on instrument performance. Soc Work Res. 1996;20:143–55. Lyons P, Doueck HJ, Wodarski JS. Risk assessment for child protective services: A review of the empirical literature on instrument performance. Soc Work Res. 1996;20:143–55.
14.
15.
go back to reference Pfister H, Böhm G. The multiplicity of emotions: A framework of emotional functions in decision making. Judgment Decis Making. 2008;3:5–17. Pfister H, Böhm G. The multiplicity of emotions: A framework of emotional functions in decision making. Judgment Decis Making. 2008;3:5–17.
16.
go back to reference Wald MS, Woolverton M. Risk assessment: The emperor’s new clothes? Child Welfare. 1990;69:483–511.PubMed Wald MS, Woolverton M. Risk assessment: The emperor’s new clothes? Child Welfare. 1990;69:483–511.PubMed
17.
go back to reference Grove WM, Meehl PE. Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: the clinical-statistical controversy. Psychol Public Policy Law. 1996;2:293–323.CrossRef Grove WM, Meehl PE. Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: the clinical-statistical controversy. Psychol Public Policy Law. 1996;2:293–323.CrossRef
18.
go back to reference Leschied AW, Chiodo D, Whitehead PC, Hurley D, Marshall L. The empirical basis of risk assessment in child welfare: the accuracy of risk assessment and clinical judgment. Child Welfare. 2003;82:527–40.PubMed Leschied AW, Chiodo D, Whitehead PC, Hurley D, Marshall L. The empirical basis of risk assessment in child welfare: the accuracy of risk assessment and clinical judgment. Child Welfare. 2003;82:527–40.PubMed
19.
go back to reference Hanson RK, Morton-Bourgon KE. The accuracy of recidivism risk assessments for sexual offenders: a meta-analysis of 118 prediction studies. Psychol Assess. 2009;21:1–21.CrossRefPubMed Hanson RK, Morton-Bourgon KE. The accuracy of recidivism risk assessments for sexual offenders: a meta-analysis of 118 prediction studies. Psychol Assess. 2009;21:1–21.CrossRefPubMed
20.
go back to reference Guy LS. Performance Indicators of the Structured Professional Judgment Approach for Assessing Risk of Violence to Others: A Meta-Analytic Survey, Doctoral dissertation, Simon Fraser University, Canada,1998. Accessed date 26 October 2013 from http://summit.sfu.ca/item/9247. Guy LS. Performance Indicators of the Structured Professional Judgment Approach for Assessing Risk of Violence to Others: A Meta-Analytic Survey, Doctoral dissertation, Simon Fraser University, Canada,1998. Accessed date 26 October 2013 from http://​summit.​sfu.​ca/​item/​9247.
21.
go back to reference Ten Berge IJ, Eijgenraam K: Licht Instrument Risicotaxatie Kindermishandeling (werkversie juni 2007). Utrecht: Nederlands Jeugdinstituut. Ten Berge IJ, Eijgenraam K: Licht Instrument Risicotaxatie Kindermishandeling (werkversie juni 2007). Utrecht: Nederlands Jeugdinstituut.
22.
go back to reference De Ruiter C, De Jong EM: CARE-NL. Richtlijn voor gestructureerde beoordeling van het risico van kindermishandeling. Utrecht: Corine de Ruiter; 2005. De Ruiter C, De Jong EM: CARE-NL. Richtlijn voor gestructureerde beoordeling van het risico van kindermishandeling. Utrecht: Corine de Ruiter; 2005.
23.
go back to reference Heinrich R, Van den Braak J. De Delta veiligheidslijst. Gestructureerde risicotaxatie en management binnen de Deltamethode. Amsterdam/Woerden: PI Research/Adviesbureau Van Montfoort; 2007. Heinrich R, Van den Braak J. De Delta veiligheidslijst. Gestructureerde risicotaxatie en management binnen de Deltamethode. Amsterdam/Woerden: PI Research/Adviesbureau Van Montfoort; 2007.
24.
go back to reference Ten Berge IJ. Instrumenten voor risicotaxatie in situaties van (vermoedelijke) kindermishandeling. Utrecht: Netherlands Jeugdinstituut; 2008. Ten Berge IJ. Instrumenten voor risicotaxatie in situaties van (vermoedelijke) kindermishandeling. Utrecht: Netherlands Jeugdinstituut; 2008.
25.
go back to reference Klein Velderman M, Pannebakker FD. Primaire preventie van kindermishandeling: Bekende, gebaande en gewenste paden. Leiden: TNO Kwaliteit van Leven; 2008. Klein Velderman M, Pannebakker FD. Primaire preventie van kindermishandeling: Bekende, gebaande en gewenste paden. Leiden: TNO Kwaliteit van Leven; 2008.
26.
go back to reference Johnson W. Effectiveness of California’s child welfare structured decision making (SDM) model: a prospective study of the validity of the California Family Risk Assessment. Madison (Wisconsin, USA): Children’s Research Center; 2004. Johnson W. Effectiveness of California’s child welfare structured decision making (SDM) model: a prospective study of the validity of the California Family Risk Assessment. Madison (Wisconsin, USA): Children’s Research Center; 2004.
27.
go back to reference Johnson WL. The validity and utility of the California Family Risk Assessment under practice conditions in the field: A prospective study. Child Abuse Negl. 2011;35:18–28.CrossRefPubMed Johnson WL. The validity and utility of the California Family Risk Assessment under practice conditions in the field: A prospective study. Child Abuse Negl. 2011;35:18–28.CrossRefPubMed
28.
go back to reference Fazel S, Singh JP, Doll H, Grann M: Use of risk assessment instruments to predict violence and antisocial behavior in 73 samples involving 24827 people: systematic review and meta-analysis. Br Med J. 2012, published online: doi:10.1136/bmj.e4692 Fazel S, Singh JP, Doll H, Grann M: Use of risk assessment instruments to predict violence and antisocial behavior in 73 samples involving 24827 people: systematic review and meta-analysis. Br Med J. 2012, published online: doi:10.​1136/​bmj.​e4692
29.
go back to reference Olver ME, Stochdale KC, Wormith JS. Risk assessment with young offenders: A meta-analysis of three assessment measures. Crim Justice Behav. 2009;36:329–53.CrossRef Olver ME, Stochdale KC, Wormith JS. Risk assessment with young offenders: A meta-analysis of three assessment measures. Crim Justice Behav. 2009;36:329–53.CrossRef
30.
go back to reference Schwalbe CS. Risk assessment for juvenile justice: a meta-analysis. Law Hum Behav. 2007;31:449–62.CrossRefPubMed Schwalbe CS. Risk assessment for juvenile justice: a meta-analysis. Law Hum Behav. 2007;31:449–62.CrossRefPubMed
31.
go back to reference Smith TK, Duggan A, Bair‐Merritt MH, Cox G. Systematic review of fathers' involvement in programmes for the primary prevention of child maltreatment. Child Abuse Rev. 2012;21:237–54.CrossRef Smith TK, Duggan A, Bair‐Merritt MH, Cox G. Systematic review of fathers' involvement in programmes for the primary prevention of child maltreatment. Child Abuse Rev. 2012;21:237–54.CrossRef
32.
go back to reference Sidebotham P, Golding J, ALSPAC Study Team. Child maltreatment in the “Children of the Nineties”: A longitudinal study of parental risk factors. Child Abuse Negl. 2001;25:1177–200.CrossRefPubMed Sidebotham P, Golding J, ALSPAC Study Team. Child maltreatment in the “Children of the Nineties”: A longitudinal study of parental risk factors. Child Abuse Negl. 2001;25:1177–200.CrossRefPubMed
33.
go back to reference Brown J, Cohen P, Johnson JG, Salzinger S. A longitudinal analysis of risk factors for child maltreatment: Findings of a 17-year prospective study of officially recorded and self-reported child abuse and neglect. Child Abuse Negl. 1998;22:1065–78.CrossRefPubMed Brown J, Cohen P, Johnson JG, Salzinger S. A longitudinal analysis of risk factors for child maltreatment: Findings of a 17-year prospective study of officially recorded and self-reported child abuse and neglect. Child Abuse Negl. 1998;22:1065–78.CrossRefPubMed
34.
go back to reference Stith SM, Liu T, Davies LC, Boykin EL, Alder MC, Harris JM, et al. Risk factors in child maltreatment: A meta-analytic review of the literature. Aggress Violent Behav. 2009;14:13–29.CrossRef Stith SM, Liu T, Davies LC, Boykin EL, Alder MC, Harris JM, et al. Risk factors in child maltreatment: A meta-analytic review of the literature. Aggress Violent Behav. 2009;14:13–29.CrossRef
35.
go back to reference Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed
36.
go back to reference Steadman HJ, Silver E, Monahan J, Appelbaum P, Robbins PC, Mulvey EP, et al. A classification tree approach to the development of actuarial violent risk assessment tools. Law Hum Behav. 2000;24:83–100.CrossRefPubMed Steadman HJ, Silver E, Monahan J, Appelbaum P, Robbins PC, Mulvey EP, et al. A classification tree approach to the development of actuarial violent risk assessment tools. Law Hum Behav. 2000;24:83–100.CrossRefPubMed
37.
go back to reference Thomas SD, Leese M: Invited editorial. A green-fingered approach can improve the clinical utility of violence risk assessment tools. Crim Behav Ment Health. 2003;13:153–158. Whurr Publishers Ltd.CrossRefPubMed Thomas SD, Leese M: Invited editorial. A green-fingered approach can improve the clinical utility of violence risk assessment tools. Crim Behav Ment Health. 2003;13:153–158. Whurr Publishers Ltd.CrossRefPubMed
40.
go back to reference Van Stokkom M. Het effect van risicofactoren op kindermishandeling, Master Thesis. Amsterdam: Universiteit van Amsterdam; 2014. Van Stokkom M. Het effect van risicofactoren op kindermishandeling, Master Thesis. Amsterdam: Universiteit van Amsterdam; 2014.
41.
go back to reference Cash SJ. Risk assessment in child welfare: The art and science. Child Youth Serv Rev. 2001;23:811–30.CrossRef Cash SJ. Risk assessment in child welfare: The art and science. Child Youth Serv Rev. 2001;23:811–30.CrossRef
42.
go back to reference Rice ME, Harris GT. Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r. Law Hum Behav. 2005;29:615.CrossRefPubMed Rice ME, Harris GT. Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r. Law Hum Behav. 2005;29:615.CrossRefPubMed
43.
go back to reference Glaser D. Emotional abuse and neglect (psychological maltreatment): A conceptual framework. Child Abuse Negl. 2002;26:697–714.CrossRefPubMed Glaser D. Emotional abuse and neglect (psychological maltreatment): A conceptual framework. Child Abuse Negl. 2002;26:697–714.CrossRefPubMed
Metadata
Title
Detection of unsafety in families with parental and/or child developmental problems at the start of family support
Authors
Claudia E. van der Put
Jo Hermanns
Loes van Rijn-van Gelderen
Frouke Sondeijker
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2016
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-016-0715-y

Other articles of this Issue 1/2016

BMC Psychiatry 1/2016 Go to the issue