Skip to main content
Top
Published in: Child and Adolescent Psychiatry and Mental Health 1/2011

Open Access 01-12-2011 | Research

Parent experiences questionnaire for outpatient child and adolescent mental health services (PEQ-CAMHS Outpatients): reliability and validity following a national survey

Authors: Andrew M Garratt, Oyvind A Bjertnaes, Olaf Holmboe, Ketil Hanssen-Bauer

Published in: Child and Adolescent Psychiatry and Mental Health | Issue 1/2011

Login to get access

Abstact

Background

Development and evaluation of the PEQ-CAMHS Outpatients, a parent completed questionnaire to measure experiences of outpatient child and adolescent mental health services (CAMHS) in Norway.

Methods

Literature review, parent interviews, pre-testing and a national survey of 17,080 parents of children who received care at one of the 86 outpatient CAMHS in Norway in 2006. Telephone interviews were conducted with a random sample of non-respondents. Levels of missing data, factor structure, internal consistency and construct validity were assessed.

Results

7,906 (46.0%) parents or primary caregivers responded to the questionnaire. Low levels of missing data suggest that the PEQ-CAMHS is acceptable. The questionnaire includes three scales supported by the results of factor analysis: relationship with health personnel (8 items), information and participation (4 items), and outcome (3 items). Item-total correlations were all above 0.6 and Cronbach's alpha correlations ranged from 0.88-0.94. The results of comparisons of scale scores with several variables relating to global satisfaction, outcome, cooperation, information, involvement and waiting time support the construct validity of the instrument.

Conclusions

The PEQ-CAMHS Outpatients questionnaire includes important aspects of outpatient CAMHS from the perspective of the parent. It has evidence for data quality, internal consistency and validity and is recommended in surveys of parent experiences of these services. Future research should assess test-retest reliability and further tests of construct validity that include clinical data are recommended.
Literature
1.
go back to reference Riley S, Stromberg A, Clark J: Assessing parental satisfaction with children's mental health services with the youth services survey for families. J Child Fam Stud. 2005, 14: 87-99. 10.1007/s10826-005-1124-x.CrossRef Riley S, Stromberg A, Clark J: Assessing parental satisfaction with children's mental health services with the youth services survey for families. J Child Fam Stud. 2005, 14: 87-99. 10.1007/s10826-005-1124-x.CrossRef
2.
go back to reference Garland AF, Haine RA, Boxmeyer CL: Determinates of youth and parent satisfaction in usual care psychotherapy. Evaluation and Program Planning. 2007, 30: 45-54. 10.1016/j.evalprogplan.2006.10.003.PubMedCentralCrossRefPubMed Garland AF, Haine RA, Boxmeyer CL: Determinates of youth and parent satisfaction in usual care psychotherapy. Evaluation and Program Planning. 2007, 30: 45-54. 10.1016/j.evalprogplan.2006.10.003.PubMedCentralCrossRefPubMed
3.
go back to reference Crow R, Gage H, Hampsom S, Hart J, Kimber A, Storey L, Thomas H: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002, 6 (32). Crow R, Gage H, Hampsom S, Hart J, Kimber A, Storey L, Thomas H: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002, 6 (32).
4.
go back to reference Shapiro JP, Welker CJ, Jacobson BJ: The Youth Client Satisfaction Questionnaire: development, construct validation, and factor structure. J Clin Child Psychol. 1997, 26: 87-98. 10.1207/s15374424jccp2601_9.CrossRefPubMed Shapiro JP, Welker CJ, Jacobson BJ: The Youth Client Satisfaction Questionnaire: development, construct validation, and factor structure. J Clin Child Psychol. 1997, 26: 87-98. 10.1207/s15374424jccp2601_9.CrossRefPubMed
5.
go back to reference Lambert W, Salzer MS, Bickman L: Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children's mental health. J Consult Clin Psychol. 1998, 66: 270-9.CrossRefPubMed Lambert W, Salzer MS, Bickman L: Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children's mental health. J Consult Clin Psychol. 1998, 66: 270-9.CrossRefPubMed
6.
go back to reference Gerkensmeyer J: Patient satisfaction with mental health services: relationship to outcomes. The 14th Annual Research Conference Proceedings: A System of Care for Children's Mental Health. Expanding the Research Base. Edited by: Liberton C, Kutash K, Friedman R. 2001, Tampa, Fla: University of South Florida, 259-266. Gerkensmeyer J: Patient satisfaction with mental health services: relationship to outcomes. The 14th Annual Research Conference Proceedings: A System of Care for Children's Mental Health. Expanding the Research Base. Edited by: Liberton C, Kutash K, Friedman R. 2001, Tampa, Fla: University of South Florida, 259-266.
7.
go back to reference Kaplan S, Busner J, Chibnall J, Kang G: Consumer Satisfaction at a Child and Adolescent State Psychiatric Hospital. Psychiatr Serv. 2001, 52: 202-6. 10.1176/appi.ps.52.2.202.CrossRefPubMed Kaplan S, Busner J, Chibnall J, Kang G: Consumer Satisfaction at a Child and Adolescent State Psychiatric Hospital. Psychiatr Serv. 2001, 52: 202-6. 10.1176/appi.ps.52.2.202.CrossRefPubMed
8.
go back to reference Delaney KR, Engles-Scianna B: Parents' perceptions of their child's emotional illness and psychiatric treatment needs. Journal of Child and Adolescent Psychiatric Nursing. 1996, 9: 15-24.CrossRefPubMed Delaney KR, Engles-Scianna B: Parents' perceptions of their child's emotional illness and psychiatric treatment needs. Journal of Child and Adolescent Psychiatric Nursing. 1996, 9: 15-24.CrossRefPubMed
9.
go back to reference Gerkensmeyer JE, Austin JK: Development and testing of a scale measuring parent satisfaction with staff interactions. J Behav Health Serv Res. 2005, 32: 61-73. 10.1007/BF02287328.CrossRefPubMed Gerkensmeyer JE, Austin JK: Development and testing of a scale measuring parent satisfaction with staff interactions. J Behav Health Serv Res. 2005, 32: 61-73. 10.1007/BF02287328.CrossRefPubMed
10.
go back to reference Resendez MG, Quist RM, Matshazi DGM: A longitudinal analysis of family empowerment and client outcomes. J Child Fam Stud. 2000, 9: 449-60. 10.1023/A:1009483425999.CrossRef Resendez MG, Quist RM, Matshazi DGM: A longitudinal analysis of family empowerment and client outcomes. J Child Fam Stud. 2000, 9: 449-60. 10.1023/A:1009483425999.CrossRef
11.
go back to reference Blader JC: Longitudinal Assessment of parental satisfaction with children's psychiatric hospitalization. Adm Policy Ment Health. 2007, 34: 108-15. 10.1007/s10488-006-0085-8.PubMedCentralCrossRefPubMed Blader JC: Longitudinal Assessment of parental satisfaction with children's psychiatric hospitalization. Adm Policy Ment Health. 2007, 34: 108-15. 10.1007/s10488-006-0085-8.PubMedCentralCrossRefPubMed
12.
go back to reference Swanson JM, Hechtman L: Using long-acting stimulants: does it change ADHD treatment outcome?. Can Child Adolesc Psychiatr Rev. 2005, 14 (Suppl 1): 2-3.PubMedCentralPubMed Swanson JM, Hechtman L: Using long-acting stimulants: does it change ADHD treatment outcome?. Can Child Adolesc Psychiatr Rev. 2005, 14 (Suppl 1): 2-3.PubMedCentralPubMed
13.
go back to reference Steele M, Weiss M, Swanson J, Wang J, Prinzo RS, Binder CE: A randomized, controlled effectiveness trial of OROS-methylphenidate compared to usual care with immediate-release methylphenidate in attention deficit-hyperactivity disorder. Can J Clin Pharmacol. 2006, 13: e50-62.PubMed Steele M, Weiss M, Swanson J, Wang J, Prinzo RS, Binder CE: A randomized, controlled effectiveness trial of OROS-methylphenidate compared to usual care with immediate-release methylphenidate in attention deficit-hyperactivity disorder. Can J Clin Pharmacol. 2006, 13: e50-62.PubMed
14.
go back to reference Martin SJ, Petr GC, Kapp SA: Consumer satisfaction with children's mental health services. Child Adolesc Soc Work J. 2003, 20: 211-26. 10.1023/A:1023609912797.CrossRef Martin SJ, Petr GC, Kapp SA: Consumer satisfaction with children's mental health services. Child Adolesc Soc Work J. 2003, 20: 211-26. 10.1023/A:1023609912797.CrossRef
15.
go back to reference Day C, Davis H: The effectiveness and quality of routine child and adolescent mental health care outreach clinics. Br J Clin Psychol. 2006, 45: 439-52. 10.1348/014466505X79986.CrossRefPubMed Day C, Davis H: The effectiveness and quality of routine child and adolescent mental health care outreach clinics. Br J Clin Psychol. 2006, 45: 439-52. 10.1348/014466505X79986.CrossRefPubMed
16.
go back to reference Heflinger CA, Simpkins CG, Scholle SH, Kelleher KJ: Parent/caregiver satisfaction with their child ' s medicaid plan and behavioral health providers. Ment Health Serv Res. 2004, 6: 23-32.CrossRefPubMed Heflinger CA, Simpkins CG, Scholle SH, Kelleher KJ: Parent/caregiver satisfaction with their child ' s medicaid plan and behavioral health providers. Ment Health Serv Res. 2004, 6: 23-32.CrossRefPubMed
17.
go back to reference Young SC, Nicholson J, Davis M: An overview of issues in research on consumer satisfaction with child and adolescent mental health services. J Child Fam Stud. 1995, 4: 219-38. 10.1007/BF02234097.CrossRef Young SC, Nicholson J, Davis M: An overview of issues in research on consumer satisfaction with child and adolescent mental health services. J Child Fam Stud. 1995, 4: 219-38. 10.1007/BF02234097.CrossRef
18.
go back to reference Attkisson CC, Greenfield TK: The Client Satisfaction Questionnaire (CSQ) Scale and the Service Satisfaction Scale-30 (SSS-30). Outcomes assessment in clinical practice. Edited by: Sederer LL, Dickey B. 1996, Baltimore: Williams & Wilkins, 120-127. Attkisson CC, Greenfield TK: The Client Satisfaction Questionnaire (CSQ) Scale and the Service Satisfaction Scale-30 (SSS-30). Outcomes assessment in clinical practice. Edited by: Sederer LL, Dickey B. 1996, Baltimore: Williams & Wilkins, 120-127.
19.
go back to reference Rey JM, Plapp JM, Simpson PL: Parental satisfaction and outcome: a 4-year study in a child and adolescent mental health service. Australian and New Zealand Journal of Psychiatry. 1999, 33: 22-28. 10.1046/j.1440-1614.1999.00516.x.CrossRefPubMed Rey JM, Plapp JM, Simpson PL: Parental satisfaction and outcome: a 4-year study in a child and adolescent mental health service. Australian and New Zealand Journal of Psychiatry. 1999, 33: 22-28. 10.1046/j.1440-1614.1999.00516.x.CrossRefPubMed
20.
go back to reference Ayton AK, Mooney MP, Sillifant K, Powls J, Rasool H: The development of the child and adolescent versions of the Verona Service Satisfaction Scale (CAMHSSS). Soc Psychiatr Epidemiol. 2007, 42: 892-901. 10.1007/s00127-007-0241-9.CrossRef Ayton AK, Mooney MP, Sillifant K, Powls J, Rasool H: The development of the child and adolescent versions of the Verona Service Satisfaction Scale (CAMHSSS). Soc Psychiatr Epidemiol. 2007, 42: 892-901. 10.1007/s00127-007-0241-9.CrossRef
21.
go back to reference Garratt AM, Andersen Bjertnæs Ø, Krogstad U, Gulbransen P: The OutPatient Experiences Questionnaire: reliability and validity in 52 Norwegian hospitals. Quality and Safety in Health Care. 2005, 14: 433-37. 10.1136/qshc.2005.014423.PubMedCentralCrossRefPubMed Garratt AM, Andersen Bjertnæs Ø, Krogstad U, Gulbransen P: The OutPatient Experiences Questionnaire: reliability and validity in 52 Norwegian hospitals. Quality and Safety in Health Care. 2005, 14: 433-37. 10.1136/qshc.2005.014423.PubMedCentralCrossRefPubMed
22.
go back to reference Bjertnæs ØA, Garratt A, Helgeland J, Holmboe O, Dahle KA, Hanssen-Bauer K, Røttingen JA: Parent assessment of outpatient child and adolescent mental health services. Tidsskr Nor Laegeforen. 2008, 128: 1041-1045.PubMed Bjertnæs ØA, Garratt A, Helgeland J, Holmboe O, Dahle KA, Hanssen-Bauer K, Røttingen JA: Parent assessment of outpatient child and adolescent mental health services. Tidsskr Nor Laegeforen. 2008, 128: 1041-1045.PubMed
23.
go back to reference Sitzia J: How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999, 11: 319-328. 10.1093/intqhc/11.4.319.CrossRefPubMed Sitzia J: How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999, 11: 319-328. 10.1093/intqhc/11.4.319.CrossRefPubMed
24.
go back to reference Hair J, Anderson RE, Tatham RL, Black WC: Multivariate data analysis with readings. 1995, Englewood Cliffs, New Jersey: Prentice-Hall international Inc, 4 Hair J, Anderson RE, Tatham RL, Black WC: Multivariate data analysis with readings. 1995, Englewood Cliffs, New Jersey: Prentice-Hall international Inc, 4
25.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3 Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3
26.
go back to reference Kline P: The handbook of psychological testing. 1993, London: Routledge Kline P: The handbook of psychological testing. 1993, London: Routledge
27.
go back to reference Garratt AM, Andresen Bjertnæs ØA, Barlinn JK: Parent Experiences of Paediatric Care (PEPC) questonnaire: reliability and validity following a national survey. Acta Paediatrica. 2007, 96: 246-252.CrossRefPubMed Garratt AM, Andresen Bjertnæs ØA, Barlinn JK: Parent Experiences of Paediatric Care (PEPC) questonnaire: reliability and validity following a national survey. Acta Paediatrica. 2007, 96: 246-252.CrossRefPubMed
28.
go back to reference Stallard P: Validity and reliability of the Parent Satisfaction Questionnaire. Br J Clin Psychol. 1996, 35: 311-8.CrossRefPubMed Stallard P: Validity and reliability of the Parent Satisfaction Questionnaire. Br J Clin Psychol. 1996, 35: 311-8.CrossRefPubMed
29.
go back to reference Godley S, Fiedler E, Funk R: Consumer satisfaction of parents and their children with child/adolescent mental health services. Eval Program Plann. 1998, 21: 31-45. 10.1016/S0149-7189(97)00043-8.CrossRef Godley S, Fiedler E, Funk R: Consumer satisfaction of parents and their children with child/adolescent mental health services. Eval Program Plann. 1998, 21: 31-45. 10.1016/S0149-7189(97)00043-8.CrossRef
30.
go back to reference Garland AF, Aarons GA, Saltzman MD, Kruse MI: Correlates of adolescents ' satisfaction with mental health services. Ment Health Serv Res. 2000, 2: 127-39. 10.1023/A:1010137725958.CrossRefPubMed Garland AF, Aarons GA, Saltzman MD, Kruse MI: Correlates of adolescents ' satisfaction with mental health services. Ment Health Serv Res. 2000, 2: 127-39. 10.1023/A:1010137725958.CrossRefPubMed
31.
go back to reference Garratt AM, Bjørngård JH, Dahle KA, Bjertnæs ØA, Saunes IS, Ruud T: Psychiatric Out-Patient Experiences Questionnaire: data quality, reliability and validity in patients attending 90 Norwegian clinics. Nordic Journal of Psychiatry. 2006, 60: 89-96. 10.1080/08039480600583464.CrossRefPubMed Garratt AM, Bjørngård JH, Dahle KA, Bjertnæs ØA, Saunes IS, Ruud T: Psychiatric Out-Patient Experiences Questionnaire: data quality, reliability and validity in patients attending 90 Norwegian clinics. Nordic Journal of Psychiatry. 2006, 60: 89-96. 10.1080/08039480600583464.CrossRefPubMed
32.
go back to reference Sitzia J, Wood N: Response rate in patient satisfaction research: an analysis of 210 published studies. Int J Qual Health Care. 1998, 10: 311-317. 10.1093/intqhc/10.4.311.CrossRefPubMed Sitzia J, Wood N: Response rate in patient satisfaction research: an analysis of 210 published studies. Int J Qual Health Care. 1998, 10: 311-317. 10.1093/intqhc/10.4.311.CrossRefPubMed
33.
go back to reference Bjertnæs ØA, Garratt AM, Johannessen JO: Data collection methods and results in users surveys in mental health care. Tidsskr Nor Laegeforen. 2006, 126: 1481-1483.PubMed Bjertnæs ØA, Garratt AM, Johannessen JO: Data collection methods and results in users surveys in mental health care. Tidsskr Nor Laegeforen. 2006, 126: 1481-1483.PubMed
34.
go back to reference Guldvog B, Hofoss D, Pettersen KI, Ebbesen J, Ronning OM: PS-RESKVA -(Patient Satisfaction, Results and Quality -- patient satisfaction in hospitals). Tidsskr Nor Laegeforen. 1998, 118: 386-391.PubMed Guldvog B, Hofoss D, Pettersen KI, Ebbesen J, Ronning OM: PS-RESKVA -(Patient Satisfaction, Results and Quality -- patient satisfaction in hospitals). Tidsskr Nor Laegeforen. 1998, 118: 386-391.PubMed
35.
go back to reference Bjertnaes OA, Garratt A, Botten G: Nonresponse bias and cost-effectiveness in a Norwegian survey of family physicians. Eval Health Prof. 2008, 31: 65-80.CrossRefPubMed Bjertnaes OA, Garratt A, Botten G: Nonresponse bias and cost-effectiveness in a Norwegian survey of family physicians. Eval Health Prof. 2008, 31: 65-80.CrossRefPubMed
36.
go back to reference Bjertnaes OA, Garratt A, Iversen H, Ruud T: The association between GP and patient ratings of quality of care at outpatient clinics. Fam Pract. 2009, 26: 384-90. 10.1093/fampra/cmp043.PubMedCentralCrossRefPubMed Bjertnaes OA, Garratt A, Iversen H, Ruud T: The association between GP and patient ratings of quality of care at outpatient clinics. Fam Pract. 2009, 26: 384-90. 10.1093/fampra/cmp043.PubMedCentralCrossRefPubMed
Metadata
Title
Parent experiences questionnaire for outpatient child and adolescent mental health services (PEQ-CAMHS Outpatients): reliability and validity following a national survey
Authors
Andrew M Garratt
Oyvind A Bjertnaes
Olaf Holmboe
Ketil Hanssen-Bauer
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Child and Adolescent Psychiatry and Mental Health / Issue 1/2011
Electronic ISSN: 1753-2000
DOI
https://doi.org/10.1186/1753-2000-5-18

Other articles of this Issue 1/2011

Child and Adolescent Psychiatry and Mental Health 1/2011 Go to the issue