Skip to main content
Top
Published in: Maternal and Child Health Journal 2/2015

01-02-2015

Development, Validation, and Utility of an Instrument to Assess Core Competencies in the Leadership Education in Neurodevelopmental and Related Disabilities (LEND) Program

Authors: Stephen S. Leff, Katherine T. Baum, Katherine B. Bevans, Nathan J. Blum

Published in: Maternal and Child Health Journal | Issue 2/2015

Login to get access

Abstract

To describe the development and psychometric evaluation of the Core Competency Measure (CCM), an instrument designed to assess professional competencies as defined by the Maternal Child Health Bureau (MCHB) and targeted by Leadership Education in Neurodevelopmental and Related Disabilities (LEND) programs. The CCM is a 44-item self-report measure comprised of six subscales to assess clinical, interdisciplinary, family-centered/cultural, community, research, and advocacy/policy competencies. The CCM was developed in an iterative fashion through participatory action research, and then nine cohorts of LEND trainees (N = 144) from 14 different disciplines completed the CCM during the first week of the training program. A 6-factor confirmatory factor analysis model was fit to data from the 44 original items. After three items were removed, the model adequately fit the data (comparative fit indices = .93, root mean error of approximation = .06) with all factor loadings exceeding .55. The measure was determined to be quite reliable as adequate internal consistency and test–retest reliability were found for each subscale. The instrument’s construct validity was supported by expected differences in self-rated competencies among fellows representing various disciplines, and the convergent validity was supported by the pattern of inter-correlations between subscale scores. The CCM appears to be a reliable and valid measure of MCHB core competencies for our sample of LEND trainees. It provides an assessment of key training areas addressed by the LEND program. Although the measure was developed within only one LEND Program, with additional research it has the potential to serve as a standardized tool to evaluate the strengths and limitations of MCHB training, both within and between programs.
Footnotes
1
Because the MCHB has provided a conceptual framework to support the core competencies measured by the CCM, we felt that a confirmatory factor analysis would be more appropriate to conduct than an exploratory factor analysis.
 
2
The anchor points were modified because the response category of ‘Strongly Disagree’ seemed to be a very unlikely choice that would be endorsed according to our stakeholder team.
 
3
Although the CCM was developed in the context of our LEND Program we had the opportunity to present our assessment tool to LEND directors at two national meetings, and although programs varied across the country, we received strong feedback that the measure likely would be quite applicable to most programs. Further, several programs have recently asked for copies of the measure to begin using and/or adapting slightly to meet the needs of their programs.
 
Literature
5.
go back to reference Skytt, B., Carlsson, M., Ljunggren, B., & Engstrom, M. (2008). Psychometric testing of the Leadership and Management Inventory: A tool to measure the skills and abilities of first-line nurse managers. Journal of Nursing Management, 16(7), 784–794.PubMedCrossRef Skytt, B., Carlsson, M., Ljunggren, B., & Engstrom, M. (2008). Psychometric testing of the Leadership and Management Inventory: A tool to measure the skills and abilities of first-line nurse managers. Journal of Nursing Management, 16(7), 784–794.PubMedCrossRef
6.
go back to reference Weech-Maldonado, R., Dreachslin, J. L., Brown, J., Pradhan, R., Rubin, K. L., Schiller, C., et al. (2012). Cultural competency assessment tool for hospitals: Evaluating hospitals’ adherence to the culturally and linguistically appropriate services standards. Health Care Management Review, 37(1), 54–66.PubMedCrossRef Weech-Maldonado, R., Dreachslin, J. L., Brown, J., Pradhan, R., Rubin, K. L., Schiller, C., et al. (2012). Cultural competency assessment tool for hospitals: Evaluating hospitals’ adherence to the culturally and linguistically appropriate services standards. Health Care Management Review, 37(1), 54–66.PubMedCrossRef
7.
go back to reference Gozu, A., Beach, M. C., Price, E. G., Gary, T. L., Robinson, K., Palacio, A., et al. (2007). Self-administered instruments to measure cultural competence of health professionals: A systematic review. Teaching and Learning in Medicine, 19(2), 180–190.PubMedCrossRef Gozu, A., Beach, M. C., Price, E. G., Gary, T. L., Robinson, K., Palacio, A., et al. (2007). Self-administered instruments to measure cultural competence of health professionals: A systematic review. Teaching and Learning in Medicine, 19(2), 180–190.PubMedCrossRef
8.
go back to reference Leff, S. S., Costigan, T. E., & Power, T. J. (2004). Using participatory-action research to develop a playground-based prevention program. Journal of School Psychology, 42(1), 3–21.CrossRef Leff, S. S., Costigan, T. E., & Power, T. J. (2004). Using participatory-action research to develop a playground-based prevention program. Journal of School Psychology, 42(1), 3–21.CrossRef
9.
go back to reference Nastasi, B. K., Varjas, K., Schensul, S. L., Silva, K. T., Schensul, J. J., & Ratnayake, P. (2000). The participatory intervention model: A framework for conceptualizing and promoting intervention acceptability. School Psychology Quarterly, 15(2), 207–232.CrossRef Nastasi, B. K., Varjas, K., Schensul, S. L., Silva, K. T., Schensul, J. J., & Ratnayake, P. (2000). The participatory intervention model: A framework for conceptualizing and promoting intervention acceptability. School Psychology Quarterly, 15(2), 207–232.CrossRef
10.
go back to reference Hughes, J. N. (2003). Commentary: Participatory action research leads to sustainable school and community improvement. School Psychology Review, 32(1), 38–43. Hughes, J. N. (2003). Commentary: Participatory action research leads to sustainable school and community improvement. School Psychology Review, 32(1), 38–43.
11.
go back to reference Leff, S. S., Crick, N. R., Angelucci, J., Haye, K., Jawad, A. F., Grossman, M., et al. (2006). Social cognition in context: Validating a cartoon-based attributional measure for urban girls. Child Development, 77(5), 1351–1358.PubMedCrossRef Leff, S. S., Crick, N. R., Angelucci, J., Haye, K., Jawad, A. F., Grossman, M., et al. (2006). Social cognition in context: Validating a cartoon-based attributional measure for urban girls. Child Development, 77(5), 1351–1358.PubMedCrossRef
12.
go back to reference Leff, S. S., Lefler, E. K., Khera, G. S., Paskewich, B., & Jawad, A. F. (2012). Preliminary examination of a cartoon-based hostile attribution bias measure for urban African American boys. American Journal of Community Psychology, 49(3–4), 332–346.PubMedCentralPubMedCrossRef Leff, S. S., Lefler, E. K., Khera, G. S., Paskewich, B., & Jawad, A. F. (2012). Preliminary examination of a cartoon-based hostile attribution bias measure for urban African American boys. American Journal of Community Psychology, 49(3–4), 332–346.PubMedCentralPubMedCrossRef
13.
go back to reference VanderVeen, J. W., Reddy, L. F., Veilleux, J. C., January, A. M., & DiLillo, D. (2012). Clinical PhD graduate student views of their scientist-practitioner training. Journal of Clinical Psychology, 68(9), 1048–1057.PubMedCrossRef VanderVeen, J. W., Reddy, L. F., Veilleux, J. C., January, A. M., & DiLillo, D. (2012). Clinical PhD graduate student views of their scientist-practitioner training. Journal of Clinical Psychology, 68(9), 1048–1057.PubMedCrossRef
14.
go back to reference Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86(2), 127–137.PubMed Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86(2), 127–137.PubMed
Metadata
Title
Development, Validation, and Utility of an Instrument to Assess Core Competencies in the Leadership Education in Neurodevelopmental and Related Disabilities (LEND) Program
Authors
Stephen S. Leff
Katherine T. Baum
Katherine B. Bevans
Nathan J. Blum
Publication date
01-02-2015
Publisher
Springer US
Published in
Maternal and Child Health Journal / Issue 2/2015
Print ISSN: 1092-7875
Electronic ISSN: 1573-6628
DOI
https://doi.org/10.1007/s10995-014-1514-z

Other articles of this Issue 2/2015

Maternal and Child Health Journal 2/2015 Go to the issue