Skip to main content
Top
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Research

Development and testing of the Measure of Innovation-Specific Implementation Intentions (MISII) using Rasch measurement theory

Authors: Joanna C. Moullin, Mark G. Ehrhart, Gregory A. Aarons

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

Implementation is proposed to be a multiphase, multilevel process. After a period of exploration, an adoption decision is made, typically at the upper management or policy level. Nevertheless, movement through each of the subsequent phases of the implementation process involves clinicians or providers at the individual level to adopt the innovation and then change their behavior to use/deliver the innovation. Multiple behavioral change theories propose that intentions are a critical determinant of implementation behavior. However, there is a need for the development and testing of pragmatic measures of providers’ intentions to use a specific innovation or evidence-based practice (EBP).

Methods

Nine items were developed to assess providers’ intentions to use a specific innovation or EBP. Motivational interviewing was the EBP in the study. Items were administered, as part of larger survey, to 179 providers across 38 substance use disorder treatment (SUDT) programs within five agencies in California, USA. Rasch analysis was conducted using RUMM2030 software to assess the items, their overall fit to the Rasch model, the response scale used, individual item fit, differential item functioning (DIF), and person separation.

Results

Following a stepwise process, the scale was reduced from nine items to three items to increase the feasibility and acceptability of the scale while maintaining suitable psychometric properties. The three-item unidimensional scale showed good person separation (PSI = .872), no disordering of thresholds, and no evidence of uniform or non-uniform DIF. Rasch analysis supported the viability of the scale as a measure of implementation intentions.

Conclusions

The Measure of Innovation-Specific Implementation Intentions (MISII) is a sound measure of providers’ intentions to use a specific innovation or EBP. Future evaluation of convergent, divergent, and predictive validity are needed. The study also demonstrates the value of Rasch analysis for testing the psychometric properties of pragmatic implementation measures.
Literature
1.
go back to reference Brownson R, Colditz G, Proctor E, editors. Dissemination and implementation research in health: translating science to practice. 2nd ed. New York: Oxford University Press; 2018. Brownson R, Colditz G, Proctor E, editors. Dissemination and implementation research in health: translating science to practice. 2nd ed. New York: Oxford University Press; 2018.
2.
go back to reference Glasgow RE. What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Educ Behav. 2013;40:257–65.CrossRefPubMed Glasgow RE. What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Educ Behav. 2013;40:257–65.CrossRefPubMed
3.
go back to reference Aarons G, Hurlburt M, Horwitz S. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38:4–23.CrossRef Aarons G, Hurlburt M, Horwitz S. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38:4–23.CrossRef
4.
go back to reference Moullin J, Sabater-Hernández D, Fernandez-Llimos F, Benrimoj S. A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Res Policy Syst. 2015;13:16.CrossRefPubMedPubMedCentral Moullin J, Sabater-Hernández D, Fernandez-Llimos F, Benrimoj S. A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Res Policy Syst. 2015;13:16.CrossRefPubMedPubMedCentral
5.
go back to reference Ajzen I. The theory of planned behaviour. Organ Behav Hum Decis Processs. 1991;50:179–211.CrossRef Ajzen I. The theory of planned behaviour. Organ Behav Hum Decis Processs. 1991;50:179–211.CrossRef
6.
go back to reference Rosenstock IM. Historical origins of the health belief model. Health Educ Monogr. 1974;2:328–35.CrossRef Rosenstock IM. Historical origins of the health belief model. Health Educ Monogr. 1974;2:328–35.CrossRef
7.
go back to reference Rogers EM. Diffusion of innovations. New York: Free Press; 2003. p. 5. Rogers EM. Diffusion of innovations. New York: Free Press; 2003. p. 5.
8.
go back to reference Eccles MP, Hrisos S, Francis J, Kaner EF, Dickinson HO, Beyer F, Johnston M. Do self-reported intentions predict clinicians’ behaviour: a systematic review. Implement Sci. 2006;1:28.CrossRefPubMedPubMedCentral Eccles MP, Hrisos S, Francis J, Kaner EF, Dickinson HO, Beyer F, Johnston M. Do self-reported intentions predict clinicians’ behaviour: a systematic review. Implement Sci. 2006;1:28.CrossRefPubMedPubMedCentral
9.
go back to reference Sheeran P. Intention-behavior relations: a conceptual and empirical review. Eur Rev Soc Psychol. 2002;12:1–36.CrossRef Sheeran P. Intention-behavior relations: a conceptual and empirical review. Eur Rev Soc Psychol. 2002;12:1–36.CrossRef
10.
go back to reference Hrisos S, Eccles MP, Francis JJ, Dickinson HO, Kaner EFS, Beyer F, Johnston M. Are there valid proxy measures of clinical behaviour? A systematic review. Implement Sci. 2009;4:37.CrossRefPubMedPubMedCentral Hrisos S, Eccles MP, Francis JJ, Dickinson HO, Kaner EFS, Beyer F, Johnston M. Are there valid proxy measures of clinical behaviour? A systematic review. Implement Sci. 2009;4:37.CrossRefPubMedPubMedCentral
11.
go back to reference Hagger MS, Luszczynska A. Implementation intention and action planning interventions in health contexts: state of the research and proposals for the way forward. Appl Psychol Health Well-Being. 2014;6:1–47.CrossRefPubMed Hagger MS, Luszczynska A. Implementation intention and action planning interventions in health contexts: state of the research and proposals for the way forward. Appl Psychol Health Well-Being. 2014;6:1–47.CrossRefPubMed
12.
go back to reference Ajzen I, Fishbein M. The influence of attitudes on behavior. In: Albarracín D, Johnson BT, Zanna MP, editors. The handbook of attitudes. Abingdon: Routledge; 2005. p. 173–221. Ajzen I, Fishbein M. The influence of attitudes on behavior. In: Albarracín D, Johnson BT, Zanna MP, editors. The handbook of attitudes. Abingdon: Routledge; 2005. p. 173–221.
13.
go back to reference Williams N. Assessing mental health clinicians’ intentions to adopt evidence-based treatments: reliability and validity testing of the evidence-based treatment intentions scale. Implement Sci. 2016;11:60. Williams N. Assessing mental health clinicians’ intentions to adopt evidence-based treatments: reliability and validity testing of the evidence-based treatment intentions scale. Implement Sci. 2016;11:60.
14.
go back to reference Lewis CC, Fischer S, Weiner BJ, Stanick C, Kim M, Martinez RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implement Sci. 2015;10:1–17.CrossRef Lewis CC, Fischer S, Weiner BJ, Stanick C, Kim M, Martinez RG. Outcomes for implementation science: an enhanced systematic review of instruments using evidence-based rating criteria. Implement Sci. 2015;10:1–17.CrossRef
15.
go back to reference Cronbach L. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef Cronbach L. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef
16.
go back to reference Nunnally JC. Psychometric theory. 2nd ed. New York: McGraw-Hill; 1978. Nunnally JC. Psychometric theory. 2nd ed. New York: McGraw-Hill; 1978.
17.
go back to reference Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press; 1960. Rasch G. Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press; 1960.
18.
go back to reference Hagquist C, Bruce M, Gustavsson J. Using the Rasch model in nursing research: an introduction and illustrative example. Int J Nurs Stud. 2009;46:380–93.CrossRefPubMed Hagquist C, Bruce M, Gustavsson J. Using the Rasch model in nursing research: an introduction and illustrative example. Int J Nurs Stud. 2009;46:380–93.CrossRefPubMed
19.
go back to reference Tennant A, Conaghan P. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper. Arthritis Rheum. 2007;57:1358–62.CrossRefPubMed Tennant A, Conaghan P. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper. Arthritis Rheum. 2007;57:1358–62.CrossRefPubMed
20.
go back to reference Pallant J, Tennant A. An introduction to the Rasch measurement model: an example using the hospital anxiety and depression scale (HADS). Br J Clin Psychol. 2007;46:1–18.CrossRefPubMed Pallant J, Tennant A. An introduction to the Rasch measurement model: an example using the hospital anxiety and depression scale (HADS). Br J Clin Psychol. 2007;46:1–18.CrossRefPubMed
21.
go back to reference Engelhard G Jr. Invariant measurement: using Rasch models in the social, behavioral and health sciences. New York: Routledge; 2013.CrossRef Engelhard G Jr. Invariant measurement: using Rasch models in the social, behavioral and health sciences. New York: Routledge; 2013.CrossRef
22.
go back to reference DeVellis RF. Scale development: theory and applications. 3rd ed. California: Sage Publications; 2012. DeVellis RF. Scale development: theory and applications. 3rd ed. California: Sage Publications; 2012.
23.
go back to reference Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE. Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol. Implement Sci. 2017;12:29.CrossRefPubMedPubMedCentral Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE. Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol. Implement Sci. 2017;12:29.CrossRefPubMedPubMedCentral
24.
go back to reference Andrich D. Rating formulation for ordered response categories. Psychometrika. 1978;43:561–73.CrossRef Andrich D. Rating formulation for ordered response categories. Psychometrika. 1978;43:561–73.CrossRef
25.
go back to reference Andrich D, Lyne A, Sheridan B, Luo G. RUMM2030. Perth: RUMM Laboratory; 2009. Andrich D, Lyne A, Sheridan B, Luo G. RUMM2030. Perth: RUMM Laboratory; 2009.
26.
go back to reference Andrich D, Marais I. A course in Rasch measuremet theory. Perth: The University of Western Australia; 2018. Andrich D, Marais I. A course in Rasch measuremet theory. Perth: The University of Western Australia; 2018.
28.
go back to reference Pallant JF, Haines HM, Hildingsson I, Cross M, Rubertsson C. Psychometric evaluation and refinement of the Prenatal Attachment Inventory. J Reprod Infant Psychol. 2014;32:112–25.CrossRef Pallant JF, Haines HM, Hildingsson I, Cross M, Rubertsson C. Psychometric evaluation and refinement of the Prenatal Attachment Inventory. J Reprod Infant Psychol. 2014;32:112–25.CrossRef
29.
go back to reference Andrich D, Luo G. Conditional pairwise estimation in the Rasch model for ordered response categories using principal components. J Appl Meas. 2003;4:205–21.PubMed Andrich D, Luo G. Conditional pairwise estimation in the Rasch model for ordered response categories using principal components. J Appl Meas. 2003;4:205–21.PubMed
30.
go back to reference Smith EV Jr. Detecting and evaluation the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3:205–31.PubMed Smith EV Jr. Detecting and evaluation the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3:205–31.PubMed
31.
go back to reference Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Pearson; 2007. Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Pearson; 2007.
32.
go back to reference Bartlett MS. A note on multiplying factors for various chi square approximations. J R Stat Soc Series B Stat Methodol. 1954;16:296–8. Bartlett MS. A note on multiplying factors for various chi square approximations. J R Stat Soc Series B Stat Methodol. 1954;16:296–8.
33.
go back to reference Kaiser HF. A second generation little jiffy. Psychometrika. 1970;35:401–15.CrossRef Kaiser HF. A second generation little jiffy. Psychometrika. 1970;35:401–15.CrossRef
34.
go back to reference Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39:31–6.CrossRef Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39:31–6.CrossRef
35.
go back to reference Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–85.CrossRefPubMed Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–85.CrossRefPubMed
36.
37.
go back to reference Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50:179–211.CrossRef Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50:179–211.CrossRef
39.
go back to reference Dickson PR, Ginter JL. Market segmentation, product differentiation, and marketing strategy. J Mark. 1987;51:1–10.CrossRef Dickson PR, Ginter JL. Market segmentation, product differentiation, and marketing strategy. J Mark. 1987;51:1–10.CrossRef
40.
Metadata
Title
Development and testing of the Measure of Innovation-Specific Implementation Intentions (MISII) using Rasch measurement theory
Authors
Joanna C. Moullin
Mark G. Ehrhart
Gregory A. Aarons
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0782-1

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue