Skip to main content
Top
Published in: Prevention Science 4/2006

01-12-2006 | Original paper

Examining Equivalence of Concepts and Measures in Diverse Samples

Authors: Tracy W. Harachi, Yoonsun Choi, Robert D. Abbott, Richard F. Catalano, Siri L. Bliesner

Published in: Prevention Science | Issue 4/2006

Login to get access

Abstract

While there is growing awareness for the need to examine the etiology of problem behaviors across cultural, racial, socioeconomic, and gender groups, much research tends to assume that constructs are equivalent and that the measures developed within one group equally assess constructs across groups. The meaning of constructs, however, may differ across groups or, if similar in meaning, measures developed for a given construct in one particular group may not be assessing the same construct or may not be assessing the construct in the same manner in other groups. The aims of this paper were to demonstrate a process of testing several forms of equivalence including conceptual, functional, item, and scalar using different methods. Data were from the Cross-Cultural Families Project, a study examining factors that promote the healthy development and adjustment of children among immigrant Cambodian and Vietnamese families. The process described in this paper can be implemented in other prevention studies interested in diverse groups. Demonstrating equivalence of constructs and measures prior to group comparisons is necessary in order to lend support of our interpretation of issues such as ethnic group differences and similarities.
Literature
go back to reference Bentler, P. M. (1990). Comparative fix indexes in structural models. Psychological Bulletin, 107, 238–246.CrossRefPubMed Bentler, P. M. (1990). Comparative fix indexes in structural models. Psychological Bulletin, 107, 238–246.CrossRefPubMed
go back to reference Bentler, P. M. (1993). EQS: Structural equations program manual. Los Angeles, CA: BMDP Statistical Software. Bentler, P. M. (1993). EQS: Structural equations program manual. Los Angeles, CA: BMDP Statistical Software.
go back to reference Byrne, B. M. (1994). Structural equation modeling with EQS and EQS-Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage Publications. Byrne, B. M. (1994). Structural equation modeling with EQS and EQS-Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage Publications.
go back to reference Byrne, B. M., Shavelson, R. J., & Muthen, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466.CrossRef Byrne, B. M., Shavelson, R. J., & Muthen, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466.CrossRef
go back to reference Cahn, D., & Stansell, J. (Eds.). (2005). From Refugee to Deportee: How U.S. Immigration Law Failed the Cambodian Community: K. H. Barrett, & W. H. George (Eds.). (2005). Race, culture, psychology, and law. (pp. 237–254). xvii, 478 pp. Thousand Oaks, CA, US: Sage Publications, Inc. Cahn, D., & Stansell, J. (Eds.). (2005). From Refugee to Deportee: How U.S. Immigration Law Failed the Cambodian Community: K. H. Barrett, & W. H. George (Eds.). (2005). Race, culture, psychology, and law. (pp. 237–254). xvii, 478 pp. Thousand Oaks, CA, US: Sage Publications, Inc.
go back to reference Catalano, R. F., Hawkins, J. D., Krenz, C., Gillmore, M., Morrison, D., Wells, E., et al. (1993). Using research to guide culturally appropriate drug abuse prevention. Journal of Consulting and Clinical Psychology, 61, 804–811.CrossRefPubMed Catalano, R. F., Hawkins, J. D., Krenz, C., Gillmore, M., Morrison, D., Wells, E., et al. (1993). Using research to guide culturally appropriate drug abuse prevention. Journal of Consulting and Clinical Psychology, 61, 804–811.CrossRefPubMed
go back to reference Cauce, A. M., Coronado, N., & Watson, J. (1998). Conceptual, methodological, and statistical issues in culturally competent research. In M. Hernandez & R. Isaacs (Eds.), Promoting cultural competence in children's mental health services. (pp. 305–329). Baltimore, MD: Paul H. Brookes. Cauce, A. M., Coronado, N., & Watson, J. (1998). Conceptual, methodological, and statistical issues in culturally competent research. In M. Hernandez & R. Isaacs (Eds.), Promoting cultural competence in children's mental health services. (pp. 305–329). Baltimore, MD: Paul H. Brookes.
go back to reference Forsyth, B. H., Lessler, J. T., & Hubbard, M. L. (1992). Cognitive evaluation of the questionnaire. In C. F. Turner, J. T. Lessler, & J. C. Gfroerer (Eds.), Survey measurement of drug use: Methodological studies (DHHS Publication No. ADM 92–1929, pp. 13–52). Rockville, MD: National Institute on Drug Abuse. Forsyth, B. H., Lessler, J. T., & Hubbard, M. L. (1992). Cognitive evaluation of the questionnaire. In C. F. Turner, J. T. Lessler, & J. C. Gfroerer (Eds.), Survey measurement of drug use: Methodological studies (DHHS Publication No. ADM 921929, pp. 1352). Rockville, MD: National Institute on Drug Abuse.
go back to reference Fuller, T. D., Edwards, J. N., Vorakitphokatorn, S., & Sermsri, S. (1993). Using focus groups to adapt survey instruments to new populations: Experience from a developing country. In D. L. Morgan (Ed.) Successful focus groups: Advancing the state of the art (Vol. 156, pp. 89–104). Thousand Oaks, CA: Sage Publications. Fuller, T. D., Edwards, J. N., Vorakitphokatorn, S., & Sermsri, S. (1993). Using focus groups to adapt survey instruments to new populations: Experience from a developing country. In D. L. Morgan (Ed.) Successful focus groups: Advancing the state of the art (Vol. 156, pp. 89–104). Thousand Oaks, CA: Sage Publications.
go back to reference Gottfredson, D. C., & Koper, C. S. (1997). Race and sex differences in the measurement of risk for drug use. Journal of Quantitative Criminology, 13, 325–347.CrossRef Gottfredson, D. C., & Koper, C. S. (1997). Race and sex differences in the measurement of risk for drug use. Journal of Quantitative Criminology, 13, 325–347.CrossRef
go back to reference Griffin, K. W., Scheier, L. M., Botvin, G. J., Diaz, T., & Miller, N. (1999). Interpersonal aggression in urban minority youth: Mediators of perceived neighbhorhood, peer, and parental influcences. Journal of Community Psychology, 27, 281– 298.CrossRef Griffin, K. W., Scheier, L. M., Botvin, G. J., Diaz, T., & Miller, N. (1999). Interpersonal aggression in urban minority youth: Mediators of perceived neighbhorhood, peer, and parental influcences. Journal of Community Psychology, 27, 281– 298.CrossRef
go back to reference Harkness, J. A., Mohler, P. Ph., & Van de Vijver, F. J. R. (2003). Comparative research. In J. A. Harkness, F. J. R. Van de Vijver, & P. Ph. Mohler (Eds.). Cross-cultural survey methods (pp. 3–16). Hoboken, NJ: John Wiley & Sons. Harkness, J. A., Mohler, P. Ph., & Van de Vijver, F. J. R. (2003). Comparative research. In J. A. Harkness, F. J. R. Van de Vijver, & P. Ph. Mohler (Eds.). Cross-cultural survey methods (pp. 3–16). Hoboken, NJ: John Wiley & Sons.
go back to reference Harkness, J. A., Van De Vijver, F. J. R., & Mohler, P. P. H. (2003). Cross-cultural survey methods. Hoboken, NJ: John Wiley & Sons. Harkness, J. A., Van De Vijver, F. J. R., & Mohler, P. P. H. (2003). Cross-cultural survey methods. Hoboken, NJ: John Wiley & Sons.
go back to reference Hobbs, F., & Stoops, N. (2002). Demographic trends in the 20th century: Census 2000 special reports (Series CENSR-4). Washington, DC: U.S. Government Printing Office. Hobbs, F., & Stoops, N. (2002). Demographic trends in the 20th century: Census 2000 special reports (Series CENSR-4). Washington, DC: U.S. Government Printing Office.
go back to reference Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144.PubMed Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144.PubMed
go back to reference Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.CrossRef Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.CrossRef
go back to reference Huebner, A., & Howell, L. W. (2003). Examining the relationship between adolescent sexual risk-taking and perceptions of monitoring, communication, and parenting styles. Journal of Adolescent Health, 33, 71–78.CrossRefPubMed Huebner, A., & Howell, L. W. (2003). Examining the relationship between adolescent sexual risk-taking and perceptions of monitoring, communication, and parenting styles. Journal of Adolescent Health, 33, 71–78.CrossRefPubMed
go back to reference Hui, C. H., & Triandis, H. C. (1985). Measurement in cross-cultural psychology—a review and comparison of strategies. Journal of Cross-Cultural Psychology, 16, 131–152. Hui, C. H., & Triandis, H. C. (1985). Measurement in cross-cultural psychology—a review and comparison of strategies. Journal of Cross-Cultural Psychology, 16, 131–152.
go back to reference Jobe, J. B., & Mingay, D. J. (1990). Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Reports, 105, 518–524.PubMed Jobe, J. B., & Mingay, D. J. (1990). Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Reports, 105, 518–524.PubMed
go back to reference Kline, R. B. (1998). Principles and practice of structural equation modeling. NY: Guilford Press. Kline, R. B. (1998). Principles and practice of structural equation modeling. NY: Guilford Press.
go back to reference Knight, G. P., & Hill, N. E. (1998). Measurement equivalence in research involving minority adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 183–210). Mahwah, NJ: Erlbaum. Knight, G. P., & Hill, N. E. (1998). Measurement equivalence in research involving minority adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 183–210). Mahwah, NJ: Erlbaum.
go back to reference Knight, G. P., Tein, J. Y., Shell, R., & Roosa, M. (1992). The cross-ethnic equivalence of parenting and family interaction measures among Hispanic and Anglo-American families. Child Development, 63, 1392–1403.CrossRefPubMed Knight, G. P., Tein, J. Y., Shell, R., & Roosa, M. (1992). The cross-ethnic equivalence of parenting and family interaction measures among Hispanic and Anglo-American families. Child Development, 63, 1392–1403.CrossRefPubMed
go back to reference MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.CrossRef MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.CrossRef
go back to reference Marshall, G. N., Schell, T. L., Elliott, M. N., Berthold, S. M., & Chun, C.-A. (2005). Mental health of Cambodian refugees 2 decades after resettlement in the United States. JAMA: Journal of the American Medical Association, 294, 571–579.CrossRefPubMed Marshall, G. N., Schell, T. L., Elliott, M. N., Berthold, S. M., & Chun, C.-A. (2005). Mental health of Cambodian refugees 2 decades after resettlement in the United States. JAMA: Journal of the American Medical Association, 294, 571–579.CrossRefPubMed
go back to reference McLoyd, V. C., & Steinberg, L. (Eds.) (1998). Studying minority adolescents. Mahwah, NJ: Lawrence Erlbaum Associates McLoyd, V. C., & Steinberg, L. (Eds.) (1998). Studying minority adolescents. Mahwah, NJ: Lawrence Erlbaum Associates
go back to reference McLoyd, V. C. (1998). Changing demographics in the American population: Implications for research on minority children and adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 3–28). Mahwah, NJ: Erlbaum. McLoyd, V. C. (1998). Changing demographics in the American population: Implications for research on minority children and adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 3–28). Mahwah, NJ: Erlbaum.
go back to reference Olson, D. H., Portner, J., & Bell, R. (1982). Family adaptability and cohesion evaluation scales. St. Paul: University of Minnesota Press. Olson, D. H., Portner, J., & Bell, R. (1982). Family adaptability and cohesion evaluation scales. St. Paul: University of Minnesota Press.
go back to reference O’Neil, R., Parke, R. D., & McDowell, D. J. (2001). Objective and subjective features of children's neighborhoods: Relations to parental regulatory strategies and children's social competence. Applied Developmental Psychology, 22, 135–155.CrossRef O’Neil, R., Parke, R. D., & McDowell, D. J. (2001). Objective and subjective features of children's neighborhoods: Relations to parental regulatory strategies and children's social competence. Applied Developmental Psychology, 22, 135–155.CrossRef
go back to reference Pons, D. A., F.L., Balaguer, I., & Garcia Merita, M. L. (2000). Satisfaction with Life Scale: Analysis of factorial invariance for adolescents and elderly persons. Perceptual and Motor Skills, 91, 62– 68.PubMed Pons, D. A., F.L., Balaguer, I., & Garcia Merita, M. L. (2000). Satisfaction with Life Scale: Analysis of factorial invariance for adolescents and elderly persons. Perceptual and Motor Skills, 91, 62– 68.PubMed
go back to reference Robinson, C. C., Mandleco, B. F., Olsen, S., & Hart, C. H. (1995). Authoritative, authoritarian, and permissive parenting practices: Development of a new measure. Psychological Reports, 77, 819–830. Robinson, C. C., Mandleco, B. F., Olsen, S., & Hart, C. H. (1995). Authoritative, authoritarian, and permissive parenting practices: Development of a new measure. Psychological Reports, 77, 819–830.
go back to reference Rosay, A. B., Gottfredson, D. C., Armstrong, T. A., & Harmon, M. A. (2000). Invariance of measures of prevention program effectiveness: A replication. Journal of Quantitative Criminology, 16, 341–367.CrossRef Rosay, A. B., Gottfredson, D. C., Armstrong, T. A., & Harmon, M. A. (2000). Invariance of measures of prevention program effectiveness: A replication. Journal of Quantitative Criminology, 16, 341–367.CrossRef
go back to reference Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90.CrossRef Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90.CrossRef
go back to reference Steiger, J. H., & Lind, J. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA. Steiger, J. H., & Lind, J. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
go back to reference Triandis, H. C. (1993). Collectivism and individualism as cultural syndromes. Cross-Cultural Psychology, 27, 155–180. Triandis, H. C. (1993). Collectivism and individualism as cultural syndromes. Cross-Cultural Psychology, 27, 155–180.
go back to reference U. S. Department of Education. (2002). Inside No Child Left Behind. Title IV–21st Century Schools, Part A–Safe and Drug-Free Schools and Communities. Retrieved the World Wide Web: http://www.ed.gov/legislation/ESEA02/pg51.html. U. S. Department of Education. (2002). Inside No Child Left Behind. Title IV21st Century Schools, Part ASafe and Drug-Free Schools and Communities. Retrieved the World Wide Web: http://​www.​ed.​gov/​legislation/​ESEA02/​pg51.​html.​
go back to reference Van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Newbury Park, CA: Sage Publications. Van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Newbury Park, CA: Sage Publications.
go back to reference Vandenberg, R. J. (2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139– 158. Vandenberg, R. J. (2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139– 158.
go back to reference Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69.
go back to reference Wu, P., Robinson, C. C., Yang, C., Hart, C. H., Olsen, S. F., Porter, C. L., Jin, S., Wo, J., & Wu, X. (2002). Similarities and differences in mothers’ parenting of preschoolers in China and the United States. International Journal of Behavioral Development, 26, 481–491.CrossRef Wu, P., Robinson, C. C., Yang, C., Hart, C. H., Olsen, S. F., Porter, C. L., Jin, S., Wo, J., & Wu, X. (2002). Similarities and differences in mothers’ parenting of preschoolers in China and the United States. International Journal of Behavioral Development, 26, 481–491.CrossRef
go back to reference Yu, E. S. H. (1985). Studying Vietnamese refugees: Methodological lessons in transcultural research. In T. C. Owan (Ed.) Southeast Asian mental health: Treatment, prevention, services, training and research (DHHS Publication No. ADM 85–1399, pp. 517–541). Washington, DC: U.S. Government Printing Office. Yu, E. S. H. (1985). Studying Vietnamese refugees: Methodological lessons in transcultural research. In T. C. Owan (Ed.) Southeast Asian mental health: Treatment, prevention, services, training and research (DHHS Publication No. ADM 851399, pp. 517541). Washington, DC: U.S. Government Printing Office.
Metadata
Title
Examining Equivalence of Concepts and Measures in Diverse Samples
Authors
Tracy W. Harachi
Yoonsun Choi
Robert D. Abbott
Richard F. Catalano
Siri L. Bliesner
Publication date
01-12-2006
Published in
Prevention Science / Issue 4/2006
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-006-0039-0

Other articles of this Issue 4/2006

Prevention Science 4/2006 Go to the issue