Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Research article

Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations

Authors: Linn Gjersing, John RM Caplehorn, Thomas Clausen

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

Research questionnaires are not always translated appropriately before they are used in new temporal, cultural or linguistic settings. The results based on such instruments may therefore not accurately reflect what they are supposed to measure. This paper aims to illustrate the process and required steps involved in the cross-cultural adaptation of a research instrument using the adaptation process of an attitudinal instrument as an example.

Methods

A questionnaire was needed for the implementation of a study in Norway 2007. There was no appropriate instruments available in Norwegian, thus an Australian-English instrument was cross-culturally adapted.

Results

The adaptation process included investigation of conceptual and item equivalence. Two forward and two back-translations were synthesized and compared by an expert committee. Thereafter the instrument was pretested and adjusted accordingly. The final questionnaire was administered to opioid maintenance treatment staff (n=140) and harm reduction staff (n=180). The overall response rate was 84%. The original instrument failed confirmatory analysis. Instead a new two-factor scale was identified and found valid in the new setting.

Conclusions

The failure of the original scale highlights the importance of adapting instruments to current research settings. It also emphasizes the importance of ensuring that concepts within an instrument are equal between the original and target language, time and context. If the described stages in the cross-cultural adaptation process had been omitted, the findings would have been misleading, even if presented with apparent precision. Thus, it is important to consider possible barriers when making a direct comparison between different nations, cultures and times.
Appendix
Available only for authorised users
Literature
1.
go back to reference Laake P, Olsen BR, Benestad HB: Research methodology in the medical and biological sciences. 2007, Amsterdam: Elsevier, Academic Press Laake P, Olsen BR, Benestad HB: Research methodology in the medical and biological sciences. 2007, Amsterdam: Elsevier, Academic Press
2.
go back to reference Herdman M, Fox-Rushby J, Badia X: A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998, 7: 323-335. 10.1023/A:1008846618880.CrossRefPubMed Herdman M, Fox-Rushby J, Badia X: A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998, 7: 323-335. 10.1023/A:1008846618880.CrossRefPubMed
3.
go back to reference Reichenheim ME, Moraes CL: Operationalizing the cross-cultural adaptation of epidemiological measurement instruments. Rev Saude Publica. 2007, 41: 665-673. 10.1590/S0034-89102006005000035.CrossRefPubMed Reichenheim ME, Moraes CL: Operationalizing the cross-cultural adaptation of epidemiological measurement instruments. Rev Saude Publica. 2007, 41: 665-673. 10.1590/S0034-89102006005000035.CrossRefPubMed
4.
go back to reference Beaton DE, Bombardier C, Guillemin F, Ferraz MB: Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000, 25: 3186-3191. 10.1097/00007632-200012150-00014.CrossRefPubMed Beaton DE, Bombardier C, Guillemin F, Ferraz MB: Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000, 25: 3186-3191. 10.1097/00007632-200012150-00014.CrossRefPubMed
5.
go back to reference Guillemin F, Bombardier C, Beaton D: Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993, 46: 1417-1432. 10.1016/0895-4356(93)90142-N.CrossRefPubMed Guillemin F, Bombardier C, Beaton D: Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993, 46: 1417-1432. 10.1016/0895-4356(93)90142-N.CrossRefPubMed
6.
go back to reference Wang W, Lee H, Fetzer SJ: Challenges and strategies of instrument translation. West J Nurs Res. 2006, 28: 310-321. 10.1177/0193945905284712.CrossRefPubMed Wang W, Lee H, Fetzer SJ: Challenges and strategies of instrument translation. West J Nurs Res. 2006, 28: 310-321. 10.1177/0193945905284712.CrossRefPubMed
7.
go back to reference Caplehorn JR, Irwig L, Saunders JB: Attitudes and beliefs of staff working in methadone maintenance clinics. Subst Use Misuse. 1996, 31: 437-452. 10.3109/10826089609045820.CrossRefPubMed Caplehorn JR, Irwig L, Saunders JB: Attitudes and beliefs of staff working in methadone maintenance clinics. Subst Use Misuse. 1996, 31: 437-452. 10.3109/10826089609045820.CrossRefPubMed
8.
go back to reference Caplehorn JR, Irwig L, Saunders JB: Physicians' attitudes and retention of patients in their methadone maintenance programs. Subst Use Misuse. 1996, 31: 663-677. 10.3109/10826089609045833.CrossRefPubMed Caplehorn JR, Irwig L, Saunders JB: Physicians' attitudes and retention of patients in their methadone maintenance programs. Subst Use Misuse. 1996, 31: 663-677. 10.3109/10826089609045833.CrossRefPubMed
9.
go back to reference Caplehorn RM, Lumley TS, Irwig L, Saunders JB: Changing attitudes and beliefs of staff working in methadone maintenance programs. Aust N Z J Public Health. 1998, 22: 505-508. 10.1111/j.1467-842X.1998.tb01422.x.CrossRefPubMed Caplehorn RM, Lumley TS, Irwig L, Saunders JB: Changing attitudes and beliefs of staff working in methadone maintenance programs. Aust N Z J Public Health. 1998, 22: 505-508. 10.1111/j.1467-842X.1998.tb01422.x.CrossRefPubMed
10.
go back to reference Caplehorn JR, Lumley TS, Irwig L: Staff attitudes and retention of patients in methadone maintenance programs. Drug Alcohol Depend. 1998, 52: 57-61. 10.1016/S0376-8716(98)00047-7.CrossRefPubMed Caplehorn JR, Lumley TS, Irwig L: Staff attitudes and retention of patients in methadone maintenance programs. Drug Alcohol Depend. 1998, 52: 57-61. 10.1016/S0376-8716(98)00047-7.CrossRefPubMed
11.
go back to reference Gjersing LR, Butler T, Caplehorn JR, Belcher JM, Matthews R: Attitudes and beliefs towards methadone maintenance treatment among Australian prison health staff. Drug & Alcohol Review. 2007, 26: 501-508. 10.1080/09595230701499118.CrossRef Gjersing LR, Butler T, Caplehorn JR, Belcher JM, Matthews R: Attitudes and beliefs towards methadone maintenance treatment among Australian prison health staff. Drug & Alcohol Review. 2007, 26: 501-508. 10.1080/09595230701499118.CrossRef
12.
go back to reference Kang SY, Magura S, Nwakeze PC, Demsky S: Counselor Attitudes in Methadone Maintenance. Journal of maintenance in the addictions. 1997, 1: 41-58. 10.1300/J126v01n02_04.CrossRef Kang SY, Magura S, Nwakeze PC, Demsky S: Counselor Attitudes in Methadone Maintenance. Journal of maintenance in the addictions. 1997, 1: 41-58. 10.1300/J126v01n02_04.CrossRef
13.
go back to reference Caplehorn J: Knowledge of methadone toxicity among US maintenance clinic staff. Journal of maintenance in the addictions. 2000, 1: 63-72. 10.1300/J126v01n04_06.CrossRef Caplehorn J: Knowledge of methadone toxicity among US maintenance clinic staff. Journal of maintenance in the addictions. 2000, 1: 63-72. 10.1300/J126v01n04_06.CrossRef
14.
go back to reference Caplehorn JR, Hartel DM, Irwig L: Measuring and comparing the attitudes and beliefs of staff working in New York methadone maintenance clinics. Subst Use Misuse. 1997, 32: 399-413. 10.3109/10826089709039361.CrossRefPubMed Caplehorn JR, Hartel DM, Irwig L: Measuring and comparing the attitudes and beliefs of staff working in New York methadone maintenance clinics. Subst Use Misuse. 1997, 32: 399-413. 10.3109/10826089709039361.CrossRefPubMed
15.
go back to reference Gerlach R, Caplehorn J: Knowledge of methadone toxicity among US maintenance clinic staff. Drug Alcohol Rev. 1999, 18: 163-170. 10.1080/09595239996590.CrossRef Gerlach R, Caplehorn J: Knowledge of methadone toxicity among US maintenance clinic staff. Drug Alcohol Rev. 1999, 18: 163-170. 10.1080/09595239996590.CrossRef
16.
go back to reference Vossenberg P: Attitudes and beliefs towards methadone of staff working in substance abuse treatment. Heroin Addiction & Related Clinical Problems. 2000, 2: 15-21. Vossenberg P: Attitudes and beliefs towards methadone of staff working in substance abuse treatment. Heroin Addiction & Related Clinical Problems. 2000, 2: 15-21.
17.
go back to reference Gerlach R, Caplehorn JRM: Attitudes and beliefs of doctors prescribing methadone to addicts in the Westfalen-Lippe region of Germany. Drug and Alcohol Review. 1999, 18: 163-170. 10.1080/09595239996590.CrossRef Gerlach R, Caplehorn JRM: Attitudes and beliefs of doctors prescribing methadone to addicts in the Westfalen-Lippe region of Germany. Drug and Alcohol Review. 1999, 18: 163-170. 10.1080/09595239996590.CrossRef
18.
go back to reference Gonzales-Saiz F, Salvador Carulla L: Medida de las actitudes y conocimientos de los profesionales de programas de mantenimiento con metadona: datos preliminares. Adicciones. 1998, 10: 315-319. Gonzales-Saiz F, Salvador Carulla L: Medida de las actitudes y conocimientos de los profesionales de programas de mantenimiento con metadona: datos preliminares. Adicciones. 1998, 10: 315-319.
19.
go back to reference Likert R: A technique for the measurement of attitudes. Archives of psychology. 1932, 140: 5-53. Likert R: A technique for the measurement of attitudes. Archives of psychology. 1932, 140: 5-53.
20.
go back to reference SPSS Inc: SPSS (release 16.0) statistical software. 2008, Chicago, Illinois, SPSS Inc SPSS Inc: SPSS (release 16.0) statistical software. 2008, Chicago, Illinois, SPSS Inc
21.
go back to reference SPSS Inc: AMOS (release 17.0) statistical software. 2009, Chicago, Illinois, SPSS Inc SPSS Inc: AMOS (release 17.0) statistical software. 2009, Chicago, Illinois, SPSS Inc
22.
go back to reference Brown TA: Confirmatory factor analysis for applied research. 2006, New York: Guilford Press Brown TA: Confirmatory factor analysis for applied research. 2006, New York: Guilford Press
23.
go back to reference Byrne BM: Structural equation modeling with AMOS. Basic concepts, applications, and programming. 2001, Mahwah, N.J: Lawrence Erlbaum Associates Byrne BM: Structural equation modeling with AMOS. Basic concepts, applications, and programming. 2001, Mahwah, N.J: Lawrence Erlbaum Associates
24.
go back to reference Kline RB: Principles and practice of structural equation modeling. 2005, New York: Guilford Press Kline RB: Principles and practice of structural equation modeling. 2005, New York: Guilford Press
25.
go back to reference Bentler PM: Comparative fit indexes in structural models. Psychol Bull. 1990, 107: 238-246. 10.1037/0033-2909.107.2.238.CrossRefPubMed Bentler PM: Comparative fit indexes in structural models. Psychol Bull. 1990, 107: 238-246. 10.1037/0033-2909.107.2.238.CrossRefPubMed
26.
go back to reference Tucker LR, Lewis C: A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973, 38: 1-10. 10.1007/BF02291170.CrossRef Tucker LR, Lewis C: A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973, 38: 1-10. 10.1007/BF02291170.CrossRef
27.
go back to reference Steiger JH: Structural Model Evaluation and Modification - An Interval Estimation Approach. Multivariate Behavioral Research. 1990, 25: 173-180. 10.1207/s15327906mbr2502_4.CrossRefPubMed Steiger JH: Structural Model Evaluation and Modification - An Interval Estimation Approach. Multivariate Behavioral Research. 1990, 25: 173-180. 10.1207/s15327906mbr2502_4.CrossRefPubMed
28.
go back to reference Fornell C, Larcker FD: Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research. 1981, 18: 39-50. 10.2307/3151312.CrossRef Fornell C, Larcker FD: Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research. 1981, 18: 39-50. 10.2307/3151312.CrossRef
29.
go back to reference Akaike H: Factor-Analysis and Aic. Psychometrika. 1987, 52: 317-332. 10.1007/BF02294359.CrossRef Akaike H: Factor-Analysis and Aic. Psychometrika. 1987, 52: 317-332. 10.1007/BF02294359.CrossRef
30.
go back to reference Browne MW, Cudeck R: Single Sample Cross-Validation Indices for Covariance Structures. Multivariate Behavioral Research. 1989, 24: 445-455. 10.1207/s15327906mbr2404_4.CrossRefPubMed Browne MW, Cudeck R: Single Sample Cross-Validation Indices for Covariance Structures. Multivariate Behavioral Research. 1989, 24: 445-455. 10.1207/s15327906mbr2404_4.CrossRefPubMed
31.
go back to reference Hair JF: Multivariate data analysis: a global perspective. 2010, Upper Saddle River, N.J.: Pearson Hair JF: Multivariate data analysis: a global perspective. 2010, Upper Saddle River, N.J.: Pearson
32.
go back to reference Hu Lt, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999, 6: 1-55. 10.1080/10705519909540118.CrossRef Hu Lt, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999, 6: 1-55. 10.1080/10705519909540118.CrossRef
33.
go back to reference Gossop M, Marsden J, Stewart D, Treacy S: Outcomes after methadone maintenance and methadone reduction treatments: two-year follow-up results from the National Treatment Outcome Research Study. Drug & Alcohol Dependence. 2001, 62: 255-264. 10.1016/S0376-8716(00)00211-8.CrossRef Gossop M, Marsden J, Stewart D, Treacy S: Outcomes after methadone maintenance and methadone reduction treatments: two-year follow-up results from the National Treatment Outcome Research Study. Drug & Alcohol Dependence. 2001, 62: 255-264. 10.1016/S0376-8716(00)00211-8.CrossRef
34.
go back to reference Kornor H, Waal H, Sandvik L: Time-limited buprenorphine replacement therapy for opioid dependence: 2-year follow-up outcomes in relation to programme completion and current agonist therapy status. Drug & Alcohol Review. 2007, 26: 135-141. 10.1080/09595230601146603.CrossRef Kornor H, Waal H, Sandvik L: Time-limited buprenorphine replacement therapy for opioid dependence: 2-year follow-up outcomes in relation to programme completion and current agonist therapy status. Drug & Alcohol Review. 2007, 26: 135-141. 10.1080/09595230601146603.CrossRef
35.
go back to reference Waal H, Clausen T, Aamodt C, Lillevold PH: Annual assessment of the Norwegian OMT programme. Oslo. 2007 Waal H, Clausen T, Aamodt C, Lillevold PH: Annual assessment of the Norwegian OMT programme. Oslo. 2007
36.
go back to reference Waal H, Clausen T, Håseth A, Lillevold PH: Annual assessment of the Norwegian OMT programme. Oslo. 2008 Waal H, Clausen T, Håseth A, Lillevold PH: Annual assessment of the Norwegian OMT programme. Oslo. 2008
Metadata
Title
Cross-cultural adaptation of research instruments: language, setting, time and statistical considerations
Authors
Linn Gjersing
John RM Caplehorn
Thomas Clausen
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-13

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue