Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2011

Open Access 01-12-2011 | Research article

Cross-cultural validation of the Educational Needs Assessment Tool in RA in 7 European countries

Authors: Mwidimi Ndosi, Alan Tennant, Ulrika Bergsten, Marja Leena Kukkurainen, Pedro Machado, Jenny de la Torre-Aboki, Thea PM Vliet Vlieland, Heidi A Zangi, Jackie Hill

Published in: BMC Musculoskeletal Disorders | Issue 1/2011

Login to get access

Abstract

Background

The Educational Needs Assessment Tool (the ENAT) is a 39-item patient questionnaire originally developed in the UK to assess educational needs of patients with rheumatoid arthritis (RA). The objective of this study was to assess the cross-cultural validity of the ENAT in 7 European countries.

Methods

The ENAT was translated into Dutch, Finnish, Norwegian, Portuguese, Spanish and Swedish versions by using Beaton's cross-cultural adaptation process, and was completed by a convenience sample of patients with RA in each country. The generated country-specific data were assessed for construct validity and were then pooled and assessed for cross-cultural invariance using Rasch analysis.

Results

Individual country-specific analysis showed adequate fit to the Rasch model after adjustment for local dependency within domains. When data from the different countries were pooled, the 39 items deviated significantly from Rasch model's expectations (X2 = 977.055, DF = 351, p = 0.000, PSI = 0.976). Again, most items within domains were found to be locally dependent, significantly affecting the fit. Consequently each domain was treated as a unit (i.e. testlet) and the ENAT was re-analysed as a seven-testlet scale resulting into a good fit to the Rasch model (X2 = 71.909; DF = 63; p = 0.207, PSI = 0.951). A test of strict unidimensionality confirmed that all domains contributed to measuring a single construct. Cross-cultural non-invariance was discounted by splitting domains for DIF maintaining an excellent fit to the Rasch model. This allowed calibration of the ENAT into an interval scale.

Conclusion

The ENAT is a simple tool, which is a valid measure of educational needs of people with RA. Adjustment for cross-cultural non-invariance is available if data from the 7 European countries are to be pooled or compared.
Appendix
Available only for authorised users
Literature
1.
go back to reference Scott D, Symmons D, Coulton B, Popert A: Long-term outcome of treating rheumatoid arthritis: results after 20 years. Lancent. 1987, 1: 1108-1111.CrossRef Scott D, Symmons D, Coulton B, Popert A: Long-term outcome of treating rheumatoid arthritis: results after 20 years. Lancent. 1987, 1: 1108-1111.CrossRef
2.
go back to reference Pincus T, Callahan LF: Taking mortality in rheumatoid arthritis seriously - predictive markers, socioeconomic status and comorbidity. J Rheumatol. 1986, 13 (5): 841-845.PubMed Pincus T, Callahan LF: Taking mortality in rheumatoid arthritis seriously - predictive markers, socioeconomic status and comorbidity. J Rheumatol. 1986, 13 (5): 841-845.PubMed
3.
go back to reference Singh JA, Christensen R, Wells GA, Suarez-Almazor ME, Buchbinder R, Lopez-Olivo MA, Ghogomu ET, Tugwell P: A network meta-analysis of randomized controlled trials of biologics for rheumatoid arthritis: a Cochrane overview. CMAJ. 2009, 181 (11): 787-796. 10.1503/cmaj.091391.CrossRefPubMedPubMedCentral Singh JA, Christensen R, Wells GA, Suarez-Almazor ME, Buchbinder R, Lopez-Olivo MA, Ghogomu ET, Tugwell P: A network meta-analysis of randomized controlled trials of biologics for rheumatoid arthritis: a Cochrane overview. CMAJ. 2009, 181 (11): 787-796. 10.1503/cmaj.091391.CrossRefPubMedPubMedCentral
4.
go back to reference Alonso-Ruiz A, Pijoan JI, Ansuategui E, Urkaregi A, Calabozo M, Quintana A: Tumor necrosis factor alpha drugs in rheumatoid arthritis: systematic review and metaanalysis of efficacy and safety. BMC Musculoskeletal Disorders. 2008, 9: 52-10.1186/1471-2474-9-52.CrossRefPubMedPubMedCentral Alonso-Ruiz A, Pijoan JI, Ansuategui E, Urkaregi A, Calabozo M, Quintana A: Tumor necrosis factor alpha drugs in rheumatoid arthritis: systematic review and metaanalysis of efficacy and safety. BMC Musculoskeletal Disorders. 2008, 9: 52-10.1186/1471-2474-9-52.CrossRefPubMedPubMedCentral
5.
go back to reference Hill J: Patient education in the rheumatic diseases. Nursing standard. 1995, 9: 25-28.PubMed Hill J: Patient education in the rheumatic diseases. Nursing standard. 1995, 9: 25-28.PubMed
6.
go back to reference Combe B, Landewe R, Lukas C, Bolosiu HD, Breedveld F, Dougados M, Emery P, Ferraccioli G, Hazes JMW, Klareskog L: EULAR recommendations for the management of early arthritis: report of a task force of the European Standing Committee for International Clinical Studies Including Therapeutics (ESCISIT). Annals of the Rheumatic Diseases. 2007, 66 (1): 34-45.CrossRefPubMed Combe B, Landewe R, Lukas C, Bolosiu HD, Breedveld F, Dougados M, Emery P, Ferraccioli G, Hazes JMW, Klareskog L: EULAR recommendations for the management of early arthritis: report of a task force of the European Standing Committee for International Clinical Studies Including Therapeutics (ESCISIT). Annals of the Rheumatic Diseases. 2007, 66 (1): 34-45.CrossRefPubMed
8.
go back to reference Niedermann K, Fransen J, Knols R, Uebelhart D: Gap between short- and long-term effects of patient education in rheumatoid arthritis patients: A systematic review. Arthritis Rheum. 2004, 51 (3): 388-398. 10.1002/art.20399.CrossRefPubMed Niedermann K, Fransen J, Knols R, Uebelhart D: Gap between short- and long-term effects of patient education in rheumatoid arthritis patients: A systematic review. Arthritis Rheum. 2004, 51 (3): 388-398. 10.1002/art.20399.CrossRefPubMed
9.
go back to reference Reimsma R, Taal E, Kirwan J, Rasker J: Systematic review of rheumatoid arthritis patient education. Arthritis Rheum. 2004, 51 (6): 1045-1059. 10.1002/art.20823.CrossRef Reimsma R, Taal E, Kirwan J, Rasker J: Systematic review of rheumatoid arthritis patient education. Arthritis Rheum. 2004, 51 (6): 1045-1059. 10.1002/art.20823.CrossRef
10.
go back to reference Koehn CL, Esdaile JM: Patient education and self-management of musculoskeletal diseases. Best Pract Res Clin Rheumatol. 2008, 22 (3): 395-405. 10.1016/j.berh.2008.02.006.CrossRefPubMed Koehn CL, Esdaile JM: Patient education and self-management of musculoskeletal diseases. Best Pract Res Clin Rheumatol. 2008, 22 (3): 395-405. 10.1016/j.berh.2008.02.006.CrossRefPubMed
11.
go back to reference Hardware B, Anne Lacey E, Shewan J: Towards the development of a tool to assess educational needs in patients with arthritis. Clinical Effectiveness in Nursing. 2004, 8 (2): 111-117. 10.1016/j.cein.2004.06.001.CrossRef Hardware B, Anne Lacey E, Shewan J: Towards the development of a tool to assess educational needs in patients with arthritis. Clinical Effectiveness in Nursing. 2004, 8 (2): 111-117. 10.1016/j.cein.2004.06.001.CrossRef
12.
go back to reference Hill J, Tennant A, Adebajo A: Further development of an educational needs tool (ENAT) for patients with rheumatoid arthritis. Arthritis and Rheumatism. 2004, 50 (9 suppl): 616- Hill J, Tennant A, Adebajo A: Further development of an educational needs tool (ENAT) for patients with rheumatoid arthritis. Arthritis and Rheumatism. 2004, 50 (9 suppl): 616-
13.
go back to reference Petersen M, Groenvold M, Bjorner J, Aaronson N, Conroy T, Cull A, Fayers P, Hjermstad M, Sprangers M, Sullivan M: Use of differential item functioning analysis to assess the equivalence of translations of a questionnaire. Quality of Life Research. 2003, 12 (4): 373-385. 10.1023/A:1023488915557.CrossRefPubMed Petersen M, Groenvold M, Bjorner J, Aaronson N, Conroy T, Cull A, Fayers P, Hjermstad M, Sprangers M, Sullivan M: Use of differential item functioning analysis to assess the equivalence of translations of a questionnaire. Quality of Life Research. 2003, 12 (4): 373-385. 10.1023/A:1023488915557.CrossRefPubMed
14.
go back to reference Tennant A, Penta M, Tesio L, Grimby G, Thonnard J-L, Slade A, Lawton G, Simone A, Carter J, Lundgren-Nilsson Ãs: Assessing and Adjusting for Cross-Cultural Validity of Impairment and Activity Limitation Scales Through Differential Item Functioning Within the Framework of the Rasch Model: The PRO-ESOR Project. Medical care. 2004, 42 (1): I-37.CrossRef Tennant A, Penta M, Tesio L, Grimby G, Thonnard J-L, Slade A, Lawton G, Simone A, Carter J, Lundgren-Nilsson Ãs: Assessing and Adjusting for Cross-Cultural Validity of Impairment and Activity Limitation Scales Through Differential Item Functioning Within the Framework of the Rasch Model: The PRO-ESOR Project. Medical care. 2004, 42 (1): I-37.CrossRef
15.
go back to reference Scott N, Fayers P, Aaronson N, Bottomley A, de Graeff A, Groenvold M, Koller M, Petersen M, Sprangers M: The use of differential item functioning analyses to identify cultural differences in responses to the EORTC QLQ-C30. Quality of Life Research. 2007, 16 (1): 115-129. 10.1007/s11136-006-9120-1.CrossRefPubMed Scott N, Fayers P, Aaronson N, Bottomley A, de Graeff A, Groenvold M, Koller M, Petersen M, Sprangers M: The use of differential item functioning analyses to identify cultural differences in responses to the EORTC QLQ-C30. Quality of Life Research. 2007, 16 (1): 115-129. 10.1007/s11136-006-9120-1.CrossRefPubMed
16.
go back to reference Linacre JM: Sample size and item calibration stability. Rasch Measurement Transactions. 1994, 7: 328-331. Linacre JM: Sample size and item calibration stability. Rasch Measurement Transactions. 1994, 7: 328-331.
17.
go back to reference Beaton DE, Bombardier C, Guillemin F, Ferraz MB: Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000, 25 (24): 3186-10.1097/00007632-200012150-00014.CrossRefPubMed Beaton DE, Bombardier C, Guillemin F, Ferraz MB: Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000, 25 (24): 3186-10.1097/00007632-200012150-00014.CrossRefPubMed
18.
go back to reference Rasch G: Probabilistic models for some intelligence and attainments tests. 1960, Chicago: University of Chicago Rasch G: Probabilistic models for some intelligence and attainments tests. 1960, Chicago: University of Chicago
19.
go back to reference Keenan AM, Redmond AC, Horton M, Conaghan PG, Tennant A: The Foot Posture Index: Rasch analysis of a novel, foot-specific outcome measure. Archives of Physical Medicine and Rehabilitation. 2007, 88 (1): 88-93. 10.1016/j.apmr.2006.10.005.CrossRefPubMed Keenan AM, Redmond AC, Horton M, Conaghan PG, Tennant A: The Foot Posture Index: Rasch analysis of a novel, foot-specific outcome measure. Archives of Physical Medicine and Rehabilitation. 2007, 88 (1): 88-93. 10.1016/j.apmr.2006.10.005.CrossRefPubMed
20.
go back to reference Doward LC, McKenna SP, Whalley D, Tennant A, Griffiths B, Emery P, Veale DJ: The development of the L-QoL: a quality-of-life instrument specific to systemic lupus erythematosus. British Medical Journal. 2009, 68 (2): 196- Doward LC, McKenna SP, Whalley D, Tennant A, Griffiths B, Emery P, Veale DJ: The development of the L-QoL: a quality-of-life instrument specific to systemic lupus erythematosus. British Medical Journal. 2009, 68 (2): 196-
21.
go back to reference Peter MtK, Erik T, Mart AFJvdL: Rasch analysis of the Dutch health assessment questionnaire disability index and the health assessment questionnaire II in patients with rheumatoid arthritis. Arthritis Rheum. 2008, 59 (12): 1721-1728. 10.1002/art.24065.CrossRef Peter MtK, Erik T, Mart AFJvdL: Rasch analysis of the Dutch health assessment questionnaire disability index and the health assessment questionnaire II in patients with rheumatoid arthritis. Arthritis Rheum. 2008, 59 (12): 1721-1728. 10.1002/art.24065.CrossRef
22.
go back to reference Durez P, Fraselle V, Houssiau Fdr, Thonnard J-L, Nielens H, Penta M: Validation of the ABILHAND questionnaire as a measure of manual ability in patients with rheumatoid arthritis. Annals of the Rheumatic Diseases. 2007, 66 (8): 1098-1105. 10.1136/ard.2006.056150.CrossRefPubMed Durez P, Fraselle V, Houssiau Fdr, Thonnard J-L, Nielens H, Penta M: Validation of the ABILHAND questionnaire as a measure of manual ability in patients with rheumatoid arthritis. Annals of the Rheumatic Diseases. 2007, 66 (8): 1098-1105. 10.1136/ard.2006.056150.CrossRefPubMed
23.
go back to reference Gilworth G, Emery P, Gossec L, Vliet Vlieland TPM, Breedveld FC, Hueber AJ, Schett G, Tennant A: Adaptation and cross-cultural validation of the rheumatoid arthritis work instability scale (RA-WIS). Annals of the Rheumatic Diseases. 2009, 68 (11): 1686-1690. 10.1136/ard.2008.098921.CrossRefPubMed Gilworth G, Emery P, Gossec L, Vliet Vlieland TPM, Breedveld FC, Hueber AJ, Schett G, Tennant A: Adaptation and cross-cultural validation of the rheumatoid arthritis work instability scale (RA-WIS). Annals of the Rheumatic Diseases. 2009, 68 (11): 1686-1690. 10.1136/ard.2008.098921.CrossRefPubMed
24.
go back to reference Tammaru M, McKenna SP, Meads DM, Maimets K, Hansen E: Adaptation of the rheumatoid arthritis quality of life scale for Estonia. Rheumatology International. 2006, 26 (7): 655-662. 10.1007/s00296-005-0038-7.CrossRefPubMed Tammaru M, McKenna SP, Meads DM, Maimets K, Hansen E: Adaptation of the rheumatoid arthritis quality of life scale for Estonia. Rheumatology International. 2006, 26 (7): 655-662. 10.1007/s00296-005-0038-7.CrossRefPubMed
25.
go back to reference Rosenbaum PR: Criterion-related construct validity. Psychometrika. 1989, 54 (4): 625-633. 10.1007/BF02296400.CrossRef Rosenbaum PR: Criterion-related construct validity. Psychometrika. 1989, 54 (4): 625-633. 10.1007/BF02296400.CrossRef
26.
go back to reference Rasch G: An informal report on a theory of objectivity in comparisons. 1967, Leyden: University of Leyden Rasch G: An informal report on a theory of objectivity in comparisons. 1967, Leyden: University of Leyden
27.
go back to reference Bartholomew D: The Statistical Approach to Social Measurement. 1996, San Diego: Academic Press Bartholomew D: The Statistical Approach to Social Measurement. 1996, San Diego: Academic Press
28.
go back to reference Anderen E: Sufficient statistics and latent trait models. Psychometrika. 1977, 42: 69-81. 10.1007/BF02293746.CrossRef Anderen E: Sufficient statistics and latent trait models. Psychometrika. 1977, 42: 69-81. 10.1007/BF02293746.CrossRef
29.
go back to reference Wright BD, Linacre JM: Observations are always ordinal; measurements, however, must be interval. Archives of Physical Medicine and Rehabilitation. 1989, 70 (12): 857-860.PubMed Wright BD, Linacre JM: Observations are always ordinal; measurements, however, must be interval. Archives of Physical Medicine and Rehabilitation. 1989, 70 (12): 857-860.PubMed
30.
go back to reference Tennant A, Conaghan P: The Rasch Measurement Model in Rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper. Arthritis and Rheumatism. 2007, 57 (8): 1358-1362. 10.1002/art.23108.CrossRefPubMed Tennant A, Conaghan P: The Rasch Measurement Model in Rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper. Arthritis and Rheumatism. 2007, 57 (8): 1358-1362. 10.1002/art.23108.CrossRefPubMed
31.
go back to reference Andrich D, Lyne A, Sherdan B, Lou G: RUMM 2020. 2003, Perth: RUMM Laboratory Andrich D, Lyne A, Sherdan B, Lou G: RUMM 2020. 2003, Perth: RUMM Laboratory
32.
go back to reference Masters GA: Rasch model for partial credit scoring. Psychometrika. 1982, 47: 149-174. 10.1007/BF02296272.CrossRef Masters GA: Rasch model for partial credit scoring. Psychometrika. 1982, 47: 149-174. 10.1007/BF02296272.CrossRef
33.
go back to reference Pallant JF, Tennant A: An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology. 2007, 46: 1-18. 10.1348/014466506X96931.CrossRefPubMed Pallant JF, Tennant A: An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology. 2007, 46: 1-18. 10.1348/014466506X96931.CrossRefPubMed
34.
go back to reference Guemin L, Robert LB, David AF: Incorporating the Testlet Concept in Test Score Analyses. Educational Measurement: Issues and Practice. 2000, 19 (4): 9-15. Guemin L, Robert LB, David AF: Incorporating the Testlet Concept in Test Score Analyses. Educational Measurement: Issues and Practice. 2000, 19 (4): 9-15.
35.
go back to reference Smith E: Detecting and evaluation the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement. 2002, 3: 205-231.PubMed Smith E: Detecting and evaluation the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement. 2002, 3: 205-231.PubMed
36.
go back to reference Andrich D: Rasch models for measurement series: quantitative applications in the social sciences no. 68. 1988, London: Sage PublicationsCrossRef Andrich D: Rasch models for measurement series: quantitative applications in the social sciences no. 68. 1988, London: Sage PublicationsCrossRef
37.
go back to reference Brodersen J, Meads D, Kreiner S, Thorsen H, Doward L, McKenna S: Methodological aspects of differential item functioning in the Rasch model. Journal of Medical Economics. 2007, 10 (3): 309-324. 10.3111/13696990701557048.CrossRef Brodersen J, Meads D, Kreiner S, Thorsen H, Doward L, McKenna S: Methodological aspects of differential item functioning in the Rasch model. Journal of Medical Economics. 2007, 10 (3): 309-324. 10.3111/13696990701557048.CrossRef
39.
go back to reference Velozo CA, Lai JS, Mallinson T, Hauselman E: Maintaining instrument quality while reducing items: application of Rasch analysis to a self-report of visual function. Journal of Outcome Measurement. 2000, 4 (3): 667-680.PubMed Velozo CA, Lai JS, Mallinson T, Hauselman E: Maintaining instrument quality while reducing items: application of Rasch analysis to a self-report of visual function. Journal of Outcome Measurement. 2000, 4 (3): 667-680.PubMed
40.
go back to reference van der Velde G, Beaton D, Hogg-Johnston S, Hurwitz E, Tennant A: Rasch analysis provides new insights into the measurement properties of the neck disability index. Arthritis Rheum. 2009, 61 (4): 544-551. 10.1002/art.24399.CrossRefPubMed van der Velde G, Beaton D, Hogg-Johnston S, Hurwitz E, Tennant A: Rasch analysis provides new insights into the measurement properties of the neck disability index. Arthritis Rheum. 2009, 61 (4): 544-551. 10.1002/art.24399.CrossRefPubMed
41.
go back to reference Keenan A, Mckenna S, Doward L, Conaghan P, Emery P, Tennant A: Development and validation of a needs-based quality of life instrument for osteoarthritis. Arthritis Rheum. 2008, 59 (6): 841-848. 10.1002/art.23714.CrossRefPubMed Keenan A, Mckenna S, Doward L, Conaghan P, Emery P, Tennant A: Development and validation of a needs-based quality of life instrument for osteoarthritis. Arthritis Rheum. 2008, 59 (6): 841-848. 10.1002/art.23714.CrossRefPubMed
42.
go back to reference Bradlow ET, Wainer H, Wang X: A Bayesian random effects model for testlets. Psychometrika. 1999, 64 (2): 153-168. 10.1007/BF02294533.CrossRef Bradlow ET, Wainer H, Wang X: A Bayesian random effects model for testlets. Psychometrika. 1999, 64 (2): 153-168. 10.1007/BF02294533.CrossRef
43.
go back to reference Wright B, Panchapakesan N: A procedure for sample-free item analysis. Educational and Psychological Measurement. 1969, 29 (1): 23-48. 10.1177/001316446902900102.CrossRef Wright B, Panchapakesan N: A procedure for sample-free item analysis. Educational and Psychological Measurement. 1969, 29 (1): 23-48. 10.1177/001316446902900102.CrossRef
44.
go back to reference Smolen JS, Aletaha D, Bijlsma JWJ, Breedveld FC, Boumpas D, Burmester G, Combe B, Cutolo M, de Wit M, Dougados M: Treating rheumatoid arthritis to target: recommendations of an international task force. Annals of the Rheumatic Diseases. 2010, 69 (4): 631-637. 10.1136/ard.2009.123919.CrossRefPubMedPubMedCentral Smolen JS, Aletaha D, Bijlsma JWJ, Breedveld FC, Boumpas D, Burmester G, Combe B, Cutolo M, de Wit M, Dougados M: Treating rheumatoid arthritis to target: recommendations of an international task force. Annals of the Rheumatic Diseases. 2010, 69 (4): 631-637. 10.1136/ard.2009.123919.CrossRefPubMedPubMedCentral
Metadata
Title
Cross-cultural validation of the Educational Needs Assessment Tool in RA in 7 European countries
Authors
Mwidimi Ndosi
Alan Tennant
Ulrika Bergsten
Marja Leena Kukkurainen
Pedro Machado
Jenny de la Torre-Aboki
Thea PM Vliet Vlieland
Heidi A Zangi
Jackie Hill
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2011
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-12-110

Other articles of this Issue 1/2011

BMC Musculoskeletal Disorders 1/2011 Go to the issue