Skip to main content
Top
Published in: BMC Health Services Research 1/2013

Open Access 01-12-2013 | Research article

Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: the eDESDE-LTC study

Authors: Luis Salvador-Carulla, Javier Alvarez-Galvez, Cristina Romero, Mencia R Gutiérrez-Colosía, Germain Weber, David McDaid, Hristo Dimitrov, Lilijana Sprah, Birgitte Kalseth, Giuseppe Tibaldi, Jose A Salinas-Perez, Carolina Lagares-Franco, Maria Teresa Romá-Ferri, Sonia Johnson

Published in: BMC Health Services Research | Issue 1/2013

Login to get access

Abstract

Background

The harmonization of European health systems brings with it a need for tools to allow the standardized collection of information about medical care. A common coding system and standards for the description of services are needed to allow local data to be incorporated into evidence-informed policy, and to permit equity and mobility to be assessed. The aim of this project has been to design such a classification and a related tool for the coding of services for Long Term Care (DESDE-LTC), based on the European Service Mapping Schedule (ESMS).

Methods

The development of DESDE-LTC followed an iterative process using nominal groups in 6 European countries. 54 researchers and stakeholders in health and social services contributed to this process. In order to classify services, we use the minimal organization unit or “Basic Stable Input of Care” (BSIC), coded by its principal function or “Main Type of Care” (MTC). The evaluation of the tool included an analysis of feasibility, consistency, ontology, inter-rater reliability, Boolean Factor Analysis, and a preliminary impact analysis (screening, scoping and appraisal).

Results

DESDE-LTC includes an alpha-numerical coding system, a glossary and an assessment instrument for mapping and counting LTC. It shows high feasibility, consistency, inter-rater reliability and face, content and construct validity. DESDE-LTC is ontologically consistent. It is regarded by experts as useful and relevant for evidence-informed decision making.

Conclusion

DESDE-LTC contributes to establishing a common terminology, taxonomy and coding of LTC services in a European context, and a standard procedure for data collection and international comparison.
Appendix
Available only for authorised users
Literature
1.
go back to reference Organization for Economic Co-operation and Development (OECD): The OECD Health Project: Long Term Care for Older People. 2005, Paris: OECD Publishing Organization for Economic Co-operation and Development (OECD): The OECD Health Project: Long Term Care for Older People. 2005, Paris: OECD Publishing
3.
go back to reference Salvador-Carulla L, Poole M, Gonzalez-Caballero JL, Romero C, Salinas JA, Lagares-Franco CM, RIRAG/PSICOST Group: DESDE Consensus Panel. Development and usefulness of an instrument for the standard description and comparison of services for disabilities (DESDE). Acta Psychiatr Scand Suppl. 2006, 19-28. 432 Salvador-Carulla L, Poole M, Gonzalez-Caballero JL, Romero C, Salinas JA, Lagares-Franco CM, RIRAG/PSICOST Group: DESDE Consensus Panel. Development and usefulness of an instrument for the standard description and comparison of services for disabilities (DESDE). Acta Psychiatr Scand Suppl. 2006, 19-28. 432
4.
go back to reference Johri M, Beland F, Bergman H: International experiments in integrated care for the elderly: a synthesis of the evidence. Int J Geriatr Psychiatry. 2003, 18: 222-235. 10.1002/gps.819.CrossRefPubMed Johri M, Beland F, Bergman H: International experiments in integrated care for the elderly: a synthesis of the evidence. Int J Geriatr Psychiatry. 2003, 18: 222-235. 10.1002/gps.819.CrossRefPubMed
5.
go back to reference EUROSTAT: Feasibility Study –Comparable Statistics in the Area of Care of Dependent Adults in the EU. 2003, Luxembourg: Office for Official Publications of the European Communities EUROSTAT: Feasibility Study –Comparable Statistics in the Area of Care of Dependent Adults in the EU. 2003, Luxembourg: Office for Official Publications of the European Communities
7.
go back to reference Salvador-Carulla L, Haro JM, Ayuso-Mateos JL: A framework for evidence-based mental health care and policy. Acta Psychiatr Scand Suppl. 2006, 5-11. 432 Salvador-Carulla L, Haro JM, Ayuso-Mateos JL: A framework for evidence-based mental health care and policy. Acta Psychiatr Scand Suppl. 2006, 5-11. 432
10.
go back to reference Thomas S, Kuhn PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association Vol. II. 1982, Symposia and Invited Papers, Chicago: The University of Chicago Press, 669-688. Thomas S, Kuhn PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association Vol. II. 1982, Symposia and Invited Papers, Chicago: The University of Chicago Press, 669-688.
11.
go back to reference Hodgson J: The impact of European Union law on individuals as patients. Br J Nurs. 2009, 18 (5): 308-310.CrossRefPubMed Hodgson J: The impact of European Union law on individuals as patients. Br J Nurs. 2009, 18 (5): 308-310.CrossRefPubMed
12.
go back to reference Glinos IA, Doering N, Maarse H: Travelling home for treatment and EU patients’ rights to care abroad: results of a survey among German students at Maastricht University. Health Policy. 2012, 105 (1): 38-45. 10.1016/j.healthpol.2011.12.008. Epub 2012 Jan 18CrossRefPubMed Glinos IA, Doering N, Maarse H: Travelling home for treatment and EU patients’ rights to care abroad: results of a survey among German students at Maastricht University. Health Policy. 2012, 105 (1): 38-45. 10.1016/j.healthpol.2011.12.008. Epub 2012 Jan 18CrossRefPubMed
13.
go back to reference Romá-Ferri MT, Palomar M: Analysis of health terminologies for use as ontologies in healthcare information systems. Gac Sanit. 2008, 22: 421-433. 10.1157/13126923.CrossRefPubMed Romá-Ferri MT, Palomar M: Analysis of health terminologies for use as ontologies in healthcare information systems. Gac Sanit. 2008, 22: 421-433. 10.1157/13126923.CrossRefPubMed
14.
go back to reference World Health Organization: The Ljubljana Charter on Reforming Health Care. 1996, Copenhagen: WHO Regional Office for Europe World Health Organization: The Ljubljana Charter on Reforming Health Care. 1996, Copenhagen: WHO Regional Office for Europe
15.
go back to reference Oxman AD, Schünemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 7. Deciding what evidence to include. Health Res Policy Syst. 2006, 4: 19-10.1186/1478-4505-4-19.CrossRefPubMedPubMedCentral Oxman AD, Schünemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 7. Deciding what evidence to include. Health Res Policy Syst. 2006, 4: 19-10.1186/1478-4505-4-19.CrossRefPubMedPubMedCentral
16.
go back to reference Oxman AD, Schünemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence. Health Res Policy Syst. 2006, 4: 20-10.1186/1478-4505-4-20.CrossRefPubMedPubMedCentral Oxman AD, Schünemann HJ, Fretheim A: Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence. Health Res Policy Syst. 2006, 4: 20-10.1186/1478-4505-4-20.CrossRefPubMedPubMedCentral
17.
go back to reference Lewin S, Oxman AD, Lavis JN, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 8: Deciding how much confidence to place in a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S8-10.1186/1478-4505-7-S1-S8.CrossRefPubMedPubMedCentral Lewin S, Oxman AD, Lavis JN, Fretheim A: SUPPORT Tools for evidence-informed health Policymaking (STP) 8: Deciding how much confidence to place in a systematic review. Health Res Policy Syst. 2009, 7 (Suppl 1): S8-10.1186/1478-4505-7-S1-S8.CrossRefPubMedPubMedCentral
18.
go back to reference Beecham J, Johnson S, EPCAT Group: The European Socio-Demographic Schedule (ESDS): rationale, principles and development. Acta Psychiat Scand. 2000, 102 (Suppl. 405): 33-46.CrossRef Beecham J, Johnson S, EPCAT Group: The European Socio-Demographic Schedule (ESDS): rationale, principles and development. Acta Psychiat Scand. 2000, 102 (Suppl. 405): 33-46.CrossRef
19.
go back to reference de Jong A: Development of the International Classification of Mental Health Care (ICMHC). Acta Psychiatr Scand Suppl. 2000, 405: 8-13.CrossRefPubMed de Jong A: Development of the International Classification of Mental Health Care (ICMHC). Acta Psychiatr Scand Suppl. 2000, 405: 8-13.CrossRefPubMed
20.
go back to reference Johnson S, Kuhlmann R, EPCAT Group. European Psychiatric Assessmen Team: The European Service Mapping Schedule (ESMS): development of an instrument for the description and classification of mental health services. Acta Psychiatr Scand Suppl. 2000, 405: 14-23.CrossRefPubMed Johnson S, Kuhlmann R, EPCAT Group. European Psychiatric Assessmen Team: The European Service Mapping Schedule (ESMS): development of an instrument for the description and classification of mental health services. Acta Psychiatr Scand Suppl. 2000, 405: 14-23.CrossRefPubMed
21.
go back to reference Munizza C, Tibaldi G, Cesano S, Dazzi R, Fantini G, Palazzi C, Scala E, Zuccolin M: Mental health care in Piedmont: a description of its structure and components using a new technology for service assessment. Acta Psychiatr Scand. 2000, 102: 47-58.CrossRef Munizza C, Tibaldi G, Cesano S, Dazzi R, Fantini G, Palazzi C, Scala E, Zuccolin M: Mental health care in Piedmont: a description of its structure and components using a new technology for service assessment. Acta Psychiatr Scand. 2000, 102: 47-58.CrossRef
22.
go back to reference Salvador-Carulla L, Romero C, Martinez A, Haro JM, Bustillo G, Ferreira A, Gaite L, Johnson S: Assessment instruments: standardization of the European Service Mapping Schedule (ESMS) in Spain. Acta Psychiatr Scand Suppl. 2000, 405: 24-32.CrossRefPubMed Salvador-Carulla L, Romero C, Martinez A, Haro JM, Bustillo G, Ferreira A, Gaite L, Johnson S: Assessment instruments: standardization of the European Service Mapping Schedule (ESMS) in Spain. Acta Psychiatr Scand Suppl. 2000, 405: 24-32.CrossRefPubMed
23.
go back to reference Trypka E, Adamowski T, Kiejna A: Presentation of the cost-effectiveness technique questionnaire--the possibility of the Polish adaptation. Psychiatr Pol. 2002, 36: 389-396.PubMed Trypka E, Adamowski T, Kiejna A: Presentation of the cost-effectiveness technique questionnaire--the possibility of the Polish adaptation. Psychiatr Pol. 2002, 36: 389-396.PubMed
24.
go back to reference Böcker FM, Jeschke F, Brieger P: Psychiatric care in Sachsen-Anhalt: a survey of institutions and services with the “European Services Mapping Schedule” ESMS. Psychiatr Prax. 2001, 28: 393-401. 10.1055/s-2001-18616.CrossRefPubMed Böcker FM, Jeschke F, Brieger P: Psychiatric care in Sachsen-Anhalt: a survey of institutions and services with the “European Services Mapping Schedule” ESMS. Psychiatr Prax. 2001, 28: 393-401. 10.1055/s-2001-18616.CrossRefPubMed
25.
go back to reference Salvador-Carulla L, Saldivia S, Martinez-Leal R, Vicente B, Garcia-Alonso C, Grandon P, Haro JM: Meso-level comparison of mental health service availability and use in Chile and Spain. Psychiatr Serv. 2008, 59: 421-428. 10.1176/appi.ps.59.4.421.CrossRefPubMed Salvador-Carulla L, Saldivia S, Martinez-Leal R, Vicente B, Garcia-Alonso C, Grandon P, Haro JM: Meso-level comparison of mental health service availability and use in Chile and Spain. Psychiatr Serv. 2008, 59: 421-428. 10.1176/appi.ps.59.4.421.CrossRefPubMed
26.
go back to reference Salvador-Carulla L, Tibaldi G, Johnson S, Scala E, Romero C, Munizza C: Patterns of mental health service utilisation in Italy and Spain–an investigation using the European Service Mapping Schedule. Soc Psychiatry Psychiatr Epidemiol. 2005, 40: 149-159. 10.1007/s00127-005-0860-y.CrossRefPubMed Salvador-Carulla L, Tibaldi G, Johnson S, Scala E, Romero C, Munizza C: Patterns of mental health service utilisation in Italy and Spain–an investigation using the European Service Mapping Schedule. Soc Psychiatry Psychiatr Epidemiol. 2005, 40: 149-159. 10.1007/s00127-005-0860-y.CrossRefPubMed
27.
go back to reference Rezvyy G, Oiesvold T, Parniakov A, Ponomarev O, Lazurko O, Olstad R: The Barents project in psychiatry: a systematic comparative mental health services study between Northern Norway and Archangelsk County. SocPsychiatry Psychiatr Epidemiol. 2007, 42 (2): 131-139. 10.1007/s00127-006-0141-4.CrossRef Rezvyy G, Oiesvold T, Parniakov A, Ponomarev O, Lazurko O, Olstad R: The Barents project in psychiatry: a systematic comparative mental health services study between Northern Norway and Archangelsk County. SocPsychiatry Psychiatr Epidemiol. 2007, 42 (2): 131-139. 10.1007/s00127-006-0141-4.CrossRef
28.
go back to reference Becker T, Hülsmann S, Knudsen HC, Martiny K, Amaddeo F, Herran A, Knapp M, Schene AH, Tansella M, Thornicroft G, Vázquez-Barquero JL: Provision of services for people with schizophrenia in five European regions. Soc Psychiatry Psychiatr Epidemiol. 2002, 37: 465-474. 10.1007/s00127-002-0591-2.CrossRefPubMed Becker T, Hülsmann S, Knudsen HC, Martiny K, Amaddeo F, Herran A, Knapp M, Schene AH, Tansella M, Thornicroft G, Vázquez-Barquero JL: Provision of services for people with schizophrenia in five European regions. Soc Psychiatry Psychiatr Epidemiol. 2002, 37: 465-474. 10.1007/s00127-002-0591-2.CrossRefPubMed
29.
go back to reference Van de Ven A, Delbecq A: The effectiveness of nominal, Delphi, and interacting group decision making processes. Acad Manage J. 1974, 17: 605-621. 10.2307/255641.CrossRef Van de Ven A, Delbecq A: The effectiveness of nominal, Delphi, and interacting group decision making processes. Acad Manage J. 1974, 17: 605-621. 10.2307/255641.CrossRef
30.
go back to reference Salvador-Carulla L, Gonzalez-Caballero JL: Assessment instruments in mental health: description and metric properties. Mental Health Outcome Measures (3rd Edition). Edited by: Thornicroft G, Tansella M. 2010, London: The Royal College of Psychiatrists, 28-62. Salvador-Carulla L, Gonzalez-Caballero JL: Assessment instruments in mental health: description and metric properties. Mental Health Outcome Measures (3rd Edition). Edited by: Thornicroft G, Tansella M. 2010, London: The Royal College of Psychiatrists, 28-62.
32.
go back to reference Lee Cronbach J: The Dependability of Behavioral Measurements. Theory of Generalizability for Scores and Profiles. Lee J. Cronbach, Goldine C. Gleser, Harinder Nanda, and Nageswari Rajaratnam. Wiley, New York, 1972. xx, 410 pp. Science. 1972, 178: 1275-1275A. 10.1126/science.178.4067.1275.CrossRef Lee Cronbach J: The Dependability of Behavioral Measurements. Theory of Generalizability for Scores and Profiles. Lee J. Cronbach, Goldine C. Gleser, Harinder Nanda, and Nageswari Rajaratnam. Wiley, New York, 1972. xx, 410 pp. Science. 1972, 178: 1275-1275A. 10.1126/science.178.4067.1275.CrossRef
33.
go back to reference Seyrlehner D: Evaluating the DESDE-LTC Instrument on feasibility. 2010, University of Vienna: Master Thesis in Psychology (supervisor: Prof. Germain Weber – Dir); University of Vienna; Faculty of Psychology Seyrlehner D: Evaluating the DESDE-LTC Instrument on feasibility. 2010, University of Vienna: Master Thesis in Psychology (supervisor: Prof. Germain Weber – Dir); University of Vienna; Faculty of Psychology
34.
go back to reference Mickey MR, Mundie P, Engelman L: Boolean factor analysis. BMDP statistical software manual. Edited by: Dixon WJ. 1990, Los Angeles, CA: University of California Press, 849-860. 2 Mickey MR, Mundie P, Engelman L: Boolean factor analysis. BMDP statistical software manual. Edited by: Dixon WJ. 1990, Los Angeles, CA: University of California Press, 849-860. 2
36.
go back to reference Parry J, Stevens A: Prospective health impact assessment: pitfalls, problems, and possible ways forward. BMJ. 2001, 323: 1177-1182. 10.1136/bmj.323.7322.1177.CrossRefPubMedPubMedCentral Parry J, Stevens A: Prospective health impact assessment: pitfalls, problems, and possible ways forward. BMJ. 2001, 323: 1177-1182. 10.1136/bmj.323.7322.1177.CrossRefPubMedPubMedCentral
37.
go back to reference Vázquez-Barquero JL, Gaite-Pintado L, Salinas-Pérez JA: Atlas de Salud Mental de Cantabria. 2010, Santander: Consejería de Sanidad Vázquez-Barquero JL, Gaite-Pintado L, Salinas-Pérez JA: Atlas de Salud Mental de Cantabria. 2010, Santander: Consejería de Sanidad
38.
go back to reference Salvador-Carulla L, Serrano-Blanco A, García-Alonso C, Fernández A, Salinas JA, Ruiz M, Prat-Pubill B, Molina C, GEOSCAT: Atles Integral dels Serveis d’Atenció a la Salut Mental de Catalunya 2010. 2012, Barcelona: Pla director de salut mental i addiccions. Barcelona: Direcció General de Regulació, Planificació, y Recursos Sanitaris, Generalitat de Catalunya Salvador-Carulla L, Serrano-Blanco A, García-Alonso C, Fernández A, Salinas JA, Ruiz M, Prat-Pubill B, Molina C, GEOSCAT: Atles Integral dels Serveis d’Atenció a la Salut Mental de Catalunya 2010. 2012, Barcelona: Pla director de salut mental i addiccions. Barcelona: Direcció General de Regulació, Planificació, y Recursos Sanitaris, Generalitat de Catalunya
39.
go back to reference Zeilinger EL, Nader IW, Brehmer-Rinderer B, Koller I, Weber G, CAPs-IDD: Characteristics of Assessment Instruments for Psychiatric Disorders in Persons with Intellectual Developmental Disorders. J Intellect Disabil Res. 2012, 10.1111/jir.12003. [Epub ahead of print] Zeilinger EL, Nader IW, Brehmer-Rinderer B, Koller I, Weber G, CAPs-IDD: Characteristics of Assessment Instruments for Psychiatric Disorders in Persons with Intellectual Developmental Disorders. J Intellect Disabil Res. 2012, 10.1111/jir.12003. [Epub ahead of print]
40.
go back to reference Salvador-Carulla L: Descripción estandarizada de los servicios de discapacidad para ancianos en España (SID). 2003, Madrid: IMSERSO Salvador-Carulla L: Descripción estandarizada de los servicios de discapacidad para ancianos en España (SID). 2003, Madrid: IMSERSO
41.
go back to reference World Health Organization: International Classification of Functioning, Disability and Health. 2001, Geneva: World Health Organization World Health Organization: International Classification of Functioning, Disability and Health. 2001, Geneva: World Health Organization
42.
go back to reference Gibert K, García-Alonso C, Salvador-Carulla L: Integrating clinicians, knowledge and data: expert-based cooperative analysis in healthcare decision support. Health Research Policy and Systems. 2010, 8: 28-10.1186/1478-4505-8-28.CrossRefPubMedPubMedCentral Gibert K, García-Alonso C, Salvador-Carulla L: Integrating clinicians, knowledge and data: expert-based cooperative analysis in healthcare decision support. Health Research Policy and Systems. 2010, 8: 28-10.1186/1478-4505-8-28.CrossRefPubMedPubMedCentral
43.
go back to reference Salvador-Carulla L, Costa-Font J, Cabases J, McDaid D, Alonso J: Evaluating mental health care and policy in Spain. J Ment Health Policy Econ. 2010, 13 (2): 73-86.PubMed Salvador-Carulla L, Costa-Font J, Cabases J, McDaid D, Alonso J: Evaluating mental health care and policy in Spain. J Ment Health Policy Econ. 2010, 13 (2): 73-86.PubMed
Metadata
Title
Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: the eDESDE-LTC study
Authors
Luis Salvador-Carulla
Javier Alvarez-Galvez
Cristina Romero
Mencia R Gutiérrez-Colosía
Germain Weber
David McDaid
Hristo Dimitrov
Lilijana Sprah
Birgitte Kalseth
Giuseppe Tibaldi
Jose A Salinas-Perez
Carolina Lagares-Franco
Maria Teresa Romá-Ferri
Sonia Johnson
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2013
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-13-218

Other articles of this Issue 1/2013

BMC Health Services Research 1/2013 Go to the issue