Skip to main content
Top
Published in: The journal of nutrition, health & aging 7/2019

01-07-2019 | Care

Inter-Rater Reliability of the Mealtime Scan+

Authors: Heather Keller, S. Awwad, J. Morrison, H. Chaudhury

Published in: The journal of nutrition, health & aging | Issue 7/2019

Login to get access

Abstract

Background and Objectives

The Mealtime Scan (MTS) was developed to assess the dining environment in Long Term Care (LTC). MTS has been reviewed and updated to ensure its standardization and responsiveness to changes in the dining environment. The objectives of this paper are to provide an overview of the changes made in the new MTS+ tool and to describe its inter-rater reliability.

Research Design and Methods

The observational and scoring methods used to evaluate the physical, social, and relational-centered dining environments in LTC homes were reviewed and updated into MTS+ and an overall quality of dining rating derived. Two trained assessors were evaluated for the inter-rater reliability. Nine dining rooms in three LTC homes at different meals were observed for a total of 45 observations. Interclass Correlation Coefficient (ICC) was used to assess reliability.

Results

MTS+ demonstrated good reliability on the orientation cues, social environment, and relationship-centered activities (orientation cues ICC: 0.75, social ICC: 0.78, relational ICC: 0.78). However, the tool’s reliability was poor for the physical environment, ICC: 0.48 and moderate for the overall rating of the quality of the dining environment, ICC: 0.67.

Discussion and Implications

Although deemed more effective and practical for use in intervention studies, MTS+ has some limitations with respect to its reliability, particularly in assessing the physical environment. It is hypothesized that more extensive training of the assessors may lead to improvements in the reliability of MTS+. MTS+ can be used in intervention research when one assessor completes repeat observations of a dining area.
Literature
1.
go back to reference Keller H, Carrier N, Duizer L, Lengyel C, Slaughter S, Steele C. Making the Most of Mealtimes (M3): grounding mealtime interventions with a conceptual model. J Am Med Dir Assoc 2014;15(3), 158–161.CrossRefPubMedPubMedCentral Keller H, Carrier N, Duizer L, Lengyel C, Slaughter S, Steele C. Making the Most of Mealtimes (M3): grounding mealtime interventions with a conceptual model. J Am Med Dir Assoc 2014;15(3), 158–161.CrossRefPubMedPubMedCentral
3.
go back to reference Keller HH. Improving food intake in persons living with dementia. Ann NY Acad Sci 2016;1367(1): 3–11.CrossRefPubMed Keller HH. Improving food intake in persons living with dementia. Ann NY Acad Sci 2016;1367(1): 3–11.CrossRefPubMed
4.
go back to reference Henkusens C, Keller HH, Dupuis S, Schindel Martin L. Transitions to long-term care: how do families living with dementia experience mealtimes after relocating? J Appl Gerontol 2014;33(5), 541–563.CrossRefPubMed Henkusens C, Keller HH, Dupuis S, Schindel Martin L. Transitions to long-term care: how do families living with dementia experience mealtimes after relocating? J Appl Gerontol 2014;33(5), 541–563.CrossRefPubMed
5.
go back to reference Hung L, Chaudhury H, Rust T. The effect of dining room physical environmental renovations on person-centered care practice and residents’ dining experiences in long-term care facilities. J Appl Gerontol 2016;35(12):1279–1301.CrossRefPubMed Hung L, Chaudhury H, Rust T. The effect of dining room physical environmental renovations on person-centered care practice and residents’ dining experiences in long-term care facilities. J Appl Gerontol 2016;35(12):1279–1301.CrossRefPubMed
6.
go back to reference Keller HH, Chaudhury H, Pfisterer KJ, Slaughter SE. Development and inter-rater reliability of the Mealtime Scan for long-term care. Gerontologist, 2017;58(3): e160–e167.CrossRefPubMedCentral Keller HH, Chaudhury H, Pfisterer KJ, Slaughter SE. Development and inter-rater reliability of the Mealtime Scan for long-term care. Gerontologist, 2017;58(3): e160–e167.CrossRefPubMedCentral
7.
go back to reference Chaudhury H, Cooke HA, Cowie H, Razaghi L. The influence of the physical environment on residents with dementia in long-term care settings: A review of the empirical literature. Gerontologist 2017;58(5): e325–e337.CrossRef Chaudhury H, Cooke HA, Cowie H, Razaghi L. The influence of the physical environment on residents with dementia in long-term care settings: A review of the empirical literature. Gerontologist 2017;58(5): e325–e337.CrossRef
8.
go back to reference Ducak K, Sweatman G, Keller H. Dining culture change in long-term care homes: Transitioning to resident-centered and relational meals. Ann Long Term Care: Clin Care Aging 2015;23(6): 28–36. Ducak K, Sweatman G, Keller H. Dining culture change in long-term care homes: Transitioning to resident-centered and relational meals. Ann Long Term Care: Clin Care Aging 2015;23(6): 28–36.
9.
go back to reference Wu S, Morrison JM, Dunn-Ridgeway H, Vucea V, Iuglio S, Keller H. Mixed methods developmental evaluation of the CHOICE program: a relationship-centred mealtime intervention for long-term care. BMC Geriatics 2018;18(1): 277.CrossRef Wu S, Morrison JM, Dunn-Ridgeway H, Vucea V, Iuglio S, Keller H. Mixed methods developmental evaluation of the CHOICE program: a relationship-centred mealtime intervention for long-term care. BMC Geriatics 2018;18(1): 277.CrossRef
10.
go back to reference Iuglio S, Keller HH, Chaudhury H, Morrison JM, Slaughter SE, Lengyel C et al. Construct validation of the Mealtime Relational Care Checklist (M-RCC) for individual resident use in long term care. J Nurs Measure (in press). Iuglio S, Keller HH, Chaudhury H, Morrison JM, Slaughter SE, Lengyel C et al. Construct validation of the Mealtime Relational Care Checklist (M-RCC) for individual resident use in long term care. J Nurs Measure (in press).
11.
go back to reference Ten Have P. Teaching students observational methods: visual studies and visual analysis. Visual Studies 2003;18(1):29–35.CrossRef Ten Have P. Teaching students observational methods: visual studies and visual analysis. Visual Studies 2003;18(1):29–35.CrossRef
12.
go back to reference Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropractic Med 2016;15(2):155–163.CrossRef Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropractic Med 2016;15(2):155–163.CrossRef
13.
go back to reference Rotondi MA, Donner A. A confidence interval approach to sample size estimation for interobserver agreement studies with multiple raters and outcomes. J Clin Epi 2012;65(7):778–784.CrossRef Rotondi MA, Donner A. A confidence interval approach to sample size estimation for interobserver agreement studies with multiple raters and outcomes. J Clin Epi 2012;65(7):778–784.CrossRef
Metadata
Title
Inter-Rater Reliability of the Mealtime Scan+
Authors
Heather Keller
S. Awwad
J. Morrison
H. Chaudhury
Publication date
01-07-2019
Publisher
Springer Paris
Keyword
Care
Published in
The journal of nutrition, health & aging / Issue 7/2019
Print ISSN: 1279-7707
Electronic ISSN: 1760-4788
DOI
https://doi.org/10.1007/s12603-019-1210-1

Other articles of this Issue 7/2019

The journal of nutrition, health & aging 7/2019 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.