Skip to main content
Top
Published in: Quality of Life Research 6/2016

Open Access 01-06-2016

Using the Three-Step Test Interview to understand how patients perceive the St. George’s Respiratory Questionnaire for COPD patients (SGRQ-C)

Authors: Muirne C. S. Paap, Lukas Lange, Job van der Palen, Christina Bode

Published in: Quality of Life Research | Issue 6/2016

Login to get access

Abstract

Purpose

The aim of this study was to assess the experiences of patients with chronic obstructive pulmonary disease (COPD) while they were completing the St. George’s Respiratory Questionnaire for COPD patients (SGRQ-C), using qualitative research methods.

Methods

Twenty Dutch COPD patients were recruited through pulmonary physicians [13 women; mean age = 63.3 years (SD = 11.4)]. A trained interviewer applied the Three-Step Test Interview which allowed the interviewer to follow the thought process of the patient filling out the SGRQ-C. The official Dutch translation of the SGRQ-C was used.

Results

Patients missed a recall period for the Symptoms subscale; were uncertain how to interpret specific words and phrases like “good days”, “games”, and “housework”; were confused by long-item stems that included a list of activities; and were frustrated by the dichotomous format used for the majority of SGRQ-C items (true/false).

Conclusions

Overall, patients were satisfied with the SGRQ-C. Nevertheless, making minor adjustments could further increase its quality. This includes reintroducing a recall period in the first set of items such as used in the previous version and splitting up items consisting of multiple activities. Furthermore, we recommend using the same response format (4 or 5 response categories) for all items.
Footnotes
1
Criterion validity in this context is measured by estimating the relationship between the scale of interest and a variable that serves as a criterion (e.g. outcome measure, legacy instrument, gold standard, expert rating).
 
2
Convergent validity in this context is typically measured by estimating the relationship between two scales that aim to measure the same or similar constructs.
 
Literature
2.
go back to reference Heene, M., Bollmann, S., & Bühner, M. (2014). Much ado about nothing, or much to do about something? Effects of scale shortening on criterion validity and mean differences. Journal of Individual Differences, 35(4), 245–249. doi:10.1027/1614-0001/a000146.CrossRef Heene, M., Bollmann, S., & Bühner, M. (2014). Much ado about nothing, or much to do about something? Effects of scale shortening on criterion validity and mean differences. Journal of Individual Differences, 35(4), 245–249. doi:10.​1027/​1614-0001/​a000146.CrossRef
3.
go back to reference Tuerlinckx, F., & De Boeck, P. (2001). The effect of ignoring item interactions on the estimated discrimination parameters in item response theory. Psychological Methods, 6(2), 181–195.CrossRefPubMed Tuerlinckx, F., & De Boeck, P. (2001). The effect of ignoring item interactions on the estimated discrimination parameters in item response theory. Psychological Methods, 6(2), 181–195.CrossRefPubMed
5.
go back to reference Kruyen, P. M., Emons, W. H. M., & Sijtsma, K. (2013). Assessing individual change using short tests and questionnaires. Applied Psychological Measurement,. doi:10.1177/0146621613510061. Kruyen, P. M., Emons, W. H. M., & Sijtsma, K. (2013). Assessing individual change using short tests and questionnaires. Applied Psychological Measurement,. doi:10.​1177/​0146621613510061​.
6.
go back to reference Jones, P. W., Quirk, F. H., & Baveystock, C. M. (1991). The St George’s Respiratory Questionnaire. Respiratory Medicine, 85(Suppl B), 25–31. (discussion 33–27).CrossRefPubMed Jones, P. W., Quirk, F. H., & Baveystock, C. M. (1991). The St George’s Respiratory Questionnaire. Respiratory Medicine, 85(Suppl B), 25–31. (discussion 33–27).CrossRefPubMed
7.
go back to reference Barr, J. T., Schumacher, G. E., Freeman, S., LeMoine, M., Bakst, A. W., & Jones, P. W. (2000). American translation, modification, and validation of the St. George’s Respiratory Questionnaire. Clinical Therapeutics, 22(9), 1121–1145. doi:10.1016/s0149-2918(00)80089-2.CrossRefPubMed Barr, J. T., Schumacher, G. E., Freeman, S., LeMoine, M., Bakst, A. W., & Jones, P. W. (2000). American translation, modification, and validation of the St. George’s Respiratory Questionnaire. Clinical Therapeutics, 22(9), 1121–1145. doi:10.​1016/​s0149-2918(00)80089-2.CrossRefPubMed
8.
go back to reference Meguro, M., Barley, E. A., Spencer, S., & Jones, P. W. (2007). Development and validation of an improved, COPD-specific version of the St. George Respiratory Questionnaire. Chest, 132(2), 456–463. doi:10.1378/chest.06-0702.CrossRefPubMed Meguro, M., Barley, E. A., Spencer, S., & Jones, P. W. (2007). Development and validation of an improved, COPD-specific version of the St. George Respiratory Questionnaire. Chest, 132(2), 456–463. doi:10.​1378/​chest.​06-0702.CrossRefPubMed
9.
go back to reference Paap, M. C. S., Brouwer, D., Glas, C. A. W., Monninkhof, E. M., Forstreuter, B., Pieterse, M. E., et al. (2015). The St George’s Respiratory Questionnaire revisited: A psychometric evaluation. Quality of Life Research, 24(1), 67–79. doi:10.1007/s11136-013-0570-y.CrossRefPubMed Paap, M. C. S., Brouwer, D., Glas, C. A. W., Monninkhof, E. M., Forstreuter, B., Pieterse, M. E., et al. (2015). The St George’s Respiratory Questionnaire revisited: A psychometric evaluation. Quality of Life Research, 24(1), 67–79. doi:10.​1007/​s11136-013-0570-y.CrossRefPubMed
10.
go back to reference Rutten-van Mölken, M., Roos, B., & Van Noord, J. A. (1999). An empirical comparison of the St George’s Respiratory Questionnaire (SGRQ) and the Chronic Respiratory Disease Questionnaire (CRQ) in a clinical trial setting. Thorax, 54(11), 995–1003.CrossRefPubMed Rutten-van Mölken, M., Roos, B., & Van Noord, J. A. (1999). An empirical comparison of the St George’s Respiratory Questionnaire (SGRQ) and the Chronic Respiratory Disease Questionnaire (CRQ) in a clinical trial setting. Thorax, 54(11), 995–1003.CrossRefPubMed
11.
go back to reference Ferrer, M., Alonso, J., Prieto, L., Plaza, V., Monso, E., Marrades, R., et al. (1996). Validity and reliability of the St George’s Respiratory Questionnaire after adaptation to a different language and culture: The Spanish example. European Respiratory Journal, 9(6), 1160–1166.CrossRefPubMed Ferrer, M., Alonso, J., Prieto, L., Plaza, V., Monso, E., Marrades, R., et al. (1996). Validity and reliability of the St George’s Respiratory Questionnaire after adaptation to a different language and culture: The Spanish example. European Respiratory Journal, 9(6), 1160–1166.CrossRefPubMed
13.
go back to reference Hak, T., Van der Veer, K., & Jansen, H. A. M. (2008). The Three-Step Test-Interview (TSTI): An observation-based method for pretesting self-completion questionnaires. Survey Research Methods, 2, 143–150. Hak, T., Van der Veer, K., & Jansen, H. A. M. (2008). The Three-Step Test-Interview (TSTI): An observation-based method for pretesting self-completion questionnaires. Survey Research Methods, 2, 143–150.
14.
go back to reference Hak, T., van der Veer, K., & Ommundsen, R. (2006). An application of the Three-Step Test-Interview (TSTI): A validation study of the Dutch and Norwegian versions of the ‘illegal aliens scale’. International Journal of Social Research Methodology, 9(3), 215–227. doi:10.1080/13645570600656264.CrossRef Hak, T., van der Veer, K., & Ommundsen, R. (2006). An application of the Three-Step Test-Interview (TSTI): A validation study of the Dutch and Norwegian versions of the ‘illegal aliens scale’. International Journal of Social Research Methodology, 9(3), 215–227. doi:10.​1080/​1364557060065626​4.CrossRef
15.
go back to reference Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage Publications. Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage Publications.
16.
go back to reference Bode, C., & Jansen, H. (2013). Examining the personal experience of aging scale with the Three Step Test Interview. Methodology, 9(3), 96–103.CrossRef Bode, C., & Jansen, H. (2013). Examining the personal experience of aging scale with the Three Step Test Interview. Methodology, 9(3), 96–103.CrossRef
17.
go back to reference Karpinski, N. (2005). Validierung von Lebensqualitäts-Assessments bei chronisch–obstruktiven Atemwegserkrankungen [Validation of Quality of Life-Assessments in patients with Chronic Obstructive Pulmonary Disease]. Bremen: University of Bremen. Karpinski, N. (2005). Validierung von Lebensqualitäts-Assessments bei chronisch–obstruktiven Atemwegserkrankungen [Validation of Quality of Life-Assessments in patients with Chronic Obstructive Pulmonary Disease]. Bremen: University of Bremen.
18.
go back to reference Fayers, P. M., & Machin, D. (2007). Quality of life: The assessment, analysis and interpretation of patient-reported outcomes (2nd ed.). Chichester: Wiley. Fayers, P. M., & Machin, D. (2007). Quality of life: The assessment, analysis and interpretation of patient-reported outcomes (2nd ed.). Chichester: Wiley.
19.
go back to reference Pool, J. J., Hiralal, S. R., Ostelo, R. W., van der Veer, K., & de Vet, H. C. (2010). Added value of qualitative studies in the development of health related patient reported outcomes such as the Pain Coping and Cognition List in patients with sub-acute neck pain. Manual Therapy, 15(1), 43–47. doi:10.1016/j.math.2009.05.010.CrossRefPubMed Pool, J. J., Hiralal, S. R., Ostelo, R. W., van der Veer, K., & de Vet, H. C. (2010). Added value of qualitative studies in the development of health related patient reported outcomes such as the Pain Coping and Cognition List in patients with sub-acute neck pain. Manual Therapy, 15(1), 43–47. doi:10.​1016/​j.​math.​2009.​05.​010.CrossRefPubMed
20.
go back to reference Embretson, S. E., & Reise, S. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum. Embretson, S. E., & Reise, S. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
21.
go back to reference Ten Klooster, P. M., Voshaar, M. A. O., Gandek, B., Rose, M., Bjorner, J. B., Taal, E., et al. (2013). Development and evaluation of a crosswalk between the SF-36 physical functioning scale and Health Assessment Questionnaire disability index in rheumatoid arthritis. Health and Quality of Life Outcomes, 11, 199. doi:10.1186/1477-7525-11-199.CrossRefPubMedPubMedCentral Ten Klooster, P. M., Voshaar, M. A. O., Gandek, B., Rose, M., Bjorner, J. B., Taal, E., et al. (2013). Development and evaluation of a crosswalk between the SF-36 physical functioning scale and Health Assessment Questionnaire disability index in rheumatoid arthritis. Health and Quality of Life Outcomes, 11, 199. doi:10.​1186/​1477-7525-11-199.CrossRefPubMedPubMedCentral
22.
go back to reference Voshaar, M. A. O., Ten Klooster, P. M., Taal, E., Wolfe, F., Vonkeman, H., Glas, C. A., et al. (2014). Linking physical function outcomes in rheumatology: Performance of a crosswalk for converting Health Assessment Questionnaire scores to Short Form 36 physical functioning scale scores. Arthritis Care and Research (Hoboken), 66(11), 1754–1758. doi:10.1002/acr.22357.CrossRef Voshaar, M. A. O., Ten Klooster, P. M., Taal, E., Wolfe, F., Vonkeman, H., Glas, C. A., et al. (2014). Linking physical function outcomes in rheumatology: Performance of a crosswalk for converting Health Assessment Questionnaire scores to Short Form 36 physical functioning scale scores. Arthritis Care and Research (Hoboken), 66(11), 1754–1758. doi:10.​1002/​acr.​22357.CrossRef
23.
go back to reference Van der Linden, W. J., & Glas, C. A. W. (Eds.). (2000). Computerized adaptive testing: Theory and practice. Dordrecht: Kluwer Academic Publishers. Van der Linden, W. J., & Glas, C. A. W. (Eds.). (2000). Computerized adaptive testing: Theory and practice. Dordrecht: Kluwer Academic Publishers.
24.
go back to reference Paap, M. C. S., Bode, C., Lenferink, L. I. M., Groen, L. C., Terwee, C. B., Ahmed, S., et al. (2014). Identifying key domains of health-related quality of life for patients with chronic obstructive pulmonary disease: The patient perspective. Health and Quality of Life Outcomes, 12(1), 106. doi:10.1186/s12955-014-0106-3.CrossRefPubMedPubMedCentral Paap, M. C. S., Bode, C., Lenferink, L. I. M., Groen, L. C., Terwee, C. B., Ahmed, S., et al. (2014). Identifying key domains of health-related quality of life for patients with chronic obstructive pulmonary disease: The patient perspective. Health and Quality of Life Outcomes, 12(1), 106. doi:10.​1186/​s12955-014-0106-3.CrossRefPubMedPubMedCentral
25.
go back to reference Cella, D. F., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., et al. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. doi:10.1016/j.jclinepi.2010.04.011.CrossRefPubMedPubMedCentral Cella, D. F., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., et al. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. doi:10.​1016/​j.​jclinepi.​2010.​04.​011.CrossRefPubMedPubMedCentral
26.
go back to reference O’Reilly, M., & Parker, N. (2013). ‘Unsatisfactory Saturation’: A critical exploration of the notion of saturated sample sizes in qualitative research. Qualitative Research, 13(2), 190–197. doi:10.1177/1468794112446106.CrossRef O’Reilly, M., & Parker, N. (2013). ‘Unsatisfactory Saturation’: A critical exploration of the notion of saturated sample sizes in qualitative research. Qualitative Research, 13(2), 190–197. doi:10.​1177/​1468794112446106​.CrossRef
27.
go back to reference Gaskell, G. (2000). Individual and group interviewing. In M. W. Bauer, & G. Gaskell (Eds.), Qualitative researching with text, image and sound. (pp. 39–57). London: SAGE Publications Ltd. Gaskell, G. (2000). Individual and group interviewing. In M. W. Bauer, & G. Gaskell (Eds.), Qualitative researching with text, image and sound. (pp. 39–57). London: SAGE Publications Ltd.
30.
go back to reference Jones, P. W. (2005). St George’s Respiratory Questionnaire for COPD patients (SGRQ-C): Manual. London: St George’s University of London. Jones, P. W. (2005). St George’s Respiratory Questionnaire for COPD patients (SGRQ-C): Manual. London: St George’s University of London.
Metadata
Title
Using the Three-Step Test Interview to understand how patients perceive the St. George’s Respiratory Questionnaire for COPD patients (SGRQ-C)
Authors
Muirne C. S. Paap
Lukas Lange
Job van der Palen
Christina Bode
Publication date
01-06-2016
Publisher
Springer International Publishing
Published in
Quality of Life Research / Issue 6/2016
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-015-1192-3

Other articles of this Issue 6/2016

Quality of Life Research 6/2016 Go to the issue