Skip to main content
Top
Published in: BMC Primary Care 1/2018

Open Access 01-12-2018 | Research article

Development of the Japanese version of the general practice assessment questionnaire: measurement of patient experience and testing of data quality

Authors: Tsunetaka Kijima, Kenju Akai, Akira Matsushita, Tsuyoshi Hamano, Keiichi Onoda, Shozo Yano, Toru Nabika, Yutaka Ishibashi, Shunichi Kumakura

Published in: BMC Primary Care | Issue 1/2018

Login to get access

Abstract

Background

Physicians’ interpersonal performance is critical in medical practice, especially primary care practice. The General Practice Assessment Questionnaire (GPAQ) was developed in the United Kingdom to evaluate the quality of primary care from the viewpoint of patients. This questionnaire highlights the evaluation of interpersonal skills and interactions between physicians and patients. Though several other tools also exist to evaluate primary care quality, the GPAQ has several distinctive evaluation items, covering receptionists, access to primary care, and enablement (patients’ understanding of self-care and of their own health after consultation). Our purpose was to develop and validate a Japanese version of the GPAQ.

Methods

This cross-sectional study tested the validity and reliability of the Japanese version of the questionnaire. We translated the original GPAQ into Japanese and assessed its reliability and validity among patients aged ≥20 years at five rural primary care centres located in Shimane and Okayama prefectures, Japan. We also examined its internal reliability using Cronbach’s alpha coefficient and construct validity—including item-scale correlations, item-other scale correlations, and inter-scale correlations. Moreover, we examined correlations between each score and overall satisfaction using Spearman’s correlation coefficient for criterion-related validity.

Results

The translated version of the GPAQ was administered, and we received 252 responses (mean age: 68 ± 12.3 years, male: 42.9%); all data were analysed. The translated questionnaire showed good reliability and validity, with Cronbach’s alphas ranging from 0.79–0.92 for all scales, and satisfactory item-scale, item-other scale, and inter-scale correlations. Correlations with overall satisfaction were strong (Spearman’s correlation coefficients: 0.31–0.38) for all scales except ‘continuity of care’.

Conclusions

The Japanese version of the GPAQ was acceptable, reliable, and valid. This could be a useful instrument to evaluate key areas of primary care performance in Japan, particularly physicians’ communication skills. Further work is required to evaluate its utility in urban areas.
Appendix
Available only for authorised users
Literature
1.
go back to reference Flocke SA. Measuring attributes of primary care: development of a new instrument. J Fam Pract. 1997;45:64–74.PubMed Flocke SA. Measuring attributes of primary care: development of a new instrument. J Fam Pract. 1997;45:64–74.PubMed
2.
go back to reference Safran DG, Taira DA, Rogers WH, Kosinski M, Ware JE, Tarlov AR. Linking primary care performance to outcomes of care. J Fam Pract. 1998;47:213–21.PubMed Safran DG, Taira DA, Rogers WH, Kosinski M, Ware JE, Tarlov AR. Linking primary care performance to outcomes of care. J Fam Pract. 1998;47:213–21.PubMed
3.
go back to reference Taira DA, Safran DG, Seto TB, Rogers WH, Kosinski M, Ware JE, et al. Asian-American patient ratings of physician primary care performance. J Gen Intern Med. 1997;12:237–42.CrossRef Taira DA, Safran DG, Seto TB, Rogers WH, Kosinski M, Ware JE, et al. Asian-American patient ratings of physician primary care performance. J Gen Intern Med. 1997;12:237–42.CrossRef
4.
go back to reference Shi L, Starfield B, Xu J. validating the adult primary care assessment tool. J Fam Pract. 2001;50:161–8. Shi L, Starfield B, Xu J. validating the adult primary care assessment tool. J Fam Pract. 2001;50:161–8.
5.
go back to reference Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, et al. Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract. 2000;50:882–7.PubMedPubMedCentral Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, et al. Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract. 2000;50:882–7.PubMedPubMedCentral
6.
go back to reference Ramsay J, Campbell JL, Schroter S, Green J, Roland M. The general practice assessment survey (GPAS): tests of data quality and measurement properties. Fam Pract. 2000;17:372–9.CrossRef Ramsay J, Campbell JL, Schroter S, Green J, Roland M. The general practice assessment survey (GPAS): tests of data quality and measurement properties. Fam Pract. 2000;17:372–9.CrossRef
7.
go back to reference Bower P, Roland M, Campbell J, Mead N. Setting standards based on patients’ views on access and continuity: secondary analysis of data from the general practice assessment survey. BMJ. 2003;326:258.CrossRef Bower P, Roland M, Campbell J, Mead N. Setting standards based on patients’ views on access and continuity: secondary analysis of data from the general practice assessment survey. BMJ. 2003;326:258.CrossRef
8.
go back to reference Mead N, Bower P, Roland M. The general practice assessment questionnaire (GPAQ)–development and psychometric characteristics. BMC Fam Pract. 2008;9:13.CrossRef Mead N, Bower P, Roland M. The general practice assessment questionnaire (GPAQ)–development and psychometric characteristics. BMC Fam Pract. 2008;9:13.CrossRef
9.
go back to reference Bower P, Mead N, Roland M. What dimensions underlie patient responses to the general practice assessment survey? A factor analytic study Fam Pract. 2002;19:489–95.CrossRef Bower P, Mead N, Roland M. What dimensions underlie patient responses to the general practice assessment survey? A factor analytic study Fam Pract. 2002;19:489–95.CrossRef
10.
go back to reference Jaturapatporn D, Hathirat S, Manataweewat B, Dellow AC, Leelaharattanarak S, Sirimothya S, et al. Reliability and validity of a Thai version of the general practice assessment questionnaire (GPAQ). J Med Assoc Thail. 2006;89:1491–6. Jaturapatporn D, Hathirat S, Manataweewat B, Dellow AC, Leelaharattanarak S, Sirimothya S, et al. Reliability and validity of a Thai version of the general practice assessment questionnaire (GPAQ). J Med Assoc Thail. 2006;89:1491–6.
12.
go back to reference Jaturapatporn D, Dellow A. Does family medicine training in Thailand affect patient satisfaction with primary care doctors? BMC Fam Pract. 2007;8:14.CrossRef Jaturapatporn D, Dellow A. Does family medicine training in Thailand affect patient satisfaction with primary care doctors? BMC Fam Pract. 2007;8:14.CrossRef
13.
go back to reference Pearson SD, Raeke LH. Patients’ trust in physicians: many theories, few measures, and little data. J Gen Intern Med. 2000;15:509–13.CrossRef Pearson SD, Raeke LH. Patients’ trust in physicians: many theories, few measures, and little data. J Gen Intern Med. 2000;15:509–13.CrossRef
14.
go back to reference Coulter A. Can patients assess the quality of health care? Patients’ surveys should ask about real experiences of medical care. BMJ. 2006;333:1–2.CrossRef Coulter A. Can patients assess the quality of health care? Patients’ surveys should ask about real experiences of medical care. BMJ. 2006;333:1–2.CrossRef
15.
go back to reference Greco M, Brownlea A, McGovern J. Impact of patient feedback on the interpersonal skills of general practice registrars: results of a longitudinal study. Med Educ. 2001;35:748–56.CrossRef Greco M, Brownlea A, McGovern J. Impact of patient feedback on the interpersonal skills of general practice registrars: results of a longitudinal study. Med Educ. 2001;35:748–56.CrossRef
16.
go back to reference Harding C, Parajuli N, Johnston L, Pilotto L. Comparing patients’ perceptions of IMGs and local Australian graduates in rural general practice. Aust Fam Physician. 2010;39:231–3.PubMed Harding C, Parajuli N, Johnston L, Pilotto L. Comparing patients’ perceptions of IMGs and local Australian graduates in rural general practice. Aust Fam Physician. 2010;39:231–3.PubMed
17.
go back to reference Aoki T, Inoue M, Nakayama T. Development and validation of the Japanese version of primary care assessment tool. Fam Pract. 2016;33:112–7.CrossRef Aoki T, Inoue M, Nakayama T. Development and validation of the Japanese version of primary care assessment tool. Fam Pract. 2016;33:112–7.CrossRef
18.
go back to reference Aoki T, Inoue M. Primary care patient experience and cancer screening uptake among women: an exploratory cross-sectional study in a Japanese population. Asia Pac Fam Med. 2017;16:3.CrossRef Aoki T, Inoue M. Primary care patient experience and cancer screening uptake among women: an exploratory cross-sectional study in a Japanese population. Asia Pac Fam Med. 2017;16:3.CrossRef
19.
go back to reference Aoki T, Inoue M. Association between health literacy and patient experience of primary care attributes: a cross-sectional study in Japan. PLoS One. 2017;12:e0184565.CrossRef Aoki T, Inoue M. Association between health literacy and patient experience of primary care attributes: a cross-sectional study in Japan. PLoS One. 2017;12:e0184565.CrossRef
23.
go back to reference Boerma WG. Profiles of general practice in Europe. An international study of variation in the tasks of general practitioners. 2003:32–43. Boerma WG. Profiles of general practice in Europe. An international study of variation in the tasks of general practitioners. 2003:32–43.
24.
go back to reference Pasarín MI, Berra S, Rajmil L, Solans M, Borrell C. Starfield B. a tool to evaluate primary health care from the population perspective. Aten Primaria. 2007;39:395–403.CrossRef Pasarín MI, Berra S, Rajmil L, Solans M, Borrell C. Starfield B. a tool to evaluate primary health care from the population perspective. Aten Primaria. 2007;39:395–403.CrossRef
25.
go back to reference Fitch K, Bernstein SJ, Aguilar MD, Burnand B, JR LC. The RAND/UCLA appropriateness method user’s manual. Santa Monica: RAND Corporation; 2001. Fitch K, Bernstein SJ, Aguilar MD, Burnand B, JR LC. The RAND/UCLA appropriateness method user’s manual. Santa Monica: RAND Corporation; 2001.
26.
go back to reference Lee JH, Choi Y-J, Volk RJ, Kim SY, Kim YS, Park HK, et al. Defining the concept of primary care in South Korea using a Delphi method. 2007;39:425. Lee JH, Choi Y-J, Volk RJ, Kim SY, Kim YS, Park HK, et al. Defining the concept of primary care in South Korea using a Delphi method. 2007;39:425.
27.
go back to reference Thornton RD, Nurse N, Snavely L, Hackett-Zahler S, Frank K, DiTomasso RA. Influences on patient satisfaction in healthcare centers: a semi-quantitative study over 5 years. BMC Health Serv Res. 2017;17:361.CrossRef Thornton RD, Nurse N, Snavely L, Hackett-Zahler S, Frank K, DiTomasso RA. Influences on patient satisfaction in healthcare centers: a semi-quantitative study over 5 years. BMC Health Serv Res. 2017;17:361.CrossRef
30.
go back to reference Tourangeau R, Yan T. Sensitive questions in surveys. Psychol Bull. 2007;133:859.CrossRef Tourangeau R, Yan T. Sensitive questions in surveys. Psychol Bull. 2007;133:859.CrossRef
31.
go back to reference Ware JE, Kosinski M, Dewey JE, Gandek B. SF-36 Health survey: manual and interpretation guide. Lincoln, RI: Quality Metric Inc.; 2000. Ware JE, Kosinski M, Dewey JE, Gandek B. SF-36 Health survey: manual and interpretation guide. Lincoln, RI: Quality Metric Inc.; 2000.
32.
go back to reference Dubé L, Ferland G. Emotional and interpersonal dimensions of health services: enriching the art of care with the science of care. Montreal: McGill-Queen’s Press; 2003. Dubé L, Ferland G. Emotional and interpersonal dimensions of health services: enriching the art of care with the science of care. Montreal: McGill-Queen’s Press; 2003.
33.
go back to reference Yang H, Shi L, Lebrun LA, Zhou X, Liu J, Wang H. Development of the Chinese primary care assessment tool: data quality and measurement properties. Int J Qual Health Care. 2013;25:92–105.CrossRef Yang H, Shi L, Lebrun LA, Zhou X, Liu J, Wang H. Development of the Chinese primary care assessment tool: data quality and measurement properties. Int J Qual Health Care. 2013;25:92–105.CrossRef
34.
go back to reference Lee JH, Choi Y-J, Sung NJ, Kim SY, Chung SH, Kim J, et al. Development of the Korean primary care assessment tool—measuring user experience: tests of data quality and measurement performance. Int J Qual Health Care. 2009;21:103–11.CrossRef Lee JH, Choi Y-J, Sung NJ, Kim SY, Chung SH, Kim J, et al. Development of the Korean primary care assessment tool—measuring user experience: tests of data quality and measurement performance. Int J Qual Health Care. 2009;21:103–11.CrossRef
35.
go back to reference Campbell J, Smith P, Nissen S, Bower P, Elliott M, Roland M. The GP patient survey for use in primary care in the National Health Service in the UK–development and psychometric characteristics. BMC Fam Pract. 2009;10:57.CrossRef Campbell J, Smith P, Nissen S, Bower P, Elliott M, Roland M. The GP patient survey for use in primary care in the National Health Service in the UK–development and psychometric characteristics. BMC Fam Pract. 2009;10:57.CrossRef
36.
go back to reference Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability. the IQOLA Project approach J Clin Epidemiol. 1998;51:945–52.CrossRef Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability. the IQOLA Project approach J Clin Epidemiol. 1998;51:945–52.CrossRef
37.
go back to reference Hays RD, Hayashi T, Carson S, Ware JE. User’s guide for the Multitrait Analysis Program (MAP). Santa Monica: RAND Corporation; 1998. Hays RD, Hayashi T, Carson S, Ware JE. User’s guide for the Multitrait Analysis Program (MAP). Santa Monica: RAND Corporation; 1998.
38.
go back to reference Leung YY, Ho KW, Zhu TY, Tam LS, Kun EW-L, Li EK-M. Testing scaling assumptions, reliability and validity of medical outcomes study short-form 36 health survey in psoriatic arthritis. Rheumatology. 2010;49:1495–501.CrossRef Leung YY, Ho KW, Zhu TY, Tam LS, Kun EW-L, Li EK-M. Testing scaling assumptions, reliability and validity of medical outcomes study short-form 36 health survey in psoriatic arthritis. Rheumatology. 2010;49:1495–501.CrossRef
39.
go back to reference Vernon SW, Myers RE, Tilley BC. Development and validation of an instrument to measure factors related to colorectal cancer screening adherence. Cancer Epidemiol Biomarkers Prev. 1997;6:825–32. Vernon SW, Myers RE, Tilley BC. Development and validation of an instrument to measure factors related to colorectal cancer screening adherence. Cancer Epidemiol Biomarkers Prev. 1997;6:825–32.
40.
go back to reference Li L, Wang H, Shen Y. Chinese SF-36 health survey: translation, cultural adaptation, validation, and normalisation. J Epidemiol Commun Health. 2003;57:259–63.CrossRef Li L, Wang H, Shen Y. Chinese SF-36 health survey: translation, cultural adaptation, validation, and normalisation. J Epidemiol Commun Health. 2003;57:259–63.CrossRef
41.
go back to reference Dörnyei Z. Research methods in applied linguistics: quantitative, qualitative, and mixed methodologies. Oxford: Oxford University Press; 2007. Dörnyei Z. Research methods in applied linguistics: quantitative, qualitative, and mixed methodologies. Oxford: Oxford University Press; 2007.
43.
go back to reference Potiriadis M, Chondros P, Gilchrist G, Hegarty K, Blashki G, Gunn JM. How do Australian patients rate their general practitioner? A descriptive study using the general practice assessment questionnaire. Med J Austral. 2008;189:215–9.PubMed Potiriadis M, Chondros P, Gilchrist G, Hegarty K, Blashki G, Gunn JM. How do Australian patients rate their general practitioner? A descriptive study using the general practice assessment questionnaire. Med J Austral. 2008;189:215–9.PubMed
44.
go back to reference Zwier G. A standardised and validated patient survey in primary care: introducing the New Zealand general practice assessment questionnaire (NZGPAQ). N Z Med J. 2013;126:47–54.PubMed Zwier G. A standardised and validated patient survey in primary care: introducing the New Zealand general practice assessment questionnaire (NZGPAQ). N Z Med J. 2013;126:47–54.PubMed
45.
go back to reference Roland M, Roberts M, Rhenius V, Campbell J. GPAQ-R: development and psychometric properties of a version of the general practice assessment questionnaire for use for revalidation by general practitioners in the UK. BMC Fam Pract. 2013;14:160.CrossRef Roland M, Roberts M, Rhenius V, Campbell J. GPAQ-R: development and psychometric properties of a version of the general practice assessment questionnaire for use for revalidation by general practitioners in the UK. BMC Fam Pract. 2013;14:160.CrossRef
49.
go back to reference Ross ELD, Iso-Ahola SE. Sightseeing tourists' motivation and satisfaction. Ann Tour Res. 1991;18:226–37.CrossRef Ross ELD, Iso-Ahola SE. Sightseeing tourists' motivation and satisfaction. Ann Tour Res. 1991;18:226–37.CrossRef
50.
go back to reference Rolstad S, Adler J, Rydén A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14:1101–8.CrossRef Rolstad S, Adler J, Rydén A. Response burden and questionnaire length: is shorter better? A review and meta-analysis. Value Health. 2011;14:1101–8.CrossRef
Metadata
Title
Development of the Japanese version of the general practice assessment questionnaire: measurement of patient experience and testing of data quality
Authors
Tsunetaka Kijima
Kenju Akai
Akira Matsushita
Tsuyoshi Hamano
Keiichi Onoda
Shozo Yano
Toru Nabika
Yutaka Ishibashi
Shunichi Kumakura
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2018
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/s12875-018-0873-8

Other articles of this Issue 1/2018

BMC Primary Care 1/2018 Go to the issue