Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

Impact of referral templates on the quality of referrals from primary to secondary care: a cluster randomised trial

Authors: Henrik Wåhlberg, Per Christian Valle, Siri Malm, Ann Ragnhild Broderstad

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

The referral letter is an important document facilitating the transfer of care from a general practitioner (GP) to secondary care. Hospital doctors have often criticised the quality and content of referral letters, and the effectiveness of improvement efforts remains uncertain.

Methods

A cluster randomised trial was conducted using referral templates for patients in four diagnostic groups: dyspepsia, suspected colorectal cancer, chest pain and chronic obstructive pulmonary disease. The GP surgery was the unit of randomisation. Of the 14 surgeries served by the University Hospital of North Norway Harstad, seven were randomised to the intervention group. Intervention GPs used referral templates soliciting core clinical information when initiating a new referral in one of the four clinical areas. Intermittent surgery visits by study personnel were also carried out. A total of 500 patients were included, with 281 in the intervention and 219 in the control arm. Referral quality scoring was performed by three blinded raters. Data were analysed using multi-level regression modelling. All analyses were conducted on intention-to-treat basis.

Results

In the final multilevel model, referrals in the intervention group scored 18 % higher (95 % CI (11 %, 25 %), p < 0.001) on the referral quality score than the control group. The model also showed that board certified GPs and GPs in larger surgeries produced referrals of significantly higher quality.

Conclusion

In this study, the dissemination of referral templates coupled with intermittent surgery visits produced higher quality referrals.

Trial registration

This trial has been registered at ClinicalTrials.gov. The trial registration number is NCT01470963.
Appendix
Available only for authorised users
Literature
1.
go back to reference Garasen H, Johnsen R. The quality of communication about older patients between hospital physicians and general practitioners: a panel study assessment. BMC Health Serv Res. 2007;7:133.CrossRefPubMedPubMedCentral Garasen H, Johnsen R. The quality of communication about older patients between hospital physicians and general practitioners: a panel study assessment. BMC Health Serv Res. 2007;7:133.CrossRefPubMedPubMedCentral
2.
go back to reference Tuomisto LE, Erhola M, Kaila M, Brander PE, Kauppinen R, Puolijoki H, et al. The Finnish national asthma programme: communication in asthma care--quality assessment of asthma referral letters. J Eval Clin Pract. 2007;13:50–4.CrossRefPubMed Tuomisto LE, Erhola M, Kaila M, Brander PE, Kauppinen R, Puolijoki H, et al. The Finnish national asthma programme: communication in asthma care--quality assessment of asthma referral letters. J Eval Clin Pract. 2007;13:50–4.CrossRefPubMed
3.
go back to reference Ong SP, Lim LT, Barnsley L, Read R. General practitioners’ referral letters--Do they meet the expectations of gastroenterologists and rheumatologists? Aust Fam Physician. 2006;35:920–2.PubMed Ong SP, Lim LT, Barnsley L, Read R. General practitioners’ referral letters--Do they meet the expectations of gastroenterologists and rheumatologists? Aust Fam Physician. 2006;35:920–2.PubMed
4.
go back to reference Dentith GE, Wilson KE, Dorman M, Girdler NM. An audit of patient referrals to the sedation department of Newcastle Dental Hospital. Prim Dent Care. 2010;17:85–91.CrossRefPubMed Dentith GE, Wilson KE, Dorman M, Girdler NM. An audit of patient referrals to the sedation department of Newcastle Dental Hospital. Prim Dent Care. 2010;17:85–91.CrossRefPubMed
5.
go back to reference Syed AA, Large DM. Quality of GPs’ referral letters to diabetes secondary care. Practical Diabetes International. 2003;20:165–9.CrossRef Syed AA, Large DM. Quality of GPs’ referral letters to diabetes secondary care. Practical Diabetes International. 2003;20:165–9.CrossRef
6.
go back to reference Newton J, Hutchinson A, Hayes V, Mccoll E, Mackee I, Holland C. Do clinicians tell each other enough? An analysis of referral communications in two specialties. Fam Pract. 1994;11:15–20.CrossRefPubMed Newton J, Hutchinson A, Hayes V, Mccoll E, Mackee I, Holland C. Do clinicians tell each other enough? An analysis of referral communications in two specialties. Fam Pract. 1994;11:15–20.CrossRefPubMed
7.
go back to reference Shaw I, Smith KM, Middleton H, Woodward L. A letter of consequence: referral letters from general practitioners to secondary mental health services. Qual Health Res. 2005;15:116–28.CrossRefPubMed Shaw I, Smith KM, Middleton H, Woodward L. A letter of consequence: referral letters from general practitioners to secondary mental health services. Qual Health Res. 2005;15:116–28.CrossRefPubMed
8.
go back to reference Bodek S, Ghori K, Edelstein M, Reed A, MacFadyen RJ. Contemporary referral of patients from community care to cardiology lack diagnostic and clinical detail. Int J Clin Pract. 2006;60:595–601.CrossRefPubMed Bodek S, Ghori K, Edelstein M, Reed A, MacFadyen RJ. Contemporary referral of patients from community care to cardiology lack diagnostic and clinical detail. Int J Clin Pract. 2006;60:595–601.CrossRefPubMed
9.
go back to reference Grol R, Rooijackers-Lemmers N, van Kaathoven L, Wollersheim H, Mokkink H. Communication at the interface: do better referral letters produce better consultant replies? Br J Gen Pract. 2003;53:217–9.PubMedPubMedCentral Grol R, Rooijackers-Lemmers N, van Kaathoven L, Wollersheim H, Mokkink H. Communication at the interface: do better referral letters produce better consultant replies? Br J Gen Pract. 2003;53:217–9.PubMedPubMedCentral
10.
go back to reference Westerman RF, Hull FM, Bezemer PD, Gort G. A study of communication between general practitioners and specialists. Br J Gen Pract. 1990;40:445–9.PubMedPubMedCentral Westerman RF, Hull FM, Bezemer PD, Gort G. A study of communication between general practitioners and specialists. Br J Gen Pract. 1990;40:445–9.PubMedPubMedCentral
11.
go back to reference Cheng J, Beltran-Agullo L, Trope GE, Buys YM. Assessment of the quality of glaucoma referral letters based on a survey of glaucoma specialists and a glaucoma guideline. Ophthalmology. 2014;121:126–33.CrossRefPubMed Cheng J, Beltran-Agullo L, Trope GE, Buys YM. Assessment of the quality of glaucoma referral letters based on a survey of glaucoma specialists and a glaucoma guideline. Ophthalmology. 2014;121:126–33.CrossRefPubMed
12.
go back to reference Jiwa M, Coleman M, McKinley RK. Measuring the quality of referral letters about patients with upper gastrointestinal symptoms. Postgrad Med J. 2005;81:467–9.CrossRefPubMedPubMedCentral Jiwa M, Coleman M, McKinley RK. Measuring the quality of referral letters about patients with upper gastrointestinal symptoms. Postgrad Med J. 2005;81:467–9.CrossRefPubMedPubMedCentral
13.
go back to reference Canadian Medical Association. National Survey: experiences with referrals from primary to specialty care. Ottawa, Ontario: Canadian Medical Association; 2013. Canadian Medical Association. National Survey: experiences with referrals from primary to specialty care. Ottawa, Ontario: Canadian Medical Association; 2013.
14.
go back to reference Patel NN, D’Souza J, Rocker M, Townsend E, Morris-Stiff G, Manimaran M, et al. Prioritisation of vascular outpatient appointments cannot be based on referral letters alone. Surgeon. 2008;6:140–3.CrossRefPubMed Patel NN, D’Souza J, Rocker M, Townsend E, Morris-Stiff G, Manimaran M, et al. Prioritisation of vascular outpatient appointments cannot be based on referral letters alone. Surgeon. 2008;6:140–3.CrossRefPubMed
15.
go back to reference Goodwin N, Dixon A, Poole T, Raleigh V. Improving the quality of care in general practice. London: The King's Fund; 2011 Goodwin N, Dixon A, Poole T, Raleigh V. Improving the quality of care in general practice. London: The King's Fund; 2011
16.
go back to reference Newton J, Eccles M, Hutchinson A. Communication between general practitioners and consultants: what should their letters contain? BMJ. 1992;304:821–4.CrossRefPubMedPubMedCentral Newton J, Eccles M, Hutchinson A. Communication between general practitioners and consultants: what should their letters contain? BMJ. 1992;304:821–4.CrossRefPubMedPubMedCentral
17.
go back to reference Ree AO: Medisinsk faglig innhold i henvisninger. Trondheim: The Norwegian Direcorate for Health; 2003. Ree AO: Medisinsk faglig innhold i henvisninger. Trondheim: The Norwegian Direcorate for Health; 2003.
18.
go back to reference Ree AO: Medisinsk faglig innhold i epikriser. Trondheim: The Norwegian Direcorate for Health; 2002. Ree AO: Medisinsk faglig innhold i epikriser. Trondheim: The Norwegian Direcorate for Health; 2002.
19.
go back to reference Martinussen PE. Referral quality and the cooperation between hospital physicians and general practice: The role of physician and primary care factors. Scand J Public Health. 2013;41:874.CrossRefPubMed Martinussen PE. Referral quality and the cooperation between hospital physicians and general practice: The role of physician and primary care factors. Scand J Public Health. 2013;41:874.CrossRefPubMed
20.
go back to reference Rokstad IS, Rokstad KS, Holmen S, Lehmann S, Assmus J. Electronic optional guidelines as a tool to improve the process of referring patients to specialized care: an intervention study. Scand J Prim Health Care. 2013;31:166–71.CrossRefPubMedPubMedCentral Rokstad IS, Rokstad KS, Holmen S, Lehmann S, Assmus J. Electronic optional guidelines as a tool to improve the process of referring patients to specialized care: an intervention study. Scand J Prim Health Care. 2013;31:166–71.CrossRefPubMedPubMedCentral
21.
go back to reference OECD. What Future for Health Spending? OECD Economics Department Policy Notes, No. 19 June 2013; 2013. OECD. What Future for Health Spending? OECD Economics Department Policy Notes, No. 19 June 2013; 2013.
22.
go back to reference Wahlberg H, Valle PC, Malm S, Broderstad AR. Practical health co-operation - the impact of a referral template on quality of care and health care co-operation: study protocol for a cluster randomized controlled trial. Trials. 2013;14:7.CrossRefPubMedPubMedCentral Wahlberg H, Valle PC, Malm S, Broderstad AR. Practical health co-operation - the impact of a referral template on quality of care and health care co-operation: study protocol for a cluster randomized controlled trial. Trials. 2013;14:7.CrossRefPubMedPubMedCentral
23.
go back to reference Carlsen B, Norheim OF. Changes in Norwegian physicians’ perception of their gatekeeper role. Scand J Prim Health Care. 2003;21:209–13.CrossRefPubMed Carlsen B, Norheim OF. Changes in Norwegian physicians’ perception of their gatekeeper role. Scand J Prim Health Care. 2003;21:209–13.CrossRefPubMed
24.
go back to reference Jiwa M, Mathers N, Walters S. Quality of information on referrals to colorectal surgeons: towards consensus. Curr Med Res Opin. 2002;18:72–7.CrossRefPubMed Jiwa M, Mathers N, Walters S. Quality of information on referrals to colorectal surgeons: towards consensus. Curr Med Res Opin. 2002;18:72–7.CrossRefPubMed
25.
go back to reference Nygaard E, Kårikstad V. Prioriteringsveileder - Fordøyelsessykdommer. Oslo: Helsedirektoratet; 2009. Nygaard E, Kårikstad V. Prioriteringsveileder - Fordøyelsessykdommer. Oslo: Helsedirektoratet; 2009.
26.
go back to reference Nygaard E, Kårikstad V. Prioriteringsveileder - Lungesykdommer. Oslo: Helsedirektoratet; 2008. Nygaard E, Kårikstad V. Prioriteringsveileder - Lungesykdommer. Oslo: Helsedirektoratet; 2008.
27.
go back to reference Nygaard E, Kårikstad V. Prioriteringsveileder - Hjertemedisinske sykdommer. Oslo: Helsedirektoratet; 2009. Nygaard E, Kårikstad V. Prioriteringsveileder - Hjertemedisinske sykdommer. Oslo: Helsedirektoratet; 2009.
28.
go back to reference British Thoracic Society Standards of Care Committee. BTS statement on criteria for specialist referral, admission, discharge and follow-up for adults with respiratory disease. Thorax. 2008;63:i1–16.CrossRef British Thoracic Society Standards of Care Committee. BTS statement on criteria for specialist referral, admission, discharge and follow-up for adults with respiratory disease. Thorax. 2008;63:i1–16.CrossRef
29.
go back to reference Snow V, Barry P, Fihn SD, Gibbons RJ, Owens DK, Williams SV, et al. Evaluation of primary care patients with chronic stable Angina: guidelines from the American College of physicians. Ann Intern Med. 2004;141:57–64.CrossRefPubMed Snow V, Barry P, Fihn SD, Gibbons RJ, Owens DK, Williams SV, et al. Evaluation of primary care patients with chronic stable Angina: guidelines from the American College of physicians. Ann Intern Med. 2004;141:57–64.CrossRefPubMed
30.
go back to reference Malm S, Schirmer H. Hjertesak: Riktigere prioritering av pasienter! Fastlegenytt (2). 2010. UNN. 6-3-0012. Malm S, Schirmer H. Hjertesak: Riktigere prioritering av pasienter! Fastlegenytt (2). 2010. UNN. 6-3-0012.
31.
go back to reference Erhardt L, Herlitz J, Bossaert L, Halinen M, Keltai M, Koster R, et al. Task force on the management of chest pain. Eur Heart J. 2002;23:1153–76.CrossRefPubMed Erhardt L, Herlitz J, Bossaert L, Halinen M, Keltai M, Koster R, et al. Task force on the management of chest pain. Eur Heart J. 2002;23:1153–76.CrossRefPubMed
32.
go back to reference Kostopoulou O, Delaney BC, Munro CW. Diagnostic difficulty and error in primary care--a systematic review. Fam Pract. 2008;25:400–13.CrossRefPubMed Kostopoulou O, Delaney BC, Munro CW. Diagnostic difficulty and error in primary care--a systematic review. Fam Pract. 2008;25:400–13.CrossRefPubMed
33.
go back to reference Murphy CL, Sheane B, Durcan I, O’Shea FD, Doran M, Cunnane G. Benefits of pre-referral preparation for rheumatology clinics. Ir Med J. 2013;106:275–7.PubMed Murphy CL, Sheane B, Durcan I, O’Shea FD, Doran M, Cunnane G. Benefits of pre-referral preparation for rheumatology clinics. Ir Med J. 2013;106:275–7.PubMed
34.
go back to reference Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70:213–20.CrossRefPubMed Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70:213–20.CrossRefPubMed
35.
go back to reference Maclure M, Willett WC. Misinterpretation and misuse of the kappa statistic. Am J Epidemiol. 1987;126:161–9.CrossRefPubMed Maclure M, Willett WC. Misinterpretation and misuse of the kappa statistic. Am J Epidemiol. 1987;126:161–9.CrossRefPubMed
36.
go back to reference Fleiss JL, Cohen J. The equivalence of weighted Kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.CrossRef Fleiss JL, Cohen J. The equivalence of weighted Kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.CrossRef
37.
go back to reference Brenner H, Kliebsch U. Dependence of weighted kappa coefficients on the number of categories. Epidemiology. 1996;7:199–202.CrossRefPubMed Brenner H, Kliebsch U. Dependence of weighted kappa coefficients on the number of categories. Epidemiology. 1996;7:199–202.CrossRefPubMed
38.
go back to reference Mathieu JE, Aguinis H, Culpepper SA, Chen G. Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling. J Appl Psychol. 2012;97:951–66.CrossRefPubMed Mathieu JE, Aguinis H, Culpepper SA, Chen G. Understanding and estimating the power to detect cross-level interaction effects in multilevel modeling. J Appl Psychol. 2012;97:951–66.CrossRefPubMed
40.
go back to reference Eldridge S, Kerry S. A practical guide to cluster randomised trials in health services research. Chichester: John Wiley & Sons, Ltd; 2012.CrossRef Eldridge S, Kerry S. A practical guide to cluster randomised trials in health services research. Chichester: John Wiley & Sons, Ltd; 2012.CrossRef
41.
go back to reference Emslie C, Grimshaw J, Templeton A. Do clinical guidelines improve general practice management and referral of infertile couples? BMJ. 1993;306:1728–31.CrossRefPubMedPubMedCentral Emslie C, Grimshaw J, Templeton A. Do clinical guidelines improve general practice management and referral of infertile couples? BMJ. 1993;306:1728–31.CrossRefPubMedPubMedCentral
42.
go back to reference Jiwa M, Walters S, Mathers N. Referral letters to colorectal surgeons: the impact of peer-mediated feedback. Br J Gen Pract. 2004;54:123–6.PubMedPubMedCentral Jiwa M, Walters S, Mathers N. Referral letters to colorectal surgeons: the impact of peer-mediated feedback. Br J Gen Pract. 2004;54:123–6.PubMedPubMedCentral
43.
go back to reference Jillian M, Louise C, Sara T, Iain C, Jeremy G, Alastair L, et al. Pragmatic randomised controlled trial to evaluate guidelines for the management of infertility across the primary care-secondary care interface. BMJ. 2001;322:1282.CrossRef Jillian M, Louise C, Sara T, Iain C, Jeremy G, Alastair L, et al. Pragmatic randomised controlled trial to evaluate guidelines for the management of infertility across the primary care-secondary care interface. BMJ. 2001;322:1282.CrossRef
44.
go back to reference Akbari A, Mayhew A, Al-Alawi MA, Grimshaw J, Winkens R, Glidewell E, et al. Interventions to improve outpatient referrals from primary care to secondary care. Cochrane Database Syst Rev. 2008;4:CD005471.PubMed Akbari A, Mayhew A, Al-Alawi MA, Grimshaw J, Winkens R, Glidewell E, et al. Interventions to improve outpatient referrals from primary care to secondary care. Cochrane Database Syst Rev. 2008;4:CD005471.PubMed
45.
go back to reference Coulter A, Noone A, Goldacre M. General practitioners’ referrals to specialist outpatient clinics. I. Why general practitioners refer patients to specialist outpatient clinics. BMJ. 1989;299:304–6.CrossRefPubMedPubMedCentral Coulter A, Noone A, Goldacre M. General practitioners’ referrals to specialist outpatient clinics. I. Why general practitioners refer patients to specialist outpatient clinics. BMJ. 1989;299:304–6.CrossRefPubMedPubMedCentral
46.
go back to reference Ringberg U, Fleten N, Deraas T, Hasvold T, Forde O. High referral rates to secondary care by general practitioners in Norway are associated with GPs’ gender and specialist qualifications in family medicine, a study of 4350 consultations. BMC Health Serv Res. 2013;13:147.CrossRefPubMedPubMedCentral Ringberg U, Fleten N, Deraas T, Hasvold T, Forde O. High referral rates to secondary care by general practitioners in Norway are associated with GPs’ gender and specialist qualifications in family medicine, a study of 4350 consultations. BMC Health Serv Res. 2013;13:147.CrossRefPubMedPubMedCentral
47.
go back to reference Forde OH, Breidablik HJ, Ogar P. Do differences in referral rates threaten the goal of equity in health care? Tidsskr Nor Laegeforen. 2011;131:1878–81.CrossRefPubMed Forde OH, Breidablik HJ, Ogar P. Do differences in referral rates threaten the goal of equity in health care? Tidsskr Nor Laegeforen. 2011;131:1878–81.CrossRefPubMed
48.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed
49.
go back to reference Jiwa M, Skinner P, Coker AO, Shaw L, Campbell MJ, Thompson J. Implementing referral guidelines: lessons from a negative outcome cluster randomised factorial trial in general practice. BMC Fam Pract. 2006;7:65.CrossRefPubMedPubMedCentral Jiwa M, Skinner P, Coker AO, Shaw L, Campbell MJ, Thompson J. Implementing referral guidelines: lessons from a negative outcome cluster randomised factorial trial in general practice. BMC Fam Pract. 2006;7:65.CrossRefPubMedPubMedCentral
50.
go back to reference Légaré F. Assessing barriers and facilitators to knowledge use. In: Straus S, Tetroe J, Graham ID, editors. Knowledge Translation in Health Care. Oxford: Blackwell Publishing Ltd; 2009. Légaré F. Assessing barriers and facilitators to knowledge use. In: Straus S, Tetroe J, Graham ID, editors. Knowledge Translation in Health Care. Oxford: Blackwell Publishing Ltd; 2009.
51.
go back to reference Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3:CD005470.PubMed Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3:CD005470.PubMed
52.
go back to reference Jellema P, van der Windt DA, Bruinvels DJ, Mallen CD, van Weyenberg SJ, Mulder CJ, et al. Value of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis. BMJ. 2010;340:c1269.CrossRefPubMedPubMedCentral Jellema P, van der Windt DA, Bruinvels DJ, Mallen CD, van Weyenberg SJ, Mulder CJ, et al. Value of symptoms and additional diagnostic tests for colorectal cancer in primary care: systematic review and meta-analysis. BMJ. 2010;340:c1269.CrossRefPubMedPubMedCentral
53.
go back to reference Norheim OF, Allgott B, Gjul GK, Kjellevold A, Moen A, Sjøli S, et al. Åpent og rettferdig - prioriteringer i helsetjenesten (open and fair - priorities in the health care services). Oslo: Norwegian Ministry of Health and Care Services; 2014. Norheim OF, Allgott B, Gjul GK, Kjellevold A, Moen A, Sjøli S, et al. Åpent og rettferdig - prioriteringer i helsetjenesten (open and fair - priorities in the health care services). Oslo: Norwegian Ministry of Health and Care Services; 2014.
Metadata
Title
Impact of referral templates on the quality of referrals from primary to secondary care: a cluster randomised trial
Authors
Henrik Wåhlberg
Per Christian Valle
Siri Malm
Ann Ragnhild Broderstad
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-1017-7

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue