Skip to main content
Top
Published in: BMC Public Health 1/2013

Open Access 01-12-2013 | Research article

Completeness and accuracy of crash outcome data in a cohort of cyclists: a validation study

Authors: Sandar Tin Tin, Alistair Woodward, Shanthi Ameratunga

Published in: BMC Public Health | Issue 1/2013

Login to get access

Abstract

Background

Bicycling, despite its health and other benefits, raises safety concerns for many people. However, reliable information on bicycle crash injury is scarce as current statistics rely on a single official database of limited quality. This paper evaluated the completeness and accuracy of crash data collected from multiple sources in a prospective cohort study involving cyclists.

Methods

The study recruited 2438 adult cyclists from New Zealand’s largest mass cycling event in November 2006 and another 190 in 2008, and obtained data regarding bicycle crashes that were attended by medical personnel or the police and occurred between the date of recruitment and 30 June 2011, through linkage to insurance claims, hospital discharges, mortality records and police reports. The quality of the linked data was assessed by capture-recapture methods and by comparison with self-reported injury data collected in a follow-up survey.

Results

Of the 2590 cyclists who were resident in New Zealand at recruitment, 855 experienced 1336 crashes, of which 755 occurred on public roads and 120 involved a collision with a motor vehicle, during a median follow-up of 4.6 years. Log-linear models estimated that the linked data were 73.7% (95% CI: 68.0%-78.7%) complete with negligible differences between on- and off-road crashes. The data were 83.3% (95% CI: 78.9%-87.6%) complete for collisions. Agreement with the self-reported data was moderate (kappa: 0.55) and varied by personal factors, cycling exposure and confidence in recalling crash events. If self-reports were considered as the gold standard, the linked data had 63.1% sensitivity and 93.5% specificity for all crashes and 40.0% sensitivity and 99.9% specificity for collisions.

Conclusions

Routinely collected databases substantially underestimate the frequency of bicycle crashes. Self-reported crash data are also incomplete and inconsistent. It is necessary to improve the quality of individual data sources as well as record linkage techniques so that all available data sources can be used reliably.
Literature
1.
go back to reference Andersen LB, Schnohr P, Schroll M, Hein HO: All-cause mortality associated with physical activity during leisure time, work, sports, and cycling to work. Arch Intern Med. 2000, 160 (11): 1621-1628. 10.1001/archinte.160.11.1621.CrossRefPubMed Andersen LB, Schnohr P, Schroll M, Hein HO: All-cause mortality associated with physical activity during leisure time, work, sports, and cycling to work. Arch Intern Med. 2000, 160 (11): 1621-1628. 10.1001/archinte.160.11.1621.CrossRefPubMed
2.
go back to reference Higgins PAT: Exercise-based transportation reduces oil dependence, carbon emissions and obesity. Environ Conserv. 2005, 32 (03): 197-202. 10.1017/S037689290500247X.CrossRef Higgins PAT: Exercise-based transportation reduces oil dependence, carbon emissions and obesity. Environ Conserv. 2005, 32 (03): 197-202. 10.1017/S037689290500247X.CrossRef
3.
go back to reference Bassett DR, Pucher J, Buehler R: Walking, cycling, and obesity rates in Europe, North America, and Australia. J Phys Act Health. 2008, 5: 795-814.PubMed Bassett DR, Pucher J, Buehler R: Walking, cycling, and obesity rates in Europe, North America, and Australia. J Phys Act Health. 2008, 5: 795-814.PubMed
4.
go back to reference Oja P, Titze S, Bauman A, de Geus B, Krenn P, Reger-Nash B, Kohlberger T: Health benefits of cycling: a systematic review. Scand J Med Sci Sports. 2011, 21 (4): 496-509. 10.1111/j.1600-0838.2011.01299.x.CrossRefPubMed Oja P, Titze S, Bauman A, de Geus B, Krenn P, Reger-Nash B, Kohlberger T: Health benefits of cycling: a systematic review. Scand J Med Sci Sports. 2011, 21 (4): 496-509. 10.1111/j.1600-0838.2011.01299.x.CrossRefPubMed
5.
go back to reference Tin Tin S, Woodward A, Thornley S, Ameratunga S: Cycling and walking to work in New Zealand, 1991–2006: regional and individual differences, and pointers to effective interventions. Int J Behav Nutr Phys Act. 2009, 6 (1): 64-10.1186/1479-5868-1186-1164.CrossRefPubMedPubMedCentral Tin Tin S, Woodward A, Thornley S, Ameratunga S: Cycling and walking to work in New Zealand, 1991–2006: regional and individual differences, and pointers to effective interventions. Int J Behav Nutr Phys Act. 2009, 6 (1): 64-10.1186/1479-5868-1186-1164.CrossRefPubMedPubMedCentral
6.
go back to reference Ministry of Transport: Comparing travel modes. 2012, Wellington: Ministry of Transport Ministry of Transport: Comparing travel modes. 2012, Wellington: Ministry of Transport
7.
go back to reference Sport New Zealand: Sport and Recreation Profile: Cycling - Findings from the 2007/08 Active New Zealand Survey. 2009, Wellington: Sport New Zealand Sport New Zealand: Sport and Recreation Profile: Cycling - Findings from the 2007/08 Active New Zealand Survey. 2009, Wellington: Sport New Zealand
8.
go back to reference Kingham S, Koorey G, Taylor K: Attracting the next 10% of cyclists with the right infrastructure. New Zealand Cycling Conference: 12–13 November 2009; New Plymouth. 2009 Kingham S, Koorey G, Taylor K: Attracting the next 10% of cyclists with the right infrastructure. New Zealand Cycling Conference: 12–13 November 2009; New Plymouth. 2009
9.
go back to reference Mackie H: 'I want to ride my bike': overcoming barriers to cycling to intermediate schools. New Zealand Transport Agency Research Report No. 380. 2009, New Zealand Transport Agency: Wellington Mackie H: 'I want to ride my bike': overcoming barriers to cycling to intermediate schools. New Zealand Transport Agency Research Report No. 380. 2009, New Zealand Transport Agency: Wellington
10.
go back to reference Ministry of Transport: Risk on the road. Pedestrians, cyclists and motorcyclists. 2012, Wellington: Ministry of Transport Ministry of Transport: Risk on the road. Pedestrians, cyclists and motorcyclists. 2012, Wellington: Ministry of Transport
11.
go back to reference Tin Tin S, Woodward A, Ameratunga SN: Injuries to pedal cyclists on New Zealand roads, 1988–2007. BMC Public Health. 2010, 10: 655-610.1186/1471-2458-1110-1655.CrossRefPubMedPubMedCentral Tin Tin S, Woodward A, Ameratunga SN: Injuries to pedal cyclists on New Zealand roads, 1988–2007. BMC Public Health. 2010, 10: 655-610.1186/1471-2458-1110-1655.CrossRefPubMedPubMedCentral
12.
go back to reference Munster D, Koorey G, Walton D: Role of road features in cycle-only crashes in New Zealand. Transfund New Zealand Research Report No. 211. 2001, Transfund New Zealand: Wellington Munster D, Koorey G, Walton D: Role of road features in cycle-only crashes in New Zealand. Transfund New Zealand Research Report No. 211. 2001, Transfund New Zealand: Wellington
13.
go back to reference Elvik R, Mysen AB: Incomplete accident reporting: Meta-analysis of studies made in 13 countries. Transp Res Rec. 1999, 1665: 133-140. 10.3141/1665-18.CrossRef Elvik R, Mysen AB: Incomplete accident reporting: Meta-analysis of studies made in 13 countries. Transp Res Rec. 1999, 1665: 133-140. 10.3141/1665-18.CrossRef
15.
go back to reference Tercero F, Andersson R: Measuring transport injuries in a developing country: an application of the capture–recapture method. Accid Anal Prev. 2004, 36 (1): 13-20. 10.1016/S0001-4575(02)00109-4.CrossRefPubMed Tercero F, Andersson R: Measuring transport injuries in a developing country: an application of the capture–recapture method. Accid Anal Prev. 2004, 36 (1): 13-20. 10.1016/S0001-4575(02)00109-4.CrossRefPubMed
16.
go back to reference de Geus B, Vandenbulcke G, Int Panis L, Thomas I, Degraeuwe B, Cumps E, Aertsens J, Torfs R, Meeusen R: A prospective cohort study on minor accidents involving commuter cyclists in Belgium. Accid Anal Prev. 2012, 45: 683-693.CrossRefPubMed de Geus B, Vandenbulcke G, Int Panis L, Thomas I, Degraeuwe B, Cumps E, Aertsens J, Torfs R, Meeusen R: A prospective cohort study on minor accidents involving commuter cyclists in Belgium. Accid Anal Prev. 2012, 45: 683-693.CrossRefPubMed
17.
go back to reference Hoffman MR, Lambert WE, Peck EG, Mayberry JC: Bicycle commuter injury prevention: It is time to focus on the environment. J Trauma. 2010, 69 (5): 1112-1119. 10.1097/TA.0b013e3181f990a1.CrossRefPubMed Hoffman MR, Lambert WE, Peck EG, Mayberry JC: Bicycle commuter injury prevention: It is time to focus on the environment. J Trauma. 2010, 69 (5): 1112-1119. 10.1097/TA.0b013e3181f990a1.CrossRefPubMed
18.
go back to reference Tivesten E, Jonsson S, Jakobsson L, Norin H: Nonresponse analysis and adjustment in a mail survey on car accidents. Accid Anal Prev. 2012, 48: 401-415.CrossRefPubMed Tivesten E, Jonsson S, Jakobsson L, Norin H: Nonresponse analysis and adjustment in a mail survey on car accidents. Accid Anal Prev. 2012, 48: 401-415.CrossRefPubMed
19.
go back to reference Jenkins P, Earle-Richardson G, Slingerland DT, May J: Time dependent memory decay. Am J Ind Med. 2002, 41 (2): 98-101. 10.1002/ajim.10035.CrossRefPubMed Jenkins P, Earle-Richardson G, Slingerland DT, May J: Time dependent memory decay. Am J Ind Med. 2002, 41 (2): 98-101. 10.1002/ajim.10035.CrossRefPubMed
20.
go back to reference af Wåhlberg AE, Dorn L, Kline T: The effect of social desirability on self reported and recorded road traffic accidents. Transp Res Part F Traffic Psychol Behav. 2010, 13 (2): 106-114. 10.1016/j.trf.2009.11.004.CrossRef af Wåhlberg AE, Dorn L, Kline T: The effect of social desirability on self reported and recorded road traffic accidents. Transp Res Part F Traffic Psychol Behav. 2010, 13 (2): 106-114. 10.1016/j.trf.2009.11.004.CrossRef
21.
go back to reference Cryer C, Langley J: Developing indicators of injury incidence that can be used to monitor global, regional and local trends. 2008, Dunedin: Injury Prevention Research Unit, University of Otago Cryer C, Langley J: Developing indicators of injury incidence that can be used to monitor global, regional and local trends. 2008, Dunedin: Injury Prevention Research Unit, University of Otago
22.
go back to reference Davie G, Langley J, Samaranayaka A, Wetherspoon ME: Accuracy of injury coding under ICD-10-AM for New Zealand public hospital discharges. Inj Prev. 2008, 14 (5): 319-323. 10.1136/ip.2007.017954.CrossRefPubMed Davie G, Langley J, Samaranayaka A, Wetherspoon ME: Accuracy of injury coding under ICD-10-AM for New Zealand public hospital discharges. Inj Prev. 2008, 14 (5): 319-323. 10.1136/ip.2007.017954.CrossRefPubMed
23.
go back to reference Thornley SJ, Woodward A, Langley JD, Ameratunga SN, Rodgers A: Conspicuity and bicycle crashes: preliminary findings of the Taupo Bicycle Study. Inj Prev. 2008, 14 (1): 11-18. 10.1136/ip.2007.016675.CrossRefPubMed Thornley SJ, Woodward A, Langley JD, Ameratunga SN, Rodgers A: Conspicuity and bicycle crashes: preliminary findings of the Taupo Bicycle Study. Inj Prev. 2008, 14 (1): 11-18. 10.1136/ip.2007.016675.CrossRefPubMed
24.
go back to reference Accident Compensation Corporation: Annual Report 2012. 2012, Wellington: ACC Accident Compensation Corporation: Annual Report 2012. 2012, Wellington: ACC
25.
go back to reference Health Outcomes International Pty Ltd: Methods and systems used to measure and monitor occupational disease and injury in New Zealand: NOHSAC Technical Report 2. 2005, Wellington: National Occupational Health and Safety Advisory Committee (NOHSAC) Health Outcomes International Pty Ltd: Methods and systems used to measure and monitor occupational disease and injury in New Zealand: NOHSAC Technical Report 2. 2005, Wellington: National Occupational Health and Safety Advisory Committee (NOHSAC)
26.
go back to reference Ministry of Health: National Minimum Dataset (Hospital Inpatient events): Data Mart—Data Dictionary V7.5. 2012, Wellington: Ministry of Health Ministry of Health: National Minimum Dataset (Hospital Inpatient events): Data Mart—Data Dictionary V7.5. 2012, Wellington: Ministry of Health
27.
go back to reference Ministry of Health: Mortality Collection Data Dictionary Version 1.3. 2009, Wellington: Ministry of Health Ministry of Health: Mortality Collection Data Dictionary Version 1.3. 2009, Wellington: Ministry of Health
28.
go back to reference Davie G, Samaranayaka A, Langley JD, Barson D: Estimating person-based injury incidence: accuracy of an algorithm to identify readmissions from hospital discharge data. Inj Prev. 2011, 17 (5): 338-342. 10.1136/injuryprev-2011-040090.CrossRefPubMed Davie G, Samaranayaka A, Langley JD, Barson D: Estimating person-based injury incidence: accuracy of an algorithm to identify readmissions from hospital discharge data. Inj Prev. 2011, 17 (5): 338-342. 10.1136/injuryprev-2011-040090.CrossRefPubMed
29.
go back to reference Cust A, Armstrong B, Smith B, Chau J, van der Ploeg H, Bauman A: Self-reported confidence in recall as a predictor of validity and repeatability of physical activity questionnaire data. Epidemiology. 2009, 20 (3): 433-441. 10.1097/EDE.0b013e3181931539.CrossRefPubMed Cust A, Armstrong B, Smith B, Chau J, van der Ploeg H, Bauman A: Self-reported confidence in recall as a predictor of validity and repeatability of physical activity questionnaire data. Epidemiology. 2009, 20 (3): 433-441. 10.1097/EDE.0b013e3181931539.CrossRefPubMed
30.
go back to reference Cook LM, Brower LP, Croze HJ: The accuracy of a population estimation from multiple recapture data. J Anim Ecol. 1967, 36 (1): 57-60. 10.2307/3014.CrossRef Cook LM, Brower LP, Croze HJ: The accuracy of a population estimation from multiple recapture data. J Anim Ecol. 1967, 36 (1): 57-60. 10.2307/3014.CrossRef
31.
go back to reference Hook EB, Regal RR: Capture-recapture methods in Epidemiology: Methods and limitations. Epidemiol Rev. 1995, 17 (2): 243-264.PubMed Hook EB, Regal RR: Capture-recapture methods in Epidemiology: Methods and limitations. Epidemiol Rev. 1995, 17 (2): 243-264.PubMed
32.
go back to reference Greenland S: Response and follow-up bias in cohort studies. Am J Epidemiol. 1977, 106 (3): 184-187.PubMed Greenland S: Response and follow-up bias in cohort studies. Am J Epidemiol. 1977, 106 (3): 184-187.PubMed
33.
go back to reference Hook EB, Regal RR: Internal validity analysis: A method for adjusting capture-recapture estimates of prevalence. Am J Epidemiol. 1995, 142 (Supplement 9): S48-S52. 10.1093/aje/142.Supplement_9.S48.CrossRefPubMed Hook EB, Regal RR: Internal validity analysis: A method for adjusting capture-recapture estimates of prevalence. Am J Epidemiol. 1995, 142 (Supplement 9): S48-S52. 10.1093/aje/142.Supplement_9.S48.CrossRefPubMed
34.
go back to reference Hauer E, Hakkert A: Extent and some implications of incomplete accident reporting. Transp Res Rec. 1988, 1185: 1-10. Hauer E, Hakkert A: Extent and some implications of incomplete accident reporting. Transp Res Rec. 1988, 1185: 1-10.
35.
go back to reference McDonald G, Davie G, Langley J: Validity of police-reported information on injury severity for those hospitalized from motor vehicle traffic crashes. Traffic Inj Prev. 2009, 10 (2): 184-190. 10.1080/15389580802593699.CrossRefPubMed McDonald G, Davie G, Langley J: Validity of police-reported information on injury severity for those hospitalized from motor vehicle traffic crashes. Traffic Inj Prev. 2009, 10 (2): 184-190. 10.1080/15389580802593699.CrossRefPubMed
36.
go back to reference Brenner H: Effects of misdiagnoses on disease monitoring with capture-recapture methods. J Clin Epidemiol. 1996, 49 (11): 1303-1307. 10.1016/0895-4356(95)00026-7.CrossRefPubMed Brenner H: Effects of misdiagnoses on disease monitoring with capture-recapture methods. J Clin Epidemiol. 1996, 49 (11): 1303-1307. 10.1016/0895-4356(95)00026-7.CrossRefPubMed
37.
go back to reference Ward H, Lyons RA, Thoreau R: Under-reporting of road casualties - Phase 1. Road Safety Research Report No. 69. June 2006, London: Department for Transport Ward H, Lyons RA, Thoreau R: Under-reporting of road casualties - Phase 1. Road Safety Research Report No. 69. June 2006, London: Department for Transport
38.
go back to reference Howe GR: Use of computerized record linkage in cohort studies. Epidemiol Rev. 1998, 20 (1): 112-121. 10.1093/oxfordjournals.epirev.a017966.CrossRefPubMed Howe GR: Use of computerized record linkage in cohort studies. Epidemiol Rev. 1998, 20 (1): 112-121. 10.1093/oxfordjournals.epirev.a017966.CrossRefPubMed
39.
go back to reference Blakely T, Salmond C: Probabilistic record linkage and a method to calculate the positive predictive value. Int J Epidemiol. 2002, 31 (6): 1246-1252. 10.1093/ije/31.6.1246.CrossRefPubMed Blakely T, Salmond C: Probabilistic record linkage and a method to calculate the positive predictive value. Int J Epidemiol. 2002, 31 (6): 1246-1252. 10.1093/ije/31.6.1246.CrossRefPubMed
40.
go back to reference Langley J, Cecchi J, Williams S: Recall of injury events by thirteen year olds. Methods Inf Med. 1989, 28 (1): 24-27.PubMed Langley J, Cecchi J, Williams S: Recall of injury events by thirteen year olds. Methods Inf Med. 1989, 28 (1): 24-27.PubMed
41.
go back to reference Warner M, Schenker N, Heinen MA, Fingerhut LA: The effects of recall on reporting injury and poisoning episodes in the National Health Interview Survey. Inj Prev. 2005, 11 (5): 282-287. 10.1136/ip.2004.006965.CrossRefPubMedPubMedCentral Warner M, Schenker N, Heinen MA, Fingerhut LA: The effects of recall on reporting injury and poisoning episodes in the National Health Interview Survey. Inj Prev. 2005, 11 (5): 282-287. 10.1136/ip.2004.006965.CrossRefPubMedPubMedCentral
42.
go back to reference af Wåhlberg AE: On the validity of self-reported traffic accident data. Safety on Road International Conference SORIC'02: 2002; Manama, Bahrain. 2002 af Wåhlberg AE: On the validity of self-reported traffic accident data. Safety on Road International Conference SORIC'02: 2002; Manama, Bahrain. 2002
43.
go back to reference Lajunen T, Corry A, Summala H, Hartley L: Impression management and Self-Deception in traffic behaviour inventories. Pers Individ Dif. 1997, 22 (3): 341-353. 10.1016/S0191-8869(96)00221-8.CrossRef Lajunen T, Corry A, Summala H, Hartley L: Impression management and Self-Deception in traffic behaviour inventories. Pers Individ Dif. 1997, 22 (3): 341-353. 10.1016/S0191-8869(96)00221-8.CrossRef
44.
go back to reference Dhillon PK, Lightstone AS, Peek-Asa C, Kraus JF: Assessment of hospital and police ascertainment of automobile versus childhood pedestrian and bicyclist collisions. Accid Anal Prev. 2001, 33 (4): 529-537. 10.1016/S0001-4575(00)00066-X.CrossRefPubMed Dhillon PK, Lightstone AS, Peek-Asa C, Kraus JF: Assessment of hospital and police ascertainment of automobile versus childhood pedestrian and bicyclist collisions. Accid Anal Prev. 2001, 33 (4): 529-537. 10.1016/S0001-4575(00)00066-X.CrossRefPubMed
45.
go back to reference Cryer PC, Westrup S, Cook AC, Ashwell V, Bridger P, Clarke C: Investigation of bias after data linkage of hospital admissions data to police road traffic crash reports. Inj Prev. 2001, 7 (3): 234-241. 10.1136/ip.7.3.234.CrossRefPubMedPubMedCentral Cryer PC, Westrup S, Cook AC, Ashwell V, Bridger P, Clarke C: Investigation of bias after data linkage of hospital admissions data to police road traffic crash reports. Inj Prev. 2001, 7 (3): 234-241. 10.1136/ip.7.3.234.CrossRefPubMedPubMedCentral
46.
go back to reference Juhra C, Wieskötter B, Chu K, Trost L, Weiss U, Messerschmidt M, Malczyk A, Heckwolf M, Raschke M: Bicycle accidents – Do we only see the tip of the iceberg?: A prospective multi-centre study in a large German city combining medical and police data. Injury. 2012, 43 (12): 2026-2034. 10.1016/j.injury.2011.10.016.CrossRefPubMed Juhra C, Wieskötter B, Chu K, Trost L, Weiss U, Messerschmidt M, Malczyk A, Heckwolf M, Raschke M: Bicycle accidents – Do we only see the tip of the iceberg?: A prospective multi-centre study in a large German city combining medical and police data. Injury. 2012, 43 (12): 2026-2034. 10.1016/j.injury.2011.10.016.CrossRefPubMed
47.
go back to reference Begg DJ, Langley JD, Williams SM: Validity of self reported crashes and injuries in a longitudinal study of young adults. Inj Prev. 1999, 5 (2): 142-144. 10.1136/ip.5.2.142.CrossRefPubMedPubMedCentral Begg DJ, Langley JD, Williams SM: Validity of self reported crashes and injuries in a longitudinal study of young adults. Inj Prev. 1999, 5 (2): 142-144. 10.1136/ip.5.2.142.CrossRefPubMedPubMedCentral
48.
go back to reference McGwin G, Owsley C, Ball K: Identifying crash involvement among older drivers: agreement between self-report and state records. Accid Anal Prev. 1998, 30 (6): 781-791. 10.1016/S0001-4575(98)00031-1.CrossRefPubMed McGwin G, Owsley C, Ball K: Identifying crash involvement among older drivers: agreement between self-report and state records. Accid Anal Prev. 1998, 30 (6): 781-791. 10.1016/S0001-4575(98)00031-1.CrossRefPubMed
Metadata
Title
Completeness and accuracy of crash outcome data in a cohort of cyclists: a validation study
Authors
Sandar Tin Tin
Alistair Woodward
Shanthi Ameratunga
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2013
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-13-420

Other articles of this Issue 1/2013

BMC Public Health 1/2013 Go to the issue