Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2022

Open Access 01-12-2022 | Research

Good validity in the Norwegian Knee Ligament Register: assessment of data quality for key variables in primary and revision cruciate ligament reconstructions from 2004 to 2013

Authors: Espen Midttun, Morten Torheim Andersen, Lars Engebretsen, Håvard Visnes, Anne Marie Fenstad, Jan-Erik Gjertsen, Andreas Persson

Published in: BMC Musculoskeletal Disorders | Issue 1/2022

Login to get access

Abstract

Background

The Norwegian Knee Ligament Register was founded in 2004 to provide representative and reliable data on cruciate ligament surgery. The aim of this study was to evaluate the validity of key variables in the Norwegian Knee Ligament Register to reveal and prevent systematic errors or incompleteness, which can lead to biased reports and study conclusions.

Method

We included a stratified cluster sample of 83 patients that had undergone both primary and revision anterior cruciate ligament surgery. A total of 166 medical records were reviewed and compared with their corresponding data in the database of the Norwegian Knee Ligament Register. We assessed the validity of a selection of key variables using medical records as a reference standard to compute the positive predictive values of the register data for the variables.

Results

The positive predictive values for the variables of primary and revision surgery ranged from 92 to 100% and from 39 to 100% with a mean positive predictive value of 99% and 88% respectively. Data on intraoperative findings and surgical details had high positive predictive values, ranging from 91 to 100% for both primary and revision surgery. The positive predictive value for the variable “date of injury” was 92% for primary surgeries but only 39% for revision surgeries. The positive predictive value for “activity at the time of injury” was 99% for primary surgeries and 52% for revisions.

Conclusion

Overall, the data quality of the key variables examined in the Norwegian Knee Ligament Register was high, making the register a valid source for research.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kaeding CC, Leger-St-Jean B, Magnussen RA. Epidemiology and diagnosis of anterior cruciate ligament injuries. Clin Sports Med. 2017;36(1):1–8.CrossRef Kaeding CC, Leger-St-Jean B, Magnussen RA. Epidemiology and diagnosis of anterior cruciate ligament injuries. Clin Sports Med. 2017;36(1):1–8.CrossRef
2.
go back to reference Sanders TL, MaraditKremers H, Bryan AJ, Larson DR, Dahm DL, Levy BA, et al. Incidence of anterior cruciate ligament tears and reconstruction: a 21-year population-based study. Am J Sports Med. 2016;44(6):1502–7.CrossRef Sanders TL, MaraditKremers H, Bryan AJ, Larson DR, Dahm DL, Levy BA, et al. Incidence of anterior cruciate ligament tears and reconstruction: a 21-year population-based study. Am J Sports Med. 2016;44(6):1502–7.CrossRef
3.
go back to reference Granan L-P, Bahr R, Steindal K, Furnes O, Engebretsen L. Development of a national cruciate ligament surgery registry: the Norwegian National Knee Ligament Registry. Am J Sports Med. 2008;36(2):308–15.CrossRef Granan L-P, Bahr R, Steindal K, Furnes O, Engebretsen L. Development of a national cruciate ligament surgery registry: the Norwegian National Knee Ligament Registry. Am J Sports Med. 2008;36(2):308–15.CrossRef
4.
go back to reference Mohtadi NG, Chan DS. Return to sport-specific performance after primary anterior cruciate ligament reconstruction: a systematic review. Am J Sports Med. 2018;46(13):3307–16.CrossRef Mohtadi NG, Chan DS. Return to sport-specific performance after primary anterior cruciate ligament reconstruction: a systematic review. Am J Sports Med. 2018;46(13):3307–16.CrossRef
5.
go back to reference Ardern CL, Webster KE, Taylor NF, Feller JA. Return to sport following anterior cruciate ligament reconstruction surgery: a systematic review and meta-analysis of the state of play. Br J Sports Med. 2011;45(7):596–606.CrossRef Ardern CL, Webster KE, Taylor NF, Feller JA. Return to sport following anterior cruciate ligament reconstruction surgery: a systematic review and meta-analysis of the state of play. Br J Sports Med. 2011;45(7):596–606.CrossRef
6.
go back to reference Engebretsen L, Forssblad M, Lind M. Why registries analysing cruciate ligament surgery are important. Br J Sports Med. 2015;49(10):636.CrossRef Engebretsen L, Forssblad M, Lind M. Why registries analysing cruciate ligament surgery are important. Br J Sports Med. 2015;49(10):636.CrossRef
7.
go back to reference Arts DG, De Keizer NF, Scheffer GJ. Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc. 2002;9(6):600–11.CrossRef Arts DG, De Keizer NF, Scheffer GJ. Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc. 2002;9(6):600–11.CrossRef
8.
go back to reference Knatterud GL, Rockhold FW, George SL, Barton FB, Davis CE, Fairweather WR, et al. Guidelines for quality assurance in multicenter trials: a position paper. Control Clin Trials. 1998;19(5):477–93.CrossRef Knatterud GL, Rockhold FW, George SL, Barton FB, Davis CE, Fairweather WR, et al. Guidelines for quality assurance in multicenter trials: a position paper. Control Clin Trials. 1998;19(5):477–93.CrossRef
9.
go back to reference Whitney CW, Lind BK, Wahl PW. Quality assurance and quality control in longitudinal studies. Epidemiol Rev. 1998;20(1):71–80.CrossRef Whitney CW, Lind BK, Wahl PW. Quality assurance and quality control in longitudinal studies. Epidemiol Rev. 1998;20(1):71–80.CrossRef
10.
go back to reference Ytterstad K, Granan LP, Ytterstad B, Steindal K, Fjeldsgaard KA, Furnes O, et al. Registration rate in the Norwegian Cruciate Ligament Register: large-volume hospitals perform better. Acta Orthop. 2012;83(2):174–8.CrossRef Ytterstad K, Granan LP, Ytterstad B, Steindal K, Fjeldsgaard KA, Furnes O, et al. Registration rate in the Norwegian Cruciate Ligament Register: large-volume hospitals perform better. Acta Orthop. 2012;83(2):174–8.CrossRef
11.
go back to reference Sundbøll J, Adelborg K, Munch T, Frøslev T, Sørensen HT, Bøtker HE, et al. Positive predictive value of cardiovascular diagnoses in the Danish National Patient Registry: a validation study. BMJ Open. 2016;6(11):e012832.CrossRef Sundbøll J, Adelborg K, Munch T, Frøslev T, Sørensen HT, Bøtker HE, et al. Positive predictive value of cardiovascular diagnoses in the Danish National Patient Registry: a validation study. BMJ Open. 2016;6(11):e012832.CrossRef
12.
go back to reference Ytterstad K, Granan LP, Engebretsen L. The Norwegian Cruciate Ligament Registry has a high degree of completeness. Tidsskr Nor Laegeforen. 2011;131(3):248–50.CrossRef Ytterstad K, Granan LP, Engebretsen L. The Norwegian Cruciate Ligament Registry has a high degree of completeness. Tidsskr Nor Laegeforen. 2011;131(3):248–50.CrossRef
13.
go back to reference Visnes H, Kroken G. Annual report NKLR 2020. Bergen: Norwegian Knee Ligament Register; 2021. Visnes H, Kroken G. Annual report NKLR 2020. Bergen: Norwegian Knee Ligament Register; 2021.
14.
go back to reference Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome Score (KOOS)–development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28(2):88–96.CrossRef Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome Score (KOOS)–development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28(2):88–96.CrossRef
15.
go back to reference Persson A, Kjellsen AB, Fjeldsgaard K, Engebretsen L, Espehaug B, Fevang JM. Registry data highlight increased revision rates for endobutton/biosure HA in ACL reconstruction with hamstring tendon autograft: a nationwide cohort study from the Norwegian Knee Ligament Registry, 2004–2013. Am J Sports Med. 2015;43(9):2182–8.CrossRef Persson A, Kjellsen AB, Fjeldsgaard K, Engebretsen L, Espehaug B, Fevang JM. Registry data highlight increased revision rates for endobutton/biosure HA in ACL reconstruction with hamstring tendon autograft: a nationwide cohort study from the Norwegian Knee Ligament Registry, 2004–2013. Am J Sports Med. 2015;43(9):2182–8.CrossRef
16.
go back to reference Persson A, Fjeldsgaard K, Gjertsen JE, Kjellsen AB, Engebretsen L, Hole RM, et al. Increased risk of revision with hamstring tendon grafts compared with patellar tendon grafts after anterior cruciate ligament reconstruction: a study of 12,643 patients from the Norwegian Cruciate Ligament Registry, 2004–2012. Am J Sports Med. 2014;42(2):285–91.CrossRef Persson A, Fjeldsgaard K, Gjertsen JE, Kjellsen AB, Engebretsen L, Hole RM, et al. Increased risk of revision with hamstring tendon grafts compared with patellar tendon grafts after anterior cruciate ligament reconstruction: a study of 12,643 patients from the Norwegian Cruciate Ligament Registry, 2004–2012. Am J Sports Med. 2014;42(2):285–91.CrossRef
17.
go back to reference Røtterud JH, Sivertsen EA, Forssblad M, Engebretsen L, Årøen A. Effect on patient-reported outcomes of debridement or microfracture of concomitant full-thickness cartilage lesions in anterior cruciate ligament-reconstructed knees: a nationwide cohort study from Norway and Sweden of 357 patients with 2-year follow-up. Am J Sports Med. 2016;44(2):337–44.CrossRef Røtterud JH, Sivertsen EA, Forssblad M, Engebretsen L, Årøen A. Effect on patient-reported outcomes of debridement or microfracture of concomitant full-thickness cartilage lesions in anterior cruciate ligament-reconstructed knees: a nationwide cohort study from Norway and Sweden of 357 patients with 2-year follow-up. Am J Sports Med. 2016;44(2):337–44.CrossRef
18.
go back to reference Agresti A, Coull BA. Approximate is better than “exact” for interval estimation of binomial proportions. Am Stat. 1998;52(2):119–26. Agresti A, Coull BA. Approximate is better than “exact” for interval estimation of binomial proportions. Am Stat. 1998;52(2):119–26.
19.
go back to reference Gifstad T, Foss OA, Engebretsen L, Lind M, Forssblad M, Albrektsen G, et al. Lower risk of revision with patellar tendon autografts compared with hamstring autografts: a registry study based on 45,998 primary ACL reconstructions in Scandinavia. Am J Sports Med. 2014;42(10):2319–28.CrossRef Gifstad T, Foss OA, Engebretsen L, Lind M, Forssblad M, Albrektsen G, et al. Lower risk of revision with patellar tendon autografts compared with hamstring autografts: a registry study based on 45,998 primary ACL reconstructions in Scandinavia. Am J Sports Med. 2014;42(10):2319–28.CrossRef
20.
go back to reference Rahr-Wagner L, Thillemann TM, Lind MC, Pedersen AB. Validation of 14,500 operated knees registered in the Danish Knee Ligament Reconstruction Register: registration completeness and validity of key variables. Clin Epidemiol. 2013;5:219–28.CrossRef Rahr-Wagner L, Thillemann TM, Lind MC, Pedersen AB. Validation of 14,500 operated knees registered in the Danish Knee Ligament Reconstruction Register: registration completeness and validity of key variables. Clin Epidemiol. 2013;5:219–28.CrossRef
21.
go back to reference Granan LP, Inacio MC, Maletis GB, Funahashi TT, Engebretsen L. Intraoperative findings and procedures in culturally and geographically different patient and surgeon populations: an anterior cruciate ligament reconstruction registry comparison between Norway and the USA. Acta Orthop. 2012;83(6):577–82.CrossRef Granan LP, Inacio MC, Maletis GB, Funahashi TT, Engebretsen L. Intraoperative findings and procedures in culturally and geographically different patient and surgeon populations: an anterior cruciate ligament reconstruction registry comparison between Norway and the USA. Acta Orthop. 2012;83(6):577–82.CrossRef
22.
go back to reference Ulstein S, Bredland K, Aroen A, Engebretsen L, Rotterud JH. No negative effect on patient-reported outcome of concomitant cartilage lesions 5–9 years after ACL reconstruction. Knee Surg Sports Traumatol Arthrosc. 2017;25(5):1482–8.CrossRef Ulstein S, Bredland K, Aroen A, Engebretsen L, Rotterud JH. No negative effect on patient-reported outcome of concomitant cartilage lesions 5–9 years after ACL reconstruction. Knee Surg Sports Traumatol Arthrosc. 2017;25(5):1482–8.CrossRef
23.
go back to reference Rotterud JH, Sivertsen EA, Forssblad M, Engebretsen L, Aroen A. Effect of meniscal and focal cartilage lesions on patient-reported outcome after anterior cruciate ligament reconstruction: a nationwide cohort study from Norway and Sweden of 8476 patients with 2-year follow-up. Am J Sports Med. 2013;41(3):535–43.CrossRef Rotterud JH, Sivertsen EA, Forssblad M, Engebretsen L, Aroen A. Effect of meniscal and focal cartilage lesions on patient-reported outcome after anterior cruciate ligament reconstruction: a nationwide cohort study from Norway and Sweden of 8476 patients with 2-year follow-up. Am J Sports Med. 2013;41(3):535–43.CrossRef
24.
go back to reference Granan LP, Bahr R, Lie SA, Engebretsen L. Timing of anterior cruciate ligament reconstructive surgery and risk of cartilage lesions and meniscal tears: a cohort study based on the Norwegian National Knee Ligament Registry. Am J Sports Med. 2009;37(5):955–61.CrossRef Granan LP, Bahr R, Lie SA, Engebretsen L. Timing of anterior cruciate ligament reconstructive surgery and risk of cartilage lesions and meniscal tears: a cohort study based on the Norwegian National Knee Ligament Registry. Am J Sports Med. 2009;37(5):955–61.CrossRef
25.
go back to reference Salmon LJ, Pinczewski LA, Russell VJ, Refshauge K. Revision anterior cruciate ligament reconstruction with hamstring tendon autograft: 5- to 9-year follow-up. Am J Sports Med. 2006;34(10):1604–14.CrossRef Salmon LJ, Pinczewski LA, Russell VJ, Refshauge K. Revision anterior cruciate ligament reconstruction with hamstring tendon autograft: 5- to 9-year follow-up. Am J Sports Med. 2006;34(10):1604–14.CrossRef
26.
go back to reference Wright RW, Huston LJ, Haas AK, Pennings JS, Allen CR, Cooper DE, et al. Association between graft choice and 6-year outcomes of revision anterior cruciate ligament reconstruction in the MARS cohort. Am J Sports Med. 2021;49(10):2589–98.CrossRef Wright RW, Huston LJ, Haas AK, Pennings JS, Allen CR, Cooper DE, et al. Association between graft choice and 6-year outcomes of revision anterior cruciate ligament reconstruction in the MARS cohort. Am J Sports Med. 2021;49(10):2589–98.CrossRef
27.
go back to reference Reverte-Vinaixa MM, Minguell J, Joshi N, Diaz-Ferreiro EW, Duarri G, Carrera L, et al. Revision anterior cruciate ligament reconstruction using tibial or hamstring tendon allografts. J Orthop Surg (Hong Kong). 2014;22(1):60–4.CrossRef Reverte-Vinaixa MM, Minguell J, Joshi N, Diaz-Ferreiro EW, Duarri G, Carrera L, et al. Revision anterior cruciate ligament reconstruction using tibial or hamstring tendon allografts. J Orthop Surg (Hong Kong). 2014;22(1):60–4.CrossRef
28.
go back to reference Di Benedetto P, Di Benedetto E, Fiocchi A, Beltrame A, Causero A. Causes of failure of anterior cruciate ligament reconstruction and revision surgical strategies. Knee Surg Relat Res. 2016;28(4):319–24.CrossRef Di Benedetto P, Di Benedetto E, Fiocchi A, Beltrame A, Causero A. Causes of failure of anterior cruciate ligament reconstruction and revision surgical strategies. Knee Surg Relat Res. 2016;28(4):319–24.CrossRef
29.
go back to reference Wilde J, Bedi A, Altchek DW. Revision anterior cruciate ligament reconstruction. Sports Health. 2014;6(6):504–18.CrossRef Wilde J, Bedi A, Altchek DW. Revision anterior cruciate ligament reconstruction. Sports Health. 2014;6(6):504–18.CrossRef
30.
go back to reference Getelman MH, Friedman MJ. Revision anterior cruciate ligament reconstruction surgery. J Am Acad Orthop Surg. 1999;7(3):189–98.CrossRef Getelman MH, Friedman MJ. Revision anterior cruciate ligament reconstruction surgery. J Am Acad Orthop Surg. 1999;7(3):189–98.CrossRef
31.
go back to reference Redler A, Iorio R, Monaco E, Puglia F, Wolf MR, Mazza D, et al. Revision anterior cruciate ligament reconstruction with hamstrings and extra-articular tenodesis: a mid- to long-term clinical and radiological study. Arthroscopy. 2018;34(12):3204–13.CrossRef Redler A, Iorio R, Monaco E, Puglia F, Wolf MR, Mazza D, et al. Revision anterior cruciate ligament reconstruction with hamstrings and extra-articular tenodesis: a mid- to long-term clinical and radiological study. Arthroscopy. 2018;34(12):3204–13.CrossRef
32.
go back to reference Carson EW, Anisko EM, Restrepo C, Panariello RA, O’Brien SJ, Warren RF. Revision anterior cruciate ligament reconstruction: etiology of failures and clinical results. J Knee Surg. 2004;17(3):127–32.CrossRef Carson EW, Anisko EM, Restrepo C, Panariello RA, O’Brien SJ, Warren RF. Revision anterior cruciate ligament reconstruction: etiology of failures and clinical results. J Knee Surg. 2004;17(3):127–32.CrossRef
33.
go back to reference Brown CH Jr, Carson EW. Revision anterior cruciate ligament surgery. Clin Sports Med. 1999;18(1):109–71.CrossRef Brown CH Jr, Carson EW. Revision anterior cruciate ligament surgery. Clin Sports Med. 1999;18(1):109–71.CrossRef
34.
go back to reference MARS Group. Predictors of clinical outcome following revision anterior cruciate ligament reconstruction. J Orthop Res. 2020;38(6):1191–203.CrossRef MARS Group. Predictors of clinical outcome following revision anterior cruciate ligament reconstruction. J Orthop Res. 2020;38(6):1191–203.CrossRef
35.
go back to reference Kraeutler MJ, Welton KL, McCarty EC, Bravman JT. Revision anterior cruciate ligament reconstruction. J Bone Joint Surg Am. 2017;99(19):1689–96.CrossRef Kraeutler MJ, Welton KL, McCarty EC, Bravman JT. Revision anterior cruciate ligament reconstruction. J Bone Joint Surg Am. 2017;99(19):1689–96.CrossRef
Metadata
Title
Good validity in the Norwegian Knee Ligament Register: assessment of data quality for key variables in primary and revision cruciate ligament reconstructions from 2004 to 2013
Authors
Espen Midttun
Morten Torheim Andersen
Lars Engebretsen
Håvard Visnes
Anne Marie Fenstad
Jan-Erik Gjertsen
Andreas Persson
Publication date
01-12-2022
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2022
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/s12891-022-05183-2

Other articles of this Issue 1/2022

BMC Musculoskeletal Disorders 1/2022 Go to the issue