Skip to main content
Top
Published in: European Radiology 5/2020

01-05-2020 | Ultrasound | Musculoskeletal

Ruling out rotator cuff tear in shoulder radiograph series using deep learning: redefining the role of conventional radiograph

Authors: Youngjune Kim, Dongjun Choi, Kyong Joon Lee, Yusuhn Kang, Joong Mo Ahn, Eugene Lee, Joon Woo Lee, Heung Sik Kang

Published in: European Radiology | Issue 5/2020

Login to get access

Abstract

Objective

To develop a deep learning algorithm that can rule out significant rotator cuff tear based on conventional shoulder radiographs in patients suspected of rotator cuff tear.

Methods

The algorithm was developed using 6793 shoulder radiograph series performed between January 2015 and June 2018, which were labeled based on ultrasound or MRI conducted within 90 days, and clinical information (age, sex, dominant side, history of trauma, degree of pain). The output was the probability of significant rotator cuff tear (supraspinatus/infraspinatus complex tear with > 50% of tendon thickness). An operating point corresponding to sensitivity of 98% was set to achieve high negative predictive value (NPV) and low negative likelihood ratio (LR−). The performance of the algorithm was tested with 1095 radiograph series performed between July and December 2018. Subgroup analysis using Fisher’s exact test was performed to identify factors (clinical information, radiography vendor, advanced imaging modality) associated with negative test results and NPV.

Results

Sensitivity, NPV, and LR− were 97.3%, 96.6%, and 0.06, respectively. The deep learning algorithm could rule out significant rotator cuff tear in about 30% of patients suspected of rotator cuff tear. The subgroup analysis showed that age < 60 years (p < 0.001), non-dominant side (p < 0.001), absence of trauma history (p = 0.001), and ultrasound examination (p < 0.001) were associated with negative test results. NPVs were higher in patients with age < 60 years (p = 0.024) and examined with ultrasound (p < 0.001).

Conclusion

The deep learning algorithm could accurately rule out significant rotator cuff tear based on shoulder radiographs.

Key Points

The deep learning algorithm can rule out significant rotator cuff tear with a negative likelihood ratio of 0.06 and a negative predictive value of 96.6%.
The deep learning algorithm can guide patients with significant rotator cuff tear to additional shoulder ultrasound or MRI with a sensitivity of 97.3%.
The deep learning algorithm could rule out significant rotator cuff tear in about 30% of patients with clinically suspected rotator cuff tear.
Appendix
Available only for authorised users
Literature
1.
go back to reference de Jesus JO, Parker L, Frangos AJ, Nazarian LN (2009) Accuracy of MRI, MR arthrography, and ultrasound in the diagnosis of rotator cuff tears: a meta-analysis. AJR Am J Roentgenol 192:1701–1707CrossRef de Jesus JO, Parker L, Frangos AJ, Nazarian LN (2009) Accuracy of MRI, MR arthrography, and ultrasound in the diagnosis of rotator cuff tears: a meta-analysis. AJR Am J Roentgenol 192:1701–1707CrossRef
2.
go back to reference Roy JS, Braen C, Leblond J et al (2015) Diagnostic accuracy of ultrasonography, MRI and MR arthrography in the characterisation of rotator cuff disorders: a systematic review and meta-analysis. Br J Sports Med 49:1316–1328CrossRef Roy JS, Braen C, Leblond J et al (2015) Diagnostic accuracy of ultrasonography, MRI and MR arthrography in the characterisation of rotator cuff disorders: a systematic review and meta-analysis. Br J Sports Med 49:1316–1328CrossRef
3.
go back to reference Amini B, Beckmann NM, Beaman FD et al (2018) ACR Appropriateness Criteria® shoulder pain-traumatic. J Am Coll Radiol 15:S171–S188 Amini B, Beckmann NM, Beaman FD et al (2018) ACR Appropriateness Criteria® shoulder pain-traumatic. J Am Coll Radiol 15:S171–S188
4.
go back to reference Small KM, Adler RS, Shah SH et al (2018) ACR Appropriateness Criteria® shoulder pain—atraumatic. J Am Coll Radiol 15:S388–S402 Small KM, Adler RS, Shah SH et al (2018) ACR Appropriateness Criteria® shoulder pain—atraumatic. J Am Coll Radiol 15:S388–S402
5.
go back to reference Pearsall AW 4th, Bonsell S, Heitman RJ, Helms CA, Osbahr D, Speer KP (2003) Radiographic findings associated with symptomatic rotator cuff tears. J Shoulder Elbow Surg 12:122–127CrossRef Pearsall AW 4th, Bonsell S, Heitman RJ, Helms CA, Osbahr D, Speer KP (2003) Radiographic findings associated with symptomatic rotator cuff tears. J Shoulder Elbow Surg 12:122–127CrossRef
6.
go back to reference Hardy DC, Vogler JB 3rd, White RH (1986) The shoulder impingement syndrome: prevalence of radiographic findings and correlation with response to therapy. AJR Am J Roentgenol 147:557–561CrossRef Hardy DC, Vogler JB 3rd, White RH (1986) The shoulder impingement syndrome: prevalence of radiographic findings and correlation with response to therapy. AJR Am J Roentgenol 147:557–561CrossRef
7.
go back to reference Cone RO 3rd, Resnick D, Danzig L (1984) Shoulder impingement syndrome: radiographic evaluation. Radiology 150:29–33CrossRef Cone RO 3rd, Resnick D, Danzig L (1984) Shoulder impingement syndrome: radiographic evaluation. Radiology 150:29–33CrossRef
8.
go back to reference Peh WC, Farmer TH, Totty WG (1995) Acromial arch shape: assessment with MR imaging. Radiology 195:501–505CrossRef Peh WC, Farmer TH, Totty WG (1995) Acromial arch shape: assessment with MR imaging. Radiology 195:501–505CrossRef
9.
go back to reference Huang LF, Rubin DA, Britton CA (1999) Greater tuberosity changes as revealed by radiography: lack of clinical usefulness in patients with rotator cuff disease. AJR Am J Roentgenol 172:1381–1388CrossRef Huang LF, Rubin DA, Britton CA (1999) Greater tuberosity changes as revealed by radiography: lack of clinical usefulness in patients with rotator cuff disease. AJR Am J Roentgenol 172:1381–1388CrossRef
10.
go back to reference Liotard JP, Cochard P, Walch G (1998) Critical analysis of the supraspinatus outlet view: rationale for a standard scapular Y-view. J Shoulder Elbow Surg 7:134–139CrossRef Liotard JP, Cochard P, Walch G (1998) Critical analysis of the supraspinatus outlet view: rationale for a standard scapular Y-view. J Shoulder Elbow Surg 7:134–139CrossRef
11.
go back to reference Hyvonen P, Paivansalo M, Lehtiniemi H, Leppilahti J, Jalovaara P (2001) Supraspinatus outlet view in the diagnosis of stages II and III impingement syndrome. Acta Radiol 42:441–446CrossRef Hyvonen P, Paivansalo M, Lehtiniemi H, Leppilahti J, Jalovaara P (2001) Supraspinatus outlet view in the diagnosis of stages II and III impingement syndrome. Acta Radiol 42:441–446CrossRef
12.
go back to reference Hussain A, Muzzammil M, Butt F, Valsamis EM, Dwyer AJ (2018) Effectiveness of plain shoulder radiograph in detecting degenerate rotator cuff tears. J Ayub Med Coll Abbottabad 30:8–11PubMed Hussain A, Muzzammil M, Butt F, Valsamis EM, Dwyer AJ (2018) Effectiveness of plain shoulder radiograph in detecting degenerate rotator cuff tears. J Ayub Med Coll Abbottabad 30:8–11PubMed
14.
go back to reference Simel DL, Samsa GP, Matchar DB (1991) Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol 44:763–770CrossRef Simel DL, Samsa GP, Matchar DB (1991) Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol 44:763–770CrossRef
15.
go back to reference Jaeschke R, Guyatt GH, Sackett DL (1994) Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA 271:703–707CrossRef Jaeschke R, Guyatt GH, Sackett DL (1994) Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA 271:703–707CrossRef
16.
go back to reference Narasimhan R, Shamse K, Nash C, Dhingra D, Kennedy S (2016) Prevalence of subscapularis tears and accuracy of shoulder ultrasound in pre-operative diagnosis. Int Orthop 40:975–979CrossRef Narasimhan R, Shamse K, Nash C, Dhingra D, Kennedy S (2016) Prevalence of subscapularis tears and accuracy of shoulder ultrasound in pre-operative diagnosis. Int Orthop 40:975–979CrossRef
17.
go back to reference Jacobson JA (2011) Shoulder US: anatomy, technique, and scanning pitfalls. Radiology 260:6–16CrossRef Jacobson JA (2011) Shoulder US: anatomy, technique, and scanning pitfalls. Radiology 260:6–16CrossRef
18.
go back to reference Okoroha KR, Mehran N, Duncan J et al (2017) Characterization of rotator cuff tears: ultrasound versus magnetic resonance imaging. Orthopedics 40:e124–e130CrossRef Okoroha KR, Mehran N, Duncan J et al (2017) Characterization of rotator cuff tears: ultrasound versus magnetic resonance imaging. Orthopedics 40:e124–e130CrossRef
19.
go back to reference Ide J, Maeda S, Takagi K (2005) Arthroscopic transtendon repair of partial-thickness articular-side tears of the rotator cuff: anatomical and clinical study. Am J Sports Med 33:1672–1679CrossRef Ide J, Maeda S, Takagi K (2005) Arthroscopic transtendon repair of partial-thickness articular-side tears of the rotator cuff: anatomical and clinical study. Am J Sports Med 33:1672–1679CrossRef
20.
go back to reference Moosmayer S, Lund G, Seljom US et al (2019) At a 10-year follow-up, tendon repair is superior to physiotherapy in the treatment of small and medium-sized rotator cuff tears. J Bone Joint Surg Am 101:1050–1060CrossRef Moosmayer S, Lund G, Seljom US et al (2019) At a 10-year follow-up, tendon repair is superior to physiotherapy in the treatment of small and medium-sized rotator cuff tears. J Bone Joint Surg Am 101:1050–1060CrossRef
21.
go back to reference McCallister WV, Parsons IM, Titelman RM, Matsen FA 3rd (2005) Open rotator cuff repair without acromioplasty. J Bone Joint Surg Am 87:1278–1283PubMed McCallister WV, Parsons IM, Titelman RM, Matsen FA 3rd (2005) Open rotator cuff repair without acromioplasty. J Bone Joint Surg Am 87:1278–1283PubMed
22.
go back to reference Harryman DT 2nd, Mack LA, Wang KY, Jackins SE, Richardson ML, Matsen FA 3rd (1991) Repairs of the rotator cuff. Correlation of functional results with integrity of the cuff. J Bone Joint Surg Am 73:982–989CrossRef Harryman DT 2nd, Mack LA, Wang KY, Jackins SE, Richardson ML, Matsen FA 3rd (1991) Repairs of the rotator cuff. Correlation of functional results with integrity of the cuff. J Bone Joint Surg Am 73:982–989CrossRef
23.
go back to reference Yamamoto A, Takagishi K, Osawa T et al (2010) Prevalence and risk factors of a rotator cuff tear in the general population. J Shoulder Elbow Surg 19:116–120CrossRef Yamamoto A, Takagishi K, Osawa T et al (2010) Prevalence and risk factors of a rotator cuff tear in the general population. J Shoulder Elbow Surg 19:116–120CrossRef
24.
go back to reference Sayampanathan AA, Andrew TH (2017) Systematic review on risk factors of rotator cuff tears. J Orthop Surg (Hong Kong) 25:2309499016684318 Sayampanathan AA, Andrew TH (2017) Systematic review on risk factors of rotator cuff tears. J Orthop Surg (Hong Kong) 25:2309499016684318
25.
go back to reference Koh KH, Han KY, Yoon YC, Lee SW, Yoo JC (2013) True anteroposterior (Grashey) view as a screening radiograph for further imaging study in rotator cuff tear. J Shoulder Elbow Surg 22:901–907CrossRef Koh KH, Han KY, Yoon YC, Lee SW, Yoo JC (2013) True anteroposterior (Grashey) view as a screening radiograph for further imaging study in rotator cuff tear. J Shoulder Elbow Surg 22:901–907CrossRef
26.
go back to reference Ono K, Yamamuro T, Rockwood CA Jr (1992) Use of a thirty-degree caudal tilt radiograph in the shoulder impingement syndrome. J Shoulder Elbow Surg 1:246–252CrossRef Ono K, Yamamuro T, Rockwood CA Jr (1992) Use of a thirty-degree caudal tilt radiograph in the shoulder impingement syndrome. J Shoulder Elbow Surg 1:246–252CrossRef
27.
go back to reference Mayerhoefer ME, Breitenseher MJ, Roposch A, Treitl C, Wurnig C (2005) Comparison of MRI and conventional radiography for assessment of acromial shape. AJR Am J Roentgenol 184:671–675CrossRef Mayerhoefer ME, Breitenseher MJ, Roposch A, Treitl C, Wurnig C (2005) Comparison of MRI and conventional radiography for assessment of acromial shape. AJR Am J Roentgenol 184:671–675CrossRef
28.
go back to reference Bigliani LU, Ticker JB, Flatow EL, Soslowsky LJ, Mow VC (1991) The relationship of acromial architecture to rotator cuff disease. Clin Sports Med 10:823–838PubMed Bigliani LU, Ticker JB, Flatow EL, Soslowsky LJ, Mow VC (1991) The relationship of acromial architecture to rotator cuff disease. Clin Sports Med 10:823–838PubMed
29.
go back to reference Hu J, Shen L, Albanie S, Sun G, Wu E (2018) Squeeze-and-excitation networks. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132-7141 Hu J, Shen L, Albanie S, Sun G, Wu E (2018) Squeeze-and-excitation networks. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132-7141
30.
go back to reference Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249-256 Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249-256
33.
go back to reference Philbrick KA, Yoshida K, Inoue D et al (2018) What does deep learning see? Insights from a classifier trained to predict contrast enhancement phase from CT images. AJR Am J Roentgenol 211:1184–1193CrossRef Philbrick KA, Yoshida K, Inoue D et al (2018) What does deep learning see? Insights from a classifier trained to predict contrast enhancement phase from CT images. AJR Am J Roentgenol 211:1184–1193CrossRef
34.
go back to reference Yao L, Prosky J, Poblenz E, Covington B, Lyman K (2018) Weakly supervised medical diagnosis and localization from multiple resolutions. arXiv preprint arXiv:180307703 Yao L, Prosky J, Poblenz E, Covington B, Lyman K (2018) Weakly supervised medical diagnosis and localization from multiple resolutions. arXiv preprint arXiv:180307703
35.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44:837–845CrossRef DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44:837–845CrossRef
36.
go back to reference Clopper CJ, Pearson ES (1934) The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 26:404–413CrossRef Clopper CJ, Pearson ES (1934) The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 26:404–413CrossRef
37.
go back to reference Boonstra AM, Schiphorst Preuper HR, Balk GA, Stewart RE (2014) Cut-off points for mild, moderate, and severe pain on the visual analogue scale for pain in patients with chronic musculoskeletal pain. Pain 155:2545–2550CrossRef Boonstra AM, Schiphorst Preuper HR, Balk GA, Stewart RE (2014) Cut-off points for mild, moderate, and severe pain on the visual analogue scale for pain in patients with chronic musculoskeletal pain. Pain 155:2545–2550CrossRef
38.
go back to reference Bachmann LM, Kolb E, Koller MT, Steurer J, ter Riet G (2003) Accuracy of Ottawa ankle rules to exclude fractures of the ankle and mid-foot: systematic review. BMJ 326:417CrossRef Bachmann LM, Kolb E, Koller MT, Steurer J, ter Riet G (2003) Accuracy of Ottawa ankle rules to exclude fractures of the ankle and mid-foot: systematic review. BMJ 326:417CrossRef
39.
go back to reference Foad A, Wijdicks CA (2012) The accuracy of magnetic resonance imaging and magnetic resonance arthrogram versus arthroscopy in the diagnosis of subscapularis tendon injury. Arthroscopy 28:636–641CrossRef Foad A, Wijdicks CA (2012) The accuracy of magnetic resonance imaging and magnetic resonance arthrogram versus arthroscopy in the diagnosis of subscapularis tendon injury. Arthroscopy 28:636–641CrossRef
40.
go back to reference Garavaglia G, Ufenast H, Taverna E (2011) The frequency of subscapularis tears in arthroscopic rotator cuff repairs: a retrospective study comparing magnetic resonance imaging and arthroscopic findings. Int J Shoulder Surg 5:90–94CrossRef Garavaglia G, Ufenast H, Taverna E (2011) The frequency of subscapularis tears in arthroscopic rotator cuff repairs: a retrospective study comparing magnetic resonance imaging and arthroscopic findings. Int J Shoulder Surg 5:90–94CrossRef
41.
go back to reference Ono Y, Sakai T, Carroll MJ, Lo IK (2017) Tears of the subscapularis tendon: a critical analysis review. JBJS Rev 5:1–12CrossRef Ono Y, Sakai T, Carroll MJ, Lo IK (2017) Tears of the subscapularis tendon: a critical analysis review. JBJS Rev 5:1–12CrossRef
42.
go back to reference Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, Kleijnen J (2004) Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med 140:189–202CrossRef Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, Kleijnen J (2004) Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med 140:189–202CrossRef
Metadata
Title
Ruling out rotator cuff tear in shoulder radiograph series using deep learning: redefining the role of conventional radiograph
Authors
Youngjune Kim
Dongjun Choi
Kyong Joon Lee
Yusuhn Kang
Joong Mo Ahn
Eugene Lee
Joon Woo Lee
Heung Sik Kang
Publication date
01-05-2020
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 5/2020
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-019-06639-1

Other articles of this Issue 5/2020

European Radiology 5/2020 Go to the issue