Validity and reliability of social anxiety disorder diagnoses in the Swedish National Patient Register

Population-based administrative registers are often used for research purposes. However, their potential usefulness depends on the validity of the registered information. This study assessed the validity of the recorded codes for social anxiety disorder (SAD), also known as social phobia, in the Swedish National Patient Register (NPR).

The personal identification numbers of 300 randomly selected individuals with a diagnosis of SAD recorded in the NPR were obtained from the Swedish National Board of Health and Welfare. The medical files of these individuals were then requested from clinics nationally. A total of 117 files were received and two independent raters reviewed each file to assess the presence or absence of SAD, according to the definition of the International Classification of Diseases, Tenth Edition (ICD-10) and the diagnostic criteria of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR). When disagreements between the two raters were found, a third rater reviewed the file to establish a best estimate diagnosis. Positive predictive values (PPV) and agreement between the two initial raters (using Cohen’s kappa) were calculated. Additionally, raters completed the Clinical Global Impression – Severity (CGI-S) and the Global Assessment of Functioning (GAF) rating scales for each file. Inter-rater agreement for the CGI-S and the GAF was assessed using intraclass correlation coefficients (ICC).

After exclusion of files not containing sufficient information, 95 files were included in the analyses. Of these, 77 files (81.05%) were considered to be ‘true positive’ cases (PPV = 0.81, 95% confidence interval = 0.72–0.88). Inter-rater agreement regarding the presence or absence of SAD was substantial (κ = 0.72). CGI-S and GAF scores indicated that patients were in the moderate range of severity and functional impairment. Inter-rater agreement for the CGI-S and the GAF was moderate to good (ICC = 0.72 and ICC = 0.82, respectively).

The ICD-10 codes for SAD in the Swedish NPR are generally valid and reliable, but we recommend sensitivity analyses in future register-based studies to minimise the impact of potential diagnostic misclassification. Most patients were moderately severe and impaired, suggesting that results from register-based studies of SAD may be generalizable.