Figures
Abstract
Introduction
The objective of this study is to compare different methods for measuring breast density, both visual assessments and automated volumetric density, in a breast cancer screening setting. These measures could potentially be implemented in future screening programmes, in the context of personalised screening or screening evaluation.
Materials and Methods
Digital mammographic exams (N = 992) of women participating in the Dutch breast cancer screening programme (age 50–75y) in 2013 were included. Breast density was measured in three different ways: BI-RADS density (5th edition) and with two commercially available automated software programs (Quantra and Volpara volumetric density). BI-RADS density (ordinal scale) was assessed by three radiologists. Quantra (v1.3) and Volpara (v1.5.0) provide continuous estimates. Different comparison methods were used, including Bland-Altman plots and correlation coefficients (e.g., intraclass correlation coefficient [ICC]).
Results
Based on the BI-RADS classification, 40.8% of the women had ‘heterogeneously or extremely dense’ breasts. The median volumetric percent density was 12.1% (IQR: 9.6–16.5) for Quantra, which was higher than the Volpara estimate (median 6.6%, IQR: 4.4–10.9). The mean difference between Quantra and Volpara was 5.19% (95% CI: 5.04–5.34) (ICC: 0.64). There was a clear increase in volumetric percent dense volume as BI-RADS density increased. The highest accuracy for predicting the presence of BI-RADS c+d (heterogeneously or extremely dense) was observed with a cut-off value of 8.0% for Volpara and 13.8% for Quantra.
Citation: van der Waal D, den Heeten GJ, Pijnappel RM, Schuur KH, Timmers JMH, Verbeek ALM, et al. (2015) Comparing Visually Assessed BI-RADS Breast Density and Automated Volumetric Breast Density Software: A Cross-Sectional Study in a Breast Cancer Screening Setting. PLoS ONE 10(9): e0136667. https://doi.org/10.1371/journal.pone.0136667
Editor: Eugenio Paci, ISPO, ITALY
Received: April 17, 2015; Accepted: August 6, 2015; Published: September 3, 2015
Copyright: © 2015 van der Waal et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: Due to ethical and legal restrictions, data are available upon request. Interested researchers may submit request for data to the Corresponding Author, Daniëlle van der Waal, Danielle.vanderWaal@radboudumc.nl.
Funding: The authors received no specific funding for this work.
Competing interests: GJ den Heeten is a former member of the medical advisory board of Mātakina, founder of sigmascreening (spin-off company Academic Medical Centre Amsterdam), and consultant of Philips ICT. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials. No other authors have any competing interests.
Introduction
Fibroglandular breast tissue, which is referred to as dense tissue, is known to mask breast carcinomas on mammograms [1, 2]. In addition to being a very strong independent breast cancer risk factor [2–4], high mammographic density is thus also associated with a decreased sensitivity of mammographic screening [2, 5]. Based on these associations, breast density could potentially be an important factor in breast cancer risk prediction and evaluation of breast cancer screening programmes. It might even become more important if considered for personalised screening [6]. Evidence on alternative screening regimens for population-based organized screening programmes is still limited, but additional screening modalities for women with a high breast density are extensively studied. Mammographic density can, however, only be used for evaluation or risk-stratified screening when it is assessed in an objective and reproducible manner.
Wolfe proposed a breast pattern scale in 1976 [7]. This led to the introduction of many other classifications in the following years, such as the Tabár scale [8] and the Breast Imaging Reporting and Data System (BI-RADS) density scale [9]. The latter is still used in breast cancer screening in the USA. A major drawback of these methods is the intra- and inter-rater variability [10]. More quantitative measures were therefore developed, with the area-based threshold software Cumulus ultimately becoming the standard method for breast density assessment in scientific research. Cumulus density values are, however, still subject to some measurement variability, and the use of the software within nationwide screening programmes is too time-consuming [11]. Furthermore, the introduction of digital mammography opened up a range of possibilities regarding automated methods that no longer assess dense area but dense volume. Dense volume, which takes breast thickness into account, is expected to be a more ‘biologically relevant’ measure [12, 13]. The commercial software programs Quantra and Volpara are now both commonly used, yet data on associations between these different methods is still scarce [14–17].
Breast density is not structurally assessed at screening examinations in the Netherlands. BI-RADS density is only recorded in the clinical setting. The Breast Density Inform Law in the USA [18] did lead to parliamentary questions in the Netherlands on the potential introduction of breast density measurements. With this increasing interest in breast density, it is important to find ways to obtain and report information on breast density of women participating in screening [19]. We thus have to learn more about the available methods. There is currently no consensus on what method to use for measuring breast density in the context of a screening programme. The objective of this study was therefore to compare different methods to measure breast density in the Dutch screening setting. The methods included here are BI-RADS density (visually assessed) and two volumetric software programs (Quantra and Volpara).
Materials and Methods
Setting
In the Netherlands, women ages 50–75 years are invited to participate in breast cancer screening every two years. We included 1000 mammographic examinations of participants who were screened at the Nijmegen screening unit in 2013. The dataset consists of multiple small sets of consecutive exams. The dates of retrieval were chosen at random, and we therefore believe that the dataset as a whole can be seen as a random sample of the Nijmegen screening population. Both a mediolateral oblique (MLO) and a craniocaudal (CC) view were obtained per breast. In five participants, only the left (N = 3) or the right (N = 2) views were available. Five examinations were excluded because the women had breast prostheses, which would distort the automated breast density measurements. In addition, three exams could not be read by the volumetric breast density software. This resulted in a dataset of 992 mammograms.
Ethics statement
According to the Dutch law, medical ethics approval is not needed for this type of study, with no extra burden for participants and anonymized data. Written informed consent was not required for this study because the data were obtained in the context of an agreement between the regional screening organisations and the Dutch Reference Centre for Screening. Women automatically consent to the use of their data for scientific purposes by participating in screening. The screening organisations are responsible for data delivery in accordance with privacy regulations, particularly regarding anonymizing data and potentially removing data of participants who objected to the exchange of personal data with specific organisations (opt-out procedure).
Breast density measurements
The Dutch screening programme uses Full-Field Digital Mammography (FFDM). All exams in this study were performed on the same Hologic Selenia system (Bedford, USA). Breast density was measured in three different ways: BI-RADS density (visually assessed by radiologists), Quantra volumetric density (automated software), and Volpara volumetric density (automated software). The R2 Quantra Volumetric Assessment software (version 1.3) was integrated in the Cenova DICOM server (version 2.1; Hologic, Bedford, USA). Version 1.5.0 of the Volpara Algorithm (Volpara Imaging Software 1.5.11; Mātakina, Wellington, New Zealand) was used.
BI-RADS breast density was assessed by three experienced screening radiologists. An initial pilot was performed where the radiologists scored the first 250 mammograms (from the original dataset of 1000 mammograms), which was concluded with a consensus meeting to ensure that the radiologists were applying the scale in a similar way. The ACR guidelines were discussed during the meeting, and discrepancies in the pilot scores were addressed. The consensus meeting had a favourable effect on the agreement between the radiologists. The scores before the consensus meeting were not included in our main analyses. Instead, the mammograms were scored again by the radiologists (individually) several weeks after the consensus meeting.
The overall scores were based on the agreement between at least two of the three radiologists. In the rare cases that all three radiologists disagreed (n = 9), the middle score was used. The mammograms were scored according to the newest (5th edition, American College of Radiology) BI-RADS density classification [9]. In contrast to previous versions of the BI-RADS density classification, the qualitative categories are not matched to area-based density percentages in the new edition. The BI-RADS density categories in the 5th edition are: (a) fatty, (b) scattered density, (c) heterogeneously dense, and (d) extremely dense [9]. A subset of 250 mammograms was scored twice by each radiologist to assess intra-observer variability. This was a different subset (mammogram 251–500) than the subset that was used in the pilot session. All assessments were performed on processed images at a review workstation. The radiologists were blinded to their previous scores and scores of others.
Quantra and Volpara are fully automated software programs that both assess the volumetric breast density on ‘for processing’ (raw) image data [17, 20, 21]. The X-rays are attenuated, as a result of photon absorption and scattering, in varying degrees as they pass through the different tissues. Estimates of fibroglandular tissue volume (absolute dense volume, in cm3) are based on the measured X-ray attenuation per pixel. Dividing the fibroglandular tissue volume by the total breast volume gives an estimate of the percentage volumetric breast density (percent dense volume). Volpara has developed an additional measure of breast density, namely the Volpara Density Grade (VDG). The VDG is based on percent dense volume, which is divided as follows: 0.0–4.5% (VDG1), 4.5–7.5% (VDG2), 7.5–15.5% (VDG3), and ≥15.5% (VDG4). The categories are based on agreement with the BI-RADS density scale.
Statistical analyses
We present different agreement and reliability measurements to compare the density measurements [22]. Reliability refers to the ability to differentiate between women with a different density level [23]. Agreement, on the other hand, refers to the degree of similarity between two measurements. When two raters, for example, give different density values, the agreement between these measurements will be poor. Reliability can, however, still be substantial when the raters give the same women relatively low or high density scores. Agreement depends on measurement error, whereas with reliability measures the measurement error is related to the between-subject variability [23].
Weighted kappa scores (κw; Fleiss-Cohen, quadratic weights) with corresponding 95% confidence intervals (CI) were used to assess the intra- and inter-rater reliability of the BI-RADS density scores [24]. The kappa scores were also compared to the categories originally defined by Landis and Koch [25] and slightly reworded by Altman [26]: poor (<0.20), fair (0.21–0.40), moderate (0.41–0.60), good (0.61–0.80), and very good (>0.80) reliability. In addition, we present the overall proportions of agreement (absolute agreement). This is the proportion of the scores that were exactly the same for two ratings.
The volumetric breast density estimates were compared to the BI-RADS classification by determining the median and the inter-quartile ranges (IQR) according to BI-RADS category for each volumetric density measure. We did not define a golden standard for breast density in our study. Receiver operating characteristic (ROC) analyses were, however, used to assess the ability of both volumetric software programs to differentiate between women with a high breast density (BI-RADS c+d) and women with a low breast density (BI-RADS a+b) based on the visual BI-RADS classification. This was done to enable comparisons with the literature. Chosen cut-off values were based on the highest accuracy, which we calculated using the following formula:
In this study, ‘true-positives’ are women with a breast density of BI-RADS c+d who are classified as having a high breast density based on the volumetric estimates. ‘True-negatives’, on the other hand, refers to women with a BI-RADS a+b density who also have a low volumetric density.
The volumetric breast density measures were also compared to each other. Both Pearson’s correlation coefficients (r), based on log-transformed values (ln[x+1]), and two-way mixed intraclass correlation coefficients (ICC) were calculated for comparison of the different volumetric density measures. The following formula was used to calculate the ICC [23]:
Variance as a result of differences between participants
Variance as a result of differences between software programs
Residual variance
An ICC of +1.0 indicates that the measures give perfectly matching scores, with ICC values >0.7 often being considered as ‘good’ [23, 27]. However, this cut-off point is rather arbitrary, and some have argued that the ICC should be at least 0.9 when measures have to be used interchangeably in clinical practice [22]. Confidence intervals were obtained by bootstrapping.
Finally, Bland-Altman plots are presented as agreement measures. The Bland-Altman plot consists of differences between two measurements on the y-axis and the mean of the two methods on the x-axis. Limits of agreement can be calculated by multiplying the standard deviation (σ) of the differences with 1.96 (+/-1.96σ). This is based on the assumptions that: (a) the variation in differences is similar across the range of values for the mean, and (b) the differences follow a normal distribution. The original (untransformed) differences were used for the Bland-Altman analyses. The observed difference between Quantra and Volpara is expected to be in between the limits of agreement in 95% of (future) measurements. Bias is defined as the mean difference between the two methods. The standard error of the bias is calculated as:
Age was the only other breast cancer risk factor available in this study population. As a descriptive analysis, the association between age and breast density was assessed by calculating proportions (BI-RADS density) and medians (Quantra and Volpara estimates) for each age group.
All statistical analyses were performed using SAS (version 9.2, SAS Institute), apart from the ICC calculations that were performed with SPSS (version 20, SPSS). Figures were made with GraphPad Prism (version 5.03, GraphPad Software). Two-sided p-values smaller than 0.05 were considered to be statistically significant.
Results
BI-RADS
Table 1 shows the BI-RADS density scores, as assessed by the three radiologists. Overall, 11.2% (n = 111) of the women were categorized as having ‘extremely dense’ breasts and 29.6% (n = 294) had a ‘heterogeneously dense’ breast pattern. Measures of intra-rater agreement and reliability for the BI-RADS density scores are presented in Table 1 as well. The κw ranged from 0.82 (95% CI: 0.79–0.86) to 0.87 (95% CI: 0.83–0.91). Based on the Landis and Koch guidelines (reworded by Altman), the intra-rater reliability could thus be seen as ‘very good’. The intra-rater agreement ranged from 62.8% (n = 157) to 84.8% (n = 212) (Table 1), with a mean agreement of 75.3%. When the BI-RADS scale was dichotomized (a+b vs. c+d), the proportions of agreement were larger (range %: 86.4–95.6, range n: 216–239). Only the first observer had paired scores that differed more than one category (n = 1).
All three radiologists agreed in 570 out of 992 (57.5%) assessments. Table 2 shows the inter-rater agreement and reliability for the BI-RADS density scores. The mean proportion of agreement for the pair-wise comparisons was 71.3% (range %: 67.6–74.3, range n: 671–737). The proportions were even higher when the measure was dichotomized (range %: 89.0–90.2, range n: 883–895). The κw of the inter-rater comparisons ranged from 0.80 to 0.84, which corresponds to ‘good’ or ‘very good’ reliability. In nine cases, the radiologists all scored differently. The number of discordant pairs with a difference of more than one category was limited (n = 8 for rater 1 vs. 2, n = 8 for rater 1 vs. 3, and n = 2 for rater 2 vs. 3).
Volumetric density
The volumetric breast density measures are presented in Table 3. The median volumetric breast density was 12.1% (IQR: 9.6–16.5) based on Quantra measurements, which was higher than the Volpara estimate (median: 6.6%, IQR: 4.4–10.9). Quantra also gave a higher median estimate of dense volume: 70 cm3 (IQR: 49–101) with Quantra compared to 50 cm3 (IQR: 39–70) with Volpara. Total breast volume, on the other hand, was higher for Volpara: 774 cm3 (IQR: 509–1119) compared to 577 cm3 (IQR: 368–842) for Volpara and Quantra, respectively. Based on the VDG, 12.3% and 30.7% of the women had ‘extremely dense’ (VDG 4) and ‘heterogeneously dense’ breasts (VDG 3), respectively.
Fig 1 shows the agreement between the volumetric measures in Bland-Altman plots. Volpara consistently gave lower percent dense volume and absolute dense volume estimates than Quantra. The mean difference (bias) between the methods (Quantra-Volpara) was 5.19% (95% CI: 5.04–5.34) for percent dense volume and 24.1 cm3 (95% CI: 22.0–26.3) for dense volume. Compared with the Volpara measurement, the Quantra estimate of percent dense volume is expected to range between +0.5% and +9.9% in 95% of the measurements (limits of agreement). The Pearson’s r and the ICC were 0.91 (95% CI: 0.90–0.92) and 0.64 (95% CI: -0.07–0.88), respectively. The limits of agreement of absolute dense volume were -43.6 cm3 and +91.9 cm3, with a Pearson’s r of 0.82 (95% CI: 0.80–0.84) and an ICC of 0.55 (95% CI: 0.24–0.72).
BI-RADS and volumetric breast density
Table 4 shows the volumetric breast density according to BI-RADS density category. For both measures, there was a clear increase in volumetric breast density as BI-RADS density increased: median estimates increased from 3.6% (IQR 3.1–4.4) to 19.3% (IQR 15.1–23.5) with Volpara and from 8.5% (IQR 7.6–9.9) to 23.1% (IQR 19.6–26.8) with Quantra. In addition, the VDG distribution was comparable to the BI-RADS density distribution (κw: 0.80, 95% CI: 0.77–0.82; proportion agreement: 65.4%) (S1 Table). Volpara and Quantra did not agree on the association between BI-RADS density and absolute dense volume: a positive association was observed with Volpara, whereas Quantra estimates of absolute dense volume did not appear to be associated with the BI-RADS classification.
The ROC analyses on predicting the presence of BIRADS c+d (high density) with percent dense volume resulted in the following area under the curve (AUC) values: 0.948 (95% CI: 0.935–0.960) with Volpara and 0.948 (95% CI: 0.935–0.961) with Quantra (S1 Fig). The highest accuracy was observed with a cut-off value of 8.0% for Volpara (sensitivity = 84%, specificity = 91%) and 13.8% for Quantra (sensitivity = 82%, specificity = 92%).
Age
The median age at examination was 59 years (IQR: 54–64). The median percent dense volume, Volpara and Quantra estimates, appeared to decrease with age (Table 4). The association between age and absolute dense volume was less pronounced in this population, with no clear pattern for the Quantra measurements and a slight decrease with Volpara. The percentage of women with ‘heterogeneously’ or ‘extremely’ dense breasts according to the BI-RADS density classification was lower for women in the highest age group (≥69y) compared to women in lowest age group (49–58y) (17.4% vs. 50.1%). A similar association between age and VDG was observed (23.5% vs. 53.4%).
Discussion
We studied three different methods to assess breast density, namely the BI-RADS density scale and two software programs (Quantra and Volpara). Quantra gave higher estimates of percent dense volume and absolute dense volume than Volpara. There was a positive association between percent dense volume and the BI-RADS density scale for both programs. In addition, the VDG (Volpara measure) seemed to be a good approximation of BI-RADS density in our study. Absolute dense volume only appeared to be associated with BI-RADS density when using the Volpara estimates. These density measures may potentially be used in the evaluation of screening performance and to identify risk groups.
Although other studies used older editions of the BI-RADS classification, the intra- and inter-observer reliability estimates in our study appeared to be similar to previous findings [10, 28–32]. The κw tends to suggest ‘good’ to ‘very good’ reliability based on the Landis and Koch guidelines, even though these categories may be somewhat arbitrary. The proportions of agreement improved after the consensus meeting (data not shown), but there are still relatively large discrepancies between the radiologists (up to 32.4% for observer 2 vs. 3). For this reason, density assessment by individual radiologists is not useful for selecting women for future alternative screening regimens in population-based organised breast cancer screening programmes or risk management. Furthermore, the intra- and inter-rater variability may differ between radiologists, for example based on experience level [33].
The use of automated volumetric density measures has been advocated [19, 34]. Volumetric density would have several advantages over qualitative scales and area-based density measures. Volumetric software programs calculate breast density based on 3D instead of 2D information, thus also including thickness of the tissue. An estimate of the actual volume of the tissue rather than the 2D projection of the tissue is expected to have a stronger biological association [12, 13]. In addition, the calculations incorporate imaging settings (e.g., X-ray dose). Furthermore, with both software programs there is perfect agreement between two assessments of the same mammogram, which we also observed in our data. This is in contrast to the qualitative and semi-automated measurements, in which some degree of intra- and inter-rater variation appears to be inevitable. Finally, the volumetric measurements would be easier to implement in screening programmes as the automated software tends to be less time-consuming and labour-intensive than the rather variable visual assessment with BI-RADS breast density, which in dual reading set-up will cause many discrepancies.
Several studies have compared the volumetric estimates to the BI-RADS scale (Table 5) [35–41]. An important difference between radiologists’ scores and automated methods is that radiologists tend to give the maximum value (as suggested by the ACR), whereas volumetric density estimates are based on the average of multiple views. The results from all these studies do, however, suggest a clear positive association between percent dense volume and BI-RADS density. The median estimates of percent dense volume we obtained with Volpara for each BI-RADS category appeared to be at the lower end of the range. Our Quantra estimates were lower than the available literature values as well. This may be explained by differences in setting and risk factor distribution (e.g., age range, use of hormone therapy, clinic versus screening). Using area-based measures, the highest BI-RADS density category was previously linked to density percentages greater than 75% (4th BI-RADS edition). All our volumetric estimates for percent dense volume were below 40%, which clearly illustrates a difference in range between area-based and volumetric methods. Similar to our findings, Gweon et al. and Jeffreys et al. both found an increase in absolute dense volume with increasing BI-RADS density [35, 36]. We observed a distinct difference in Volpara absolute dense volume between the two lowest and the two highest BI-RADS density categories. There was no clear association between Quantra absolute dense volume and BI-RADS density. In line with these results, Eng et al. found that Quantra absolute dense volume, in contrast to Volpara dense volume or Cumulus dense area, was not associated with an increased breast cancer risk (Q5 vs. Q1: OR 1.08) [42].
There was a relatively strong correlation in percent dense volume between the two automated volumetric methods (Pearson’s r: 0.91, ICC: 0.64). The correlation for absolute dense volume, on the other hand, appeared to be somewhat weaker, with lower correlation coefficients (Pearson’s r: 0.82, ICC: 0.55). The first results from validation studies, comparing volumetric density to MRI results, are now appearing in the literature. Gubern-Mérida et al. indicated that Volpara may slightly underestimate the true density (as measured with MRI) [38]. Wang et al. is, to our knowledge, the first study to include both Volpara and Quantra. They observed a strong correlation between the two measures, as well as a strong correlation of both with MRI [14]. However, absolute dense volume was not included in either of these studies. Morrish et al. did report on absolute dense volume in their comparison study of Quantra and Volpara [15]. Although they observed a weaker correlation for percent dense volume, the results on absolute dense volume appear to be in line with our findings. It should be noted that this study was performed in a slightly different setting (e.g., country, age range, participant selection) and used different software versions, which may explain differences in volume estimates and observed correlations.
The effect of breast density on breast cancer risk is relevant for personalised (primary and secondary) prevention, where it can potentially be used as a risk stratification factor. Little evidence has yet been published on the association between volumetric density and breast cancer risk to date, although previous studies have suggested that volumetric density may be more strongly associated with breast cancer risk due to its predicted biological association [12, 13]. According to the meta-analysis of McCormack et al. [3], women with extremely dense breasts based on the BI-RADS classification have a 4.08 (95% CI: 2.96–5.63) times higher breast cancer risk compared with women with fatty breasts. In our study, the highest BI-RADS category corresponded to a median percent dense volume of 19.3% (Volpara) or 23.1% (Quantra). However, with overlapping ranges of volumetric density for different BI-RADS categories, it is difficult to directly relate these findings to the previously determined risks based on the BI-RADS scale. Park and colleagues reported an adjusted OR of 3.07 for women with more than 15.1% Volpara percent dense volume compared to women with less than 4.7% in a Korean population [43]. A study by Brand et al. showed that the highest Volpara density quartile was associated with a 2.93 (percent dense volume) or 1.63 (absolute dense volume) higher risk than the lowest quartile [44]. Finally, Eng et al. studied several breast density measures: both Volpara (Q5 vs. Q1: OR 8.26) and Quantra (Q5 vs. Q1: OR 3.94) estimates of percent dense volume were associated with an increased breast cancer risk [42].
The associations between volumetric density and other established breast cancer risk factors may provide some insight into the etiological role of volumetric density. We studied the association with age, where we observed a similar inverse association as has previously been determined using other density measures. Studies have shown that most risk factors have a similar association with Volpara volumetric breast density as they do with area-based measures [44–46]. Only limited evidence is available on the association between established risk factors and Quantra volumetric density [47].
One of the limitations of our study is that we did not have any information on breast cancer risk, which would ultimately be needed to validate both breast density measures and potentially implement them in a breast cancer screening setting if they are to be used for risk stratification. More research is needed as well on the association between volumetric density and sensitivity of digital mammography. This information is required to identify a clinically relevant breast density cut-off value above which additional screening (e.g., with MRI or ultrasound) may be cost effective. Studies are also needed on the potential inclusion of volumetric density in risk models. Strengths of the current study include the use of both Volpara and Quantra, which we were able to study in relation to the newest BI-RADS density classification. In addition, we included both percent dense volume and absolute dense volume. Finally, our study sample was relatively large compared to previous studies (Table 5).
Before volumetric density measurements can be implemented in breast cancer screening, the infrastructure on storing unprocessed mammogram data has to be developed further. This would involve large amounts of data. However, the advantage of this data storage is that multiple automated tools can easily be compared over time. Furthermore, if at any time an algorithm would be introduced that performs considerably better, it could also be applied to historical data. This is especially important for monitoring density changes, for example between geographic areas and within women. Due to the lack of intra- and inter-observer variability, in contrast to the BI-RADS density classification, changes in density can be more readily detected if random measurement error is small.
Conclusions
Volpara and Quantra clearly differed from each other. However, there appeared to be a strong association of these measures with each other and with the BI-RADS density scale. Further research on the differences between the measures is needed before they can be implemented in breast cancer screening programmes. This applies both to the logistics surrounding breast density measurements and the role of breast density in screening programmes. If studies indeed show that breast density is important for evaluating performance or could be useful for risk stratification, then both Quantra and Volpara may be considered.
Supporting Information
S1 Fig. ROC analyses on predicting high density (BI-RADS c+d) with percent dense volume (a) and dense volume (b).
https://doi.org/10.1371/journal.pone.0136667.s001
(PDF)
S1 Table. Comparison of VDG and BI-RADS density classification (N, %).
https://doi.org/10.1371/journal.pone.0136667.s002
(PDF)
Acknowledgments
The authors thank the screening organisation (Foundation of Population Screening East) for providing the data.
Author Contributions
Conceived and designed the experiments: DW MB JT GH AV. Performed the experiments: DW JT GH KS RP. Analyzed the data: DW MB GH AV. Wrote the paper: DW MB AV JT GH KS RP.
References
- 1. van Gils CH, Otten JD, Verbeek AL, Hendriks JH. Mammographic breast density and risk of breast cancer: masking bias or causality? Eur J Epidemiol 1998;14:315–20. pmid:9690746
- 2. Boyd NF, Guo H, Martin LJ, Sun L, Stone J, Fishell E, et al. Mammographic density and the risk and detection of breast cancer. N Engl J Med 2007;356:227–36. pmid:17229950
- 3. McCormack VA, dos Santos Silva I. Breast density and parenchymal patterns as markers of breast cancer risk: a meta-analysis. Cancer Epidemiol Biomarkers Prev 2006;15:1159–69. pmid:16775176
- 4. Kerlikowske K. The mammogram that cried Wolfe. N Engl J Med 2007;356:297–300. pmid:17229958
- 5. Carney PA, Miglioretti DL, Yankaskas BC, Kerlikowske K, Rosenberg R, Rutter CM, et al. Individual and combined effects of age, breast density, and hormone replacement therapy use on the accuracy of screening mammography. Ann Intern Med 2003; 138:168–75. pmid:12558355
- 6. Schousboe JT, Kerlikowske K, Loh A, Cummings SR. Personalizing mammography by breast density and other risk factors for breast cancer: analysis of health benefits and cost-effectiveness. Ann Intern Med 2011;155:10–20. pmid:21727289
- 7. Wolfe JN. Breast patterns as an index of risk for developing breast cancer. AJR Am J Roentgenol 1976;126:1130–7. pmid:179369
- 8. Gram IT, Funkhouser E, Tabár L. The Tabár classification of mammographic parenchymal patterns. Eur J Radiol 1997;24:131–6. pmid:9097055
- 9.
Sickles EA, D’Orsi CJ, Bassett LW, et al (2013) ACR BI-RADS Mammography. In: ACR BI-RADS Atlas, Breast Imaging Reporting and Data System. American College of Radiology, Reston
- 10. Ciatto S, Houssami N, Apruzzese A, Bassetti E, Brancato B, Carozzi F, et al. Categorizing breast mammographic density: intra- and interobserver reproducibility of BI-RADS density categories. Breast 2005;14:269–75. pmid:16085233
- 11. Assi V, Warwick J, Cuzick J, Duffy SW. Clinical and epidemiological issues in mammographic density. Nat Rev Clin Oncol 2012;9:33–40.
- 12. Yaffe MJ. Mammographic density. Measurement of mammographic density. Breast Cancer Res 2008;10:209. pmid:18598375
- 13. Vachon CM, van Gils CH, Sellers TA, Ghosh K, Pruthi S, Brandt KR, et al. Mammographic density, breast cancer risk and risk prediction. Breast Cancer Res 2007;9:217. pmid:18190724
- 14. Wang J, Azziz A, Fan B, Malkov S, Klifa C, Newitt D, et al. Agreement of mammographic measures of volumetric breast density to MRI. Plos One 2013;8:e81653. pmid:24324712
- 15. Morrish OW, Tucker L, Black R, Willsher P, Duffy SW, Gilbert FJ. Mammographic Breast Density: Comparison of Methods for Quantitative Evaluation. Radiology 2015:141508.
- 16. Schmachtenberg C, Hammann-Kloss S, Bick U, Engelken F. Intraindividual Comparison of Two Methods of Volumetric Breast Composition Assessment. Acad Radiol Epub 2015 Jan 10.
- 17.
Hartman K, Highnam R, Warren R, Jackson V. Volumetric Assessment of Breast Tissue Composition from FFDM Images. In: Krupinski EA, editor. Lecture Notes in Computer Science: 9th International Workshop on Digital Mammography; 2008 Jul 20–23; Tucson, AZ, USA: Springer-Verlag; 2008. p. 33–9.
- 18. Ray KM, Price ER, Joe BN. Breast density legislation: mandatory disclosure to patients, alternative screening, billing, reimbursement. AJR Am J Roentgenol 2015;204:257–60. pmid:25615746
- 19. Ng KH, Yip CH, Taib NA. Standardisation of clinical breast-density measurement. Lancet Oncol. 2012;13:334–6. pmid:22469115
- 20. van Engeland S, Snoeren PR, Huisman H, Boetes C, Karssemeijer N. Volumetric breast density estimation from full-field digital mammograms. IEEE Trans Med Imaging 2006;25:273–82. pmid:16524084
- 21.
Highnam R, Brady M, Yaffe M, Karssemeijer N, Harvey J. Robust breast composition measures—Volpara. In: Martí J, Oliver A, Freixenet J, Martí R, editors. Lecture Notes in Computer Science: 10th International Workshop on Digital Mammography; 2010 Jun 16–18; Girona, Spain: Springer-Verlag; 2010. p. 651–8.
- 22. Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, et al. Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol 2011;64:96–106. pmid:21130355
- 23. de Vet HC, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol 2006;59:1033–9. pmid:16980142
- 24.
Fleiss JL, Levin BA, Paik MC. The Measurement of Interrater Agreement. In: Statistical methods for rates and proportions. Third edition. Hoboken (NJ): John Wiley & Sons; 2003. p. 598–626.
- 25. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159–74. pmid:843571
- 26.
Altman DG. Some common problems in medical research. In: Practical statistics in medical research. London, UK: Chapman and Hall; 1991. p. 404.
- 27.
Nunnally JC, Bernstein IH. Psychometric theory. Third edition. New York: New York, McGraw Hill; 1994.
- 28. Redondo A, Comas M, Macia F, Ferrer F, Murta-Nascimento C, Maristany MT, et al. Inter- and intraradiologist variability in the BI-RADS assessment and breast density categories for screening mammograms. Br J Radiol 2012;85:1465–70. pmid:22993385
- 29. Bernardi D, Pellegrini M, Di Michele S, Tuttobene P, Fanto C, Valentini M, et al. Interobserver agreement in breast radiological density attribution according to BI-RADS quantitative classification. Radiol Med 2012;117:519–28. pmid:22228132
- 30. Garrido-Estepa M, Ruiz-Perales F, Miranda J, Ascunce N, Gonzalez-Roman I, Sanchez-Contador C, et al. Evaluation of mammographic density patterns: reproducibility and concordance among scales. BMC Cancer 2010;10:485. pmid:20836850
- 31. Ooms EA, Zonderland HM, Eijkemans MJ, Kriege M, Mahdavian Delavary B, Burger CW, et al. Mammography: interobserver variability in breast density assessment. Breast 2007;16:568–76. pmid:18035541
- 32. Berg WA, Campassi C, Langenberg P, Sexton MJ. Breast Imaging Reporting and Data System: inter- and intraobserver variability in feature analysis and final assessment. AJR Am J Roentgenol 2000;174:1769–77. pmid:10845521
- 33. Ciatto S, Houssami N, Apruzzese A, Bassetti E, Brancato B, Carozzi F, et al. Reader variability in reporting breast imaging according to BI-RADS assessment categories (the Florence experience). Breast 2006;15:44–51. pmid:16076556
- 34. Kopans DB. Basic physics and doubts about relationship between mammographically determined tissue density and breast cancer risk. Radiology 2008;246:348–53. pmid:18227535
- 35. Gweon HM, Youk JH, Kim JA, Son EJ. Radiologist assessment of breast density by BI-RADS categories versus fully automated volumetric assessment. AJR Am J Roentgenol 2013;201:692–7. pmid:23971465
- 36.
Jeffreys M, Harvey J, Highnam R. Comparing a New Volumetric Breast Density Method (Volpara) to Cumulus. In: Martí J, Oliver A, Freixenet J, Martí R, editors. Lecture Notes in Computer Science: 10th International Workshop on Digital Mammography; 2010 Jun 16–18; Girona, Spain: Springer-Verlag; 2010. p. 408–13.
- 37. Seo JM, Ko ES, Han BK, Ko EY, Shin JH, Hahn SY. Automated volumetric breast density estimation: a comparison with visual assessment. Clin Radiol 2013;68:690–5. pmid:23434202
- 38. Gubern-Merida A, Kallenberg M, Platel B, Mann RM, Marti R, Karssemeijer N. Volumetric breast density estimation from full-field digital mammograms: a validation study. Plos One 2014;9:e85952. pmid:24465808
- 39. Ko SY, Kim EK, Kim MJ, Moon HJ. Mammographic density estimation with automated volumetric breast density measurement. Korean journal of radiology 2014;15:313–21. pmid:24843235
- 40. Regini E, Mariscotti G, Durando M, Ghione G, Luparia A, Campanino PP, et al. Radiological assessment of breast density by visual classification (BI-RADS) compared to automated volumetric digital software (Quantra): implications for clinical practice. Radiol Med 2014;119:741–9. pmid:24610166
- 41. Ciatto S, Bernardi D, Calabrese M, Durando M, Gentilini MA, Mariscotti G, et al. A first evaluation of breast radiological density assessment by QUANTRA software as compared to visual classification. Breast 2012;21:503–6. pmid:22285387
- 42. Eng A, Gallant Z, Shepherd J, McCormack V, Li J, Dowsett M, et al. Digital mammographic density and breast cancer risk: a case-control study of six alternative density assessment methods. Breast Cancer Res 2014;16:439. pmid:25239205
- 43. Park IH, Ko K, Joo J, Park B, Jung SY, Lee S, et al. High Volumetric Breast Density Predicts Risk for Breast Cancer in Postmenopausal, but not Premenopausal, Korean Women. Ann Surg Oncol 2014.
- 44. Brand JS, Czene K, Shepherd JA, Leifland K, Heddson B, Sundbom A, et al. Automated measurement of volumetric mammographic density: a tool for widespread breast cancer risk assessment. Cancer Epidemiol Biomarkers Prev 2014;23:1764–72. pmid:25012995
- 45. Lokate M, Kallenberg MG, Karssemeijer N, Van den Bosch MA, Peeters PH, Van Gils CH. Volumetric breast density from full-field digital mammograms and its association with breast cancer risk factors: a comparison with a threshold method. Cancer Epidemiol Biomarkers Prev 2010;19:3096–105. pmid:20921336
- 46. Schetter SE, Hartman TJ, Liao J, Richie JP, Prokopczyk B, DuBrock C, et al. Differential impact of body mass index on absolute and percent breast density: implications regarding their use as breast cancer risk biomarkers. Breast Cancer Res Treat 2014;146:355–63. pmid:24951269
- 47. Skippage P, Wilkinson L, Allen S, Roche N, Dowsett M, A'Hern R. Correlation of age and HRT use with breast density as assessed by Quantra. Breast J 2013;19:79–86. pmid:23230974