Skip to main content
Top
Published in: Israel Journal of Health Policy Research 1/2016

Open Access 01-12-2016 | Original research article

A feasibility study to assess the validity of administrative data sources and self-reported information of breast cancer survivors

Authors: Rola Hamood, Hatem Hamood, Ilya Merhasin, Lital Keinan-Boker

Published in: Israel Journal of Health Policy Research | Issue 1/2016

Login to get access

Abstract

Background

Cancer survivorship has increasingly become the focus of research due to progress in early detection and advancements in the therapeutic approach, but high-quality information sources for outcomes, potential confounders and personal characteristics present a challenge. Few studies have collected breast cancer care data from mixed data sources and validated them, and to the best of our knowledge, none so far have been conducted in Israel, where National Health Insurance Law assures universal health care, delivered through four health care funds with computerized administrative, pharmaceutical and medical databases.
This validation study is aimed to assess the accuracy and completeness of information on cancer care and health outcomes using several research tools, before embarking on a full-scale study aimed to evaluate the long-term treatment-related health adverse outcomes in a cohort of breast cancer survivors.

Methods

One hundred twenty randomly sampled female patients diagnosed with primary breast cancer in years 2000–2010 in northern Israel, who are members of the “Leumit” healthcare fund, were included. Data sources included “Leumit” medical records, the National Cancer Registry and a self-report questionnaire. The questionnaire was completed by 99 % of the women contacted. The accuracy of the information regarding cancer care was assessed with the reference standard set as one of the research tools, varying per the characteristic being under investigation. For example: health outcomes and medical history were validated against “Leumit” medical records, while construct validity of the self-reported questionnaire served to assess the prevalence of chronic pain. Agreement, predictive values, correlations, and internal consistency were calculated. Logistic regression models were constructed to assess potential predictors of correct responses.

Results

The overall level of agreement (Kappa) was almost perfect for demographics and outcomes, above 0.8 for treatments and chronic pain, while only fair to moderate for most of the self-reported medical history. Correct responses of medical history were associated with Jewish ethnicity, recency of breast cancer diagnosis, and family history of cardiovascular disease. The internal consistency of the quality-of-life scale was above 0.9.

Conclusion

In the absence of a national registry for cancer care, a mixed methodology for data collection is the most complete source.

Trial registration

Trial registration number Not available. This is an observational study with prospective data collection and no intervention; therefore, trial registration number is not required.
Literature
1.
go back to reference Institute of Medicine, Hewitt ME, Sheldon G, Ellen S. From cancer patient to cancer survivor: Lost in transition. Washington: National Academies; 2006. Institute of Medicine, Hewitt ME, Sheldon G, Ellen S. From cancer patient to cancer survivor: Lost in transition. Washington: National Academies; 2006.
2.
go back to reference Barisic A, Glendon G, Weerasooriya N, Andrulis IL, Knight JA. Accuracy of self-reported breast cancer information among women from the Ontario site of the breast cancer family registry. J Cancer Epidemiol. 2012;2012:310804.CrossRefPubMedPubMedCentral Barisic A, Glendon G, Weerasooriya N, Andrulis IL, Knight JA. Accuracy of self-reported breast cancer information among women from the Ontario site of the breast cancer family registry. J Cancer Epidemiol. 2012;2012:310804.CrossRefPubMedPubMedCentral
3.
go back to reference Phillips KA, Milne RL, Buys S, Friedlander ML, Ward JH, McCredie MR, Giles GG, Hopper JL. Agreement between self-reported breast cancer treatment and medical records in a population-based breast cancer family registry. J Clin Oncol. 2005;23(21):4679–86.CrossRefPubMed Phillips KA, Milne RL, Buys S, Friedlander ML, Ward JH, McCredie MR, Giles GG, Hopper JL. Agreement between self-reported breast cancer treatment and medical records in a population-based breast cancer family registry. J Clin Oncol. 2005;23(21):4679–86.CrossRefPubMed
4.
go back to reference Liang SY, Phillips KA, Wang G, Keohane C, Armstrong J, Morris WM, Haas JS. Tradeoffs of using administrative claims and medical records to identify the use of personalized medicine for patients with breast cancer. Med Care. 2011;49(6):e1–8.CrossRefPubMedPubMedCentral Liang SY, Phillips KA, Wang G, Keohane C, Armstrong J, Morris WM, Haas JS. Tradeoffs of using administrative claims and medical records to identify the use of personalized medicine for patients with breast cancer. Med Care. 2011;49(6):e1–8.CrossRefPubMedPubMedCentral
5.
go back to reference Institute of Medicine (US) Roundtable on Value & Science-Driven Health Care Clinical data as the basic staple of health learning. Creating and protecting a public good: Workshop summary. Washington: National Academy of Sciences; 2010. Institute of Medicine (US) Roundtable on Value & Science-Driven Health Care Clinical data as the basic staple of health learning. Creating and protecting a public good: Workshop summary. Washington: National Academy of Sciences; 2010.
6.
go back to reference Malin JL, Kahn KL, Adams J, Kwan L, Laouri M, Ganz PA. Validity of cancer registry data for measuring the quality of breast cancer care. J Natl Cancer Inst. 2002;94(11):835–44.CrossRefPubMed Malin JL, Kahn KL, Adams J, Kwan L, Laouri M, Ganz PA. Validity of cancer registry data for measuring the quality of breast cancer care. J Natl Cancer Inst. 2002;94(11):835–44.CrossRefPubMed
7.
go back to reference Smith AW, Reeve BB, Bellizzi KM, Harlan LC, Klabunde CN, Amsellem M, Bierman AS, Hays RD. Cancer, comorbidities, and health-related quality of life of older adults. Health Care Financ Rev. 2008;29(4):41–56.PubMedPubMedCentral Smith AW, Reeve BB, Bellizzi KM, Harlan LC, Klabunde CN, Amsellem M, Bierman AS, Hays RD. Cancer, comorbidities, and health-related quality of life of older adults. Health Care Financ Rev. 2008;29(4):41–56.PubMedPubMedCentral
8.
go back to reference Butler Nattinger A, Schapira MM, Warren JL, Earle CC. Methodological issues in the use of administrative claims data to study surveillance after cancer treatment. Med Car. 2002;40(8 Suppl):IV-69-74. Butler Nattinger A, Schapira MM, Warren JL, Earle CC. Methodological issues in the use of administrative claims data to study surveillance after cancer treatment. Med Car. 2002;40(8 Suppl):IV-69-74.
9.
go back to reference Li X, Hilsden R, Hossain S, Fleming J, Winget M. Validation of administrative data sources for endoscopy utilization in colorectal cancer diagnosis. BMC Health Serv Res. 2012;12:358. 6963-12-358.CrossRefPubMedPubMedCentral Li X, Hilsden R, Hossain S, Fleming J, Winget M. Validation of administrative data sources for endoscopy utilization in colorectal cancer diagnosis. BMC Health Serv Res. 2012;12:358. 6963-12-358.CrossRefPubMedPubMedCentral
10.
go back to reference Malin JL, Schuster MA, Kahn KA, Brook RH. Quality of breast cancer care: what do we know? J Clin Oncol. 2002;20(21):4381–93.CrossRefPubMed Malin JL, Schuster MA, Kahn KA, Brook RH. Quality of breast cancer care: what do we know? J Clin Oncol. 2002;20(21):4381–93.CrossRefPubMed
13.
go back to reference Israel national health interview survey INHIS2, 2007–2010: Selected findings. Israel Center for Disease Control, Ministry of Health. Publication 331, Hebrew; 2012. Israel national health interview survey INHIS2, 2007–2010: Selected findings. Israel Center for Disease Control, Ministry of Health. Publication 331, Hebrew; 2012.
14.
go back to reference Hamood H, Hamood R, Green MS, Almog R. Effect of adherence to evidence-based therapy after acute myocardial infarction on all-cause mortality. Pharmacoepidemiol Drug Saf. 2015;24(10):1093–104.CrossRefPubMed Hamood H, Hamood R, Green MS, Almog R. Effect of adherence to evidence-based therapy after acute myocardial infarction on all-cause mortality. Pharmacoepidemiol Drug Saf. 2015;24(10):1093–104.CrossRefPubMed
15.
go back to reference Fishler Y, Chetrit A, Barchana M, Modan B. Estimation of completeness of The Cancer Registry in Israel. Ramat Gan: Israel Center for Disease Control, Ministry of Health; 2003. Fishler Y, Chetrit A, Barchana M, Modan B. Estimation of completeness of The Cancer Registry in Israel. Ramat Gan: Israel Center for Disease Control, Ministry of Health; 2003.
16.
go back to reference Moeller D. Building your automated bundled payment for an episode-of-care initiative. Am Health Drug Benefits. 2011;4(6):403–5.PubMedPubMedCentral Moeller D. Building your automated bundled payment for an episode-of-care initiative. Am Health Drug Benefits. 2011;4(6):403–5.PubMedPubMedCentral
17.
go back to reference Lewin-Epstein N, Sagiv-Schifter T, Shabtai EL, Shmueli A. Validation of the 36-item short-form health survey (Hebrew version) in the adult population of Israel. Med Care. 1998;36(9):1361–70.CrossRefPubMed Lewin-Epstein N, Sagiv-Schifter T, Shabtai EL, Shmueli A. Validation of the 36-item short-form health survey (Hebrew version) in the adult population of Israel. Med Care. 1998;36(9):1361–70.CrossRefPubMed
18.
go back to reference Fleiss JL. Statistical methods for rates and proportions. 3rd ed. New Jersey: Wiley; 2003.CrossRef Fleiss JL. Statistical methods for rates and proportions. 3rd ed. New Jersey: Wiley; 2003.CrossRef
19.
go back to reference Altman DG. Practical statistics for medical research. London: Chapman & Hall; 1991. Altman DG. Practical statistics for medical research. London: Chapman & Hall; 1991.
20.
go back to reference Agresti A, Coull B. Approximate is better than “exact” for interval estimation of binomial proportions. Am Stat. 1998;52(2):119–26. Agresti A, Coull B. Approximate is better than “exact” for interval estimation of binomial proportions. Am Stat. 1998;52(2):119–26.
21.
go back to reference Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRefPubMed Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRefPubMed
22.
go back to reference Krouwer JS, Monti KL. A simple, graphical method to evaluate laboratory assays. Eur J Clin Chem Clin Biochem. 1995;33(8):525–7.PubMed Krouwer JS, Monti KL. A simple, graphical method to evaluate laboratory assays. Eur J Clin Chem Clin Biochem. 1995;33(8):525–7.PubMed
23.
go back to reference Brestoff JR, Perry IJ, Van den Broeck J. Challenging the role of social norms regarding body weight as an explanation for weight, height, and BMI misreporting biases: Development and application of a new approach to examining misreporting and misclassification bias in surveys. BMC Public Health. 2011;11:331. 2458-11-331.CrossRefPubMedPubMedCentral Brestoff JR, Perry IJ, Van den Broeck J. Challenging the role of social norms regarding body weight as an explanation for weight, height, and BMI misreporting biases: Development and application of a new approach to examining misreporting and misclassification bias in surveys. BMC Public Health. 2011;11:331. 2458-11-331.CrossRefPubMedPubMedCentral
24.
go back to reference Helmstadter GC. Principles of psychological measurement. New York: Appleton; 1964. Helmstadter GC. Principles of psychological measurement. New York: Appleton; 1964.
25.
go back to reference Turner D, Hildebrand KJ, Fradette K, Latosinsky S. Same question, different data source, different answers? data source agreement for surgical procedures on women with breast cancer. Healthc Policy. 2007;3(1):46–54.PubMedPubMedCentral Turner D, Hildebrand KJ, Fradette K, Latosinsky S. Same question, different data source, different answers? data source agreement for surgical procedures on women with breast cancer. Healthc Policy. 2007;3(1):46–54.PubMedPubMedCentral
26.
go back to reference De-loyde KJ, Harrison JD, Durcinoska I, Shepherd HL, Solomon MJ, Young JM. Which information source is best? concordance between patient report, clinician report and medical records of patient co-morbidity and adjuvant therapy health information. J Eval Clin Pract. 2015;21(2):339–46.CrossRefPubMed De-loyde KJ, Harrison JD, Durcinoska I, Shepherd HL, Solomon MJ, Young JM. Which information source is best? concordance between patient report, clinician report and medical records of patient co-morbidity and adjuvant therapy health information. J Eval Clin Pract. 2015;21(2):339–46.CrossRefPubMed
27.
go back to reference Barber J, Muller S, Whitehurst T, Hay E. Measuring morbidity: self-report or health care records? Fam Pract. 2010;27(1):25–30.CrossRefPubMed Barber J, Muller S, Whitehurst T, Hay E. Measuring morbidity: self-report or health care records? Fam Pract. 2010;27(1):25–30.CrossRefPubMed
28.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
29.
go back to reference U.S. Preventive Services Task Force. Screening for lipid disorders in adults: recommendation statement. Am Fam Physician. 2009;80(11):1273–4. U.S. Preventive Services Task Force. Screening for lipid disorders in adults: recommendation statement. Am Fam Physician. 2009;80(11):1273–4.
30.
go back to reference Stuart AL, Williams LJ, Brennan SL, Kotowicz MA, Pasco JA. Poor agreement between self-reported diagnosis and bone mineral density results in the identification of osteoporosis. J Clin Densitom. 2015;18(1):13–6.CrossRefPubMed Stuart AL, Williams LJ, Brennan SL, Kotowicz MA, Pasco JA. Poor agreement between self-reported diagnosis and bone mineral density results in the identification of osteoporosis. J Clin Densitom. 2015;18(1):13–6.CrossRefPubMed
31.
go back to reference Masood Z, Shahzad S, Saqib A, Ashraf K. Osteopenia and osteoporosis; frequency among females. Professional Med J. 2014;21(3):477–83. Masood Z, Shahzad S, Saqib A, Ashraf K. Osteopenia and osteoporosis; frequency among females. Professional Med J. 2014;21(3):477–83.
32.
go back to reference Guthrie JR, Dennerstein L, Wark JD. Risk factors for osteoporosis: a review. Medscape Womens Health. 2000;5(4):E1.PubMed Guthrie JR, Dennerstein L, Wark JD. Risk factors for osteoporosis: a review. Medscape Womens Health. 2000;5(4):E1.PubMed
35.
go back to reference Smith SM, Balise RR, Norton C, Chen MM, Flesher AN, Guardino AE. A feasibility study to evaluate breast cancer patients’ knowledge of their diagnosis and treatment. Patient Educ Couns. 2012;89(2):321–9.CrossRefPubMedPubMedCentral Smith SM, Balise RR, Norton C, Chen MM, Flesher AN, Guardino AE. A feasibility study to evaluate breast cancer patients’ knowledge of their diagnosis and treatment. Patient Educ Couns. 2012;89(2):321–9.CrossRefPubMedPubMedCentral
36.
go back to reference Shapiro CL, Hardenbergh PH, Gelman R, Blanks D, Hauptman P, Recht A, Hayes DF, Harris J, Henderson IC. Cardiac effects of adjuvant doxorubicin and radiation therapy in breast cancer patients. J Clin Oncol. 1998;16(11):3493–501.CrossRefPubMed Shapiro CL, Hardenbergh PH, Gelman R, Blanks D, Hauptman P, Recht A, Hayes DF, Harris J, Henderson IC. Cardiac effects of adjuvant doxorubicin and radiation therapy in breast cancer patients. J Clin Oncol. 1998;16(11):3493–501.CrossRefPubMed
37.
go back to reference Kanis JA, Melton 3rd LJ, Christiansen C, Johnston CC, Khaltaev N. The diagnosis of osteoporosis. J Bone Miner Res. 1994;9(8):1137–41.CrossRefPubMed Kanis JA, Melton 3rd LJ, Christiansen C, Johnston CC, Khaltaev N. The diagnosis of osteoporosis. J Bone Miner Res. 1994;9(8):1137–41.CrossRefPubMed
38.
go back to reference Herman WH, Fajans SS. Hemoglobin A1c for the diagnosis of diabetes: practical considerations. Pol Arch Med Wewn. 2010;120(1–2):37–40.PubMed Herman WH, Fajans SS. Hemoglobin A1c for the diagnosis of diabetes: practical considerations. Pol Arch Med Wewn. 2010;120(1–2):37–40.PubMed
39.
go back to reference Kahan E, Kahan NR. The emerging role of electronic patient records in improving drug safety in Israel: a paradigm whose time has come. Archivos en Medicina Familiar. 2007;9(1):61–3. Kahan E, Kahan NR. The emerging role of electronic patient records in improving drug safety in Israel: a paradigm whose time has come. Archivos en Medicina Familiar. 2007;9(1):61–3.
40.
go back to reference Classification of chronic pain. Descriptions of chronic pain syndromes and definitions of pain terms. Prepared by the International Association for the Study of Pain, Subcommittee on Taxonomy. Pain Suppl. 1986;3:S1–226. Classification of chronic pain. Descriptions of chronic pain syndromes and definitions of pain terms. Prepared by the International Association for the Study of Pain, Subcommittee on Taxonomy. Pain Suppl. 1986;3:S1–226.
Metadata
Title
A feasibility study to assess the validity of administrative data sources and self-reported information of breast cancer survivors
Authors
Rola Hamood
Hatem Hamood
Ilya Merhasin
Lital Keinan-Boker
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Israel Journal of Health Policy Research / Issue 1/2016
Electronic ISSN: 2045-4015
DOI
https://doi.org/10.1186/s13584-016-0111-6

Other articles of this Issue 1/2016

Israel Journal of Health Policy Research 1/2016 Go to the issue