Skip to main content
Top
Published in: BMC Health Services Research 1/2006

Open Access 01-12-2006 | Research article

Estimation of Pap-test coverage in an area with an organised screening program: challenges for survey methods

Authors: Paolo Giorgi Rossi, Gennaro Esposito, Silvia Brezzi, Angela Brachini, Patrizio Raggi, Antonio Federici

Published in: BMC Health Services Research | Issue 1/2006

Login to get access

Abstract

Background

The cytological screening programme of Viterbo has completed the second round of invitations to the entire target population (age 25–64). From a public health perspective, it is important to know the Pap-test coverage rate and the use of opportunistic screening. The most commonly used study design is the survey, but the validity of self-reports and the assumptions made about non respondents are often questioned.

Methods

From the target population, 940 women were sampled, and responded to a telephone interview about Pap-test utilisation. The answers were compared with the screening program registry; comparing the dates of Pap-tests reported by both sources. Sensitivity analyses were performed for coverage over a 36-month period, according to various assumptions regarding non respondents.

Results

The response rate was 68%. The coverage over 36 months was 86.4% if we assume that non respondents had the same coverage as respondents, 66% if we assume they were not covered at all, and 74.6% if we adjust for screening compliance in the non respondents. The sensitivity and specificity of the question, "have you ever had a Pap test with the screening programme" were 84.5% and 82.2% respectively. The test dates reported in the interview tended to be more recent than those reported in the registry, but 68% were within 12 months of each other.

Conclusion

Surveys are useful tools to understand the effectiveness of a screening programme and women's self-report was sufficiently reliable in our setting, but the coverage estimates were strongly influenced by the assumptions we made regarding non respondents.
Appendix
Available only for authorised users
Literature
1.
go back to reference IARC Handbooks of Cancer Prevention: Cervix Cancer Screening. IARC, Lion. 2005, 10. IARC Handbooks of Cancer Prevention: Cervix Cancer Screening. IARC, Lion. 2005, 10.
2.
go back to reference The Council of the European Union, Council Recommendation of 2 December 2003 on cancer screening (2003/878/EC) Official Journal of the European Union 16.12.2003. The Council of the European Union, Council Recommendation of 2 December 2003 on cancer screening (2003/878/EC) Official Journal of the European Union 16.12.2003.
3.
go back to reference Bos AB, van Ballegooijen M, van Gessel-Dabekaussen AA, Habbema JD: Organised cervical cancer screening still leads to higher coverage than spontaneous screening in The Netherlands. Eur J Cancer. 1998, 34: 1598-1601. 10.1016/S0959-8049(98)00249-4.PubMedCrossRef Bos AB, van Ballegooijen M, van Gessel-Dabekaussen AA, Habbema JD: Organised cervical cancer screening still leads to higher coverage than spontaneous screening in The Netherlands. Eur J Cancer. 1998, 34: 1598-1601. 10.1016/S0959-8049(98)00249-4.PubMedCrossRef
4.
go back to reference Ministero della Sanità: Linee Guida elaborate dalla Commissione Oncologica Nazionale in applicazione di quanto previsto dal Piano Sanitario Nazionale per il triennio 1994–1996, relative all'azione programmata "prevenzione e Cura delle malattie oncologiche", concernenti l'organizzazione della prevenzione e dell'assistenza in oncologia. Gazzetta Ufficiale N. 127. 1/6/1996 Ministero della Sanità: Linee Guida elaborate dalla Commissione Oncologica Nazionale in applicazione di quanto previsto dal Piano Sanitario Nazionale per il triennio 1994–1996, relative all'azione programmata "prevenzione e Cura delle malattie oncologiche", concernenti l'organizzazione della prevenzione e dell'assistenza in oncologia. Gazzetta Ufficiale N. 127. 1/6/1996
5.
go back to reference Segnan N, Ronco G, Ciatto S: Cervical cancer screening in Italy. Eur J Cancer. 2000, 36: 2235-2239. 10.1016/S0959-8049(00)00316-6.PubMedCrossRef Segnan N, Ronco G, Ciatto S: Cervical cancer screening in Italy. Eur J Cancer. 2000, 36: 2235-2239. 10.1016/S0959-8049(00)00316-6.PubMedCrossRef
6.
go back to reference Ronco G, Iossa A, Naldoni C, Pilutti S, Anghinoni E, Zappa M, Dalla Palma P, Ciatto S, Segnan N: A first survey of organized cervical cancer screening programs in Italy. GISCi working group on organization and evaluation. Gruppo Italiano Screening Citologico. Tumori. 1998, 84: 624-630.PubMedCrossRef Ronco G, Iossa A, Naldoni C, Pilutti S, Anghinoni E, Zappa M, Dalla Palma P, Ciatto S, Segnan N: A first survey of organized cervical cancer screening programs in Italy. GISCi working group on organization and evaluation. Gruppo Italiano Screening Citologico. Tumori. 1998, 84: 624-630.PubMedCrossRef
7.
go back to reference ISTAT – Unit Struttura e dinamica sociale: Health interview survey: Health status and use of health services – Years 1999–2000. ISTAT, Roma. 2003 ISTAT – Unit Struttura e dinamica sociale: Health interview survey: Health status and use of health services – Years 1999–2000. ISTAT, Roma. 2003
8.
go back to reference Thornberry OT, Wilson RW, Golden PM: Health promotion data for the 1990 objectives. Estimates from the National Health Interview Survey of Health Promotion and Disease Prevention: United States, 1985. Adv Data. 1986, 1-16. 126 Thornberry OT, Wilson RW, Golden PM: Health promotion data for the 1990 objectives. Estimates from the National Health Interview Survey of Health Promotion and Disease Prevention: United States, 1985. Adv Data. 1986, 1-16. 126
9.
go back to reference Hoyo C, Ostbye T, Skinner CS, Yarnall KS, Chowdhary J: Reproducibility of self-reported Pap test utilization in middle-aged African-American women. Ethn Dis. 2005, 15 (1): 84-9.PubMed Hoyo C, Ostbye T, Skinner CS, Yarnall KS, Chowdhary J: Reproducibility of self-reported Pap test utilization in middle-aged African-American women. Ethn Dis. 2005, 15 (1): 84-9.PubMed
10.
go back to reference McPhee SJ, Nguyen TT, Shema SJ, Nguyen B, Somkin C, Vo P, Pasick R: Validation of recall of breast and cervical cancer screening by women in an ethnically diverse population. Prev Med. 2002, 35: 463-473. 10.1006/pmed.2002.1096.PubMedCrossRef McPhee SJ, Nguyen TT, Shema SJ, Nguyen B, Somkin C, Vo P, Pasick R: Validation of recall of breast and cervical cancer screening by women in an ethnically diverse population. Prev Med. 2002, 35: 463-473. 10.1006/pmed.2002.1096.PubMedCrossRef
11.
go back to reference Barratt A, Cockburn J, Smith D, Redman S: Reliability and validity of women's recall of mammographic screening. Aust N Z J Public Health. 2000, 24: 79-81.PubMedCrossRef Barratt A, Cockburn J, Smith D, Redman S: Reliability and validity of women's recall of mammographic screening. Aust N Z J Public Health. 2000, 24: 79-81.PubMedCrossRef
12.
go back to reference Newell S, Girgis A, Sanson-Fisher R, Ireland M: Accuracy of patients' recall of Pap and cholesterol screening. Am J Public Health. 2000, 90: 1431-1435.PubMedPubMedCentralCrossRef Newell S, Girgis A, Sanson-Fisher R, Ireland M: Accuracy of patients' recall of Pap and cholesterol screening. Am J Public Health. 2000, 90: 1431-1435.PubMedPubMedCentralCrossRef
13.
go back to reference McGovern PG, Lurie N, Margolis KL, Slater JS: Accuracy of self-report of mammography and Pap smear in a low-income urban population. Am J Prev Med. 1998, 14: 201-208. 10.1016/S0749-3797(97)00076-7.PubMedCrossRef McGovern PG, Lurie N, Margolis KL, Slater JS: Accuracy of self-report of mammography and Pap smear in a low-income urban population. Am J Prev Med. 1998, 14: 201-208. 10.1016/S0749-3797(97)00076-7.PubMedCrossRef
14.
go back to reference Bowman JA, Sanson-Fisher R, Redman S: The accuracy of self-reported Pap smear utilisation. Soc Sci Med. 1997, 44: 969-976. 10.1016/S0277-9536(96)00222-5.PubMedCrossRef Bowman JA, Sanson-Fisher R, Redman S: The accuracy of self-reported Pap smear utilisation. Soc Sci Med. 1997, 44: 969-976. 10.1016/S0277-9536(96)00222-5.PubMedCrossRef
15.
go back to reference Paskett ED, Tatum CM, Mack DW, Hoen H, Case LD, Velez R: Validation of self-reported breast and cervical cancer screening tests among low-income minority women. Cancer Epidemiol Biomarkers Prev. 1996, 5: 721-726.PubMed Paskett ED, Tatum CM, Mack DW, Hoen H, Case LD, Velez R: Validation of self-reported breast and cervical cancer screening tests among low-income minority women. Cancer Epidemiol Biomarkers Prev. 1996, 5: 721-726.PubMed
16.
go back to reference Hiatt RA, Perez-Stable EJ, Quesenberry C, Sabogal F, Otero-Sabogal R, McPhee SJ: Agreement between self-reported early cancer detection practices and medical audits among Hispanic and non-Hispanic white health plan members in northern California. Prev Med. 1995, 24: 278-285. 10.1006/pmed.1995.1045.PubMedCrossRef Hiatt RA, Perez-Stable EJ, Quesenberry C, Sabogal F, Otero-Sabogal R, McPhee SJ: Agreement between self-reported early cancer detection practices and medical audits among Hispanic and non-Hispanic white health plan members in northern California. Prev Med. 1995, 24: 278-285. 10.1006/pmed.1995.1045.PubMedCrossRef
17.
go back to reference Johnson CS, Archer J, Campos-Outcalt D: Accuracy of Pap smear and mammogram self-reports in a southwestern Native American tribe. Am J Prev Med. 1995, 11: 360-363.PubMedCrossRef Johnson CS, Archer J, Campos-Outcalt D: Accuracy of Pap smear and mammogram self-reports in a southwestern Native American tribe. Am J Prev Med. 1995, 11: 360-363.PubMedCrossRef
18.
go back to reference Montano DE, Phillips WR: Cancer screening by primary care physicians: a comparison of rates obtained from physician self-report, patient survey, and chart audit. Am J Public Health. 1995, 85: 795-800.PubMedPubMedCentralCrossRef Montano DE, Phillips WR: Cancer screening by primary care physicians: a comparison of rates obtained from physician self-report, patient survey, and chart audit. Am J Public Health. 1995, 85: 795-800.PubMedPubMedCentralCrossRef
19.
go back to reference Gordon NP, Hiatt RA, Lampert DI: Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst. 1993, 85: 566-570.PubMedCrossRef Gordon NP, Hiatt RA, Lampert DI: Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst. 1993, 85: 566-570.PubMedCrossRef
20.
go back to reference Whitman S, Lacey L, Ansell D, Chen EH, Dell J, Phillips CW: Do chart reviews and interviews provide the same information about breast and cervical cancer screening?. Int J Epidemiol. 1993, 22: 393-397.PubMedCrossRef Whitman S, Lacey L, Ansell D, Chen EH, Dell J, Phillips CW: Do chart reviews and interviews provide the same information about breast and cervical cancer screening?. Int J Epidemiol. 1993, 22: 393-397.PubMedCrossRef
21.
go back to reference Brown JB, Adams ME: Patients as reliable reporters of medical care process. Recall of ambulatory encounter events. Med Care. 1992, 30: 400-411.PubMedCrossRef Brown JB, Adams ME: Patients as reliable reporters of medical care process. Recall of ambulatory encounter events. Med Care. 1992, 30: 400-411.PubMedCrossRef
22.
go back to reference Bowman JA, Redman S, Dickinson JA, Gibberd R, Sanson-Fisher RW: The accuracy of Pap smear utilization self-report: a methodological consideration in cervical screening research. Health Serv Res. 1991, 26: 97-107.PubMedPubMedCentral Bowman JA, Redman S, Dickinson JA, Gibberd R, Sanson-Fisher RW: The accuracy of Pap smear utilization self-report: a methodological consideration in cervical screening research. Health Serv Res. 1991, 26: 97-107.PubMedPubMedCentral
23.
go back to reference Michielutte R, Dignan MB, Wells HB, Bahnson J, Smith M, Wooten R, Hale LN: Errors in reporting cervical screening among public health clinic patients. J Clin Epidemiol. 1991, 44: 403-408. 10.1016/0895-4356(91)90078-N.PubMedCrossRef Michielutte R, Dignan MB, Wells HB, Bahnson J, Smith M, Wooten R, Hale LN: Errors in reporting cervical screening among public health clinic patients. J Clin Epidemiol. 1991, 44: 403-408. 10.1016/0895-4356(91)90078-N.PubMedCrossRef
24.
25.
go back to reference Sogaard AJ, Selmer R, Bjertness E, Thelle D: The Oslo Health Study: The impact of self-selection in a large, population-based survey. Int J Equity Health. 2004, 3: 3-10.1186/1475-9276-3-3.PubMedPubMedCentralCrossRef Sogaard AJ, Selmer R, Bjertness E, Thelle D: The Oslo Health Study: The impact of self-selection in a large, population-based survey. Int J Equity Health. 2004, 3: 3-10.1186/1475-9276-3-3.PubMedPubMedCentralCrossRef
26.
go back to reference Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J: Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol. 2003, 13: 105-110. 10.1016/S1047-2797(02)00257-0.PubMedCrossRef Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J: Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol. 2003, 13: 105-110. 10.1016/S1047-2797(02)00257-0.PubMedCrossRef
27.
go back to reference Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M: Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001, 17: 991-999. 10.1023/A:1020016922473.PubMedCrossRef Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M: Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001, 17: 991-999. 10.1023/A:1020016922473.PubMedCrossRef
28.
go back to reference Etter JF, Perneger TV: Analysis of non-response bias in a mailed health survey. J Clin Epidemiol. 1997, 50: 1123-1128. 10.1016/S0895-4356(97)00166-2.PubMedCrossRef Etter JF, Perneger TV: Analysis of non-response bias in a mailed health survey. J Clin Epidemiol. 1997, 50: 1123-1128. 10.1016/S0895-4356(97)00166-2.PubMedCrossRef
29.
go back to reference Crombie IK, Orbell S, Johnston G, Robertson AJ, Kenicer M: Cervical screening: the optimum visit plan for contacting users and non-users in Scotland. J Epidemiol Community Health. 1994, 48: 586-589.PubMedPubMedCentralCrossRef Crombie IK, Orbell S, Johnston G, Robertson AJ, Kenicer M: Cervical screening: the optimum visit plan for contacting users and non-users in Scotland. J Epidemiol Community Health. 1994, 48: 586-589.PubMedPubMedCentralCrossRef
30.
go back to reference Diehr P, Koepsell TD, Cheadle A, Psaty BM: Assessing response bias in random-digit dialling surveys: the telephone-prefix method. Stat Med. 1992, 11: 1009-1021.PubMedCrossRef Diehr P, Koepsell TD, Cheadle A, Psaty BM: Assessing response bias in random-digit dialling surveys: the telephone-prefix method. Stat Med. 1992, 11: 1009-1021.PubMedCrossRef
31.
go back to reference Giorgi Rossi P, Federici A, Bartolozzi F, Farchi S, Borgia P, Guasticchi G: Understanding non-compliance to colorectal cancer screening: a case control study, nested in a randomised trial [ISRCTN83029072]. BMC Public Health. 2005, 5: 139-10.1186/1471-2458-5-139.PubMedPubMedCentralCrossRef Giorgi Rossi P, Federici A, Bartolozzi F, Farchi S, Borgia P, Guasticchi G: Understanding non-compliance to colorectal cancer screening: a case control study, nested in a randomised trial [ISRCTN83029072]. BMC Public Health. 2005, 5: 139-10.1186/1471-2458-5-139.PubMedPubMedCentralCrossRef
32.
go back to reference Giorgi Rossi P, Faustini A, Spadea T, Perucci CA: Choosing immunization coverage indicators at the local level. Eur J Epidemiol. 2004, 19: 979-985. 10.1007/s10654-004-5758-6.PubMedCrossRef Giorgi Rossi P, Faustini A, Spadea T, Perucci CA: Choosing immunization coverage indicators at the local level. Eur J Epidemiol. 2004, 19: 979-985. 10.1007/s10654-004-5758-6.PubMedCrossRef
33.
go back to reference Wolf HK, Kuulasmaa K, Tolonen H, Sans S, Molarius A, Eastwood BJ: WHO MONICA Project. Effect of sampling frames on response rates in the WHO MONICA risk factor surveys. Eur J Epidemiol. 2005, 20: 293-299. 10.1007/s10654-005-0600-3.PubMedCrossRef Wolf HK, Kuulasmaa K, Tolonen H, Sans S, Molarius A, Eastwood BJ: WHO MONICA Project. Effect of sampling frames on response rates in the WHO MONICA risk factor surveys. Eur J Epidemiol. 2005, 20: 293-299. 10.1007/s10654-005-0600-3.PubMedCrossRef
34.
go back to reference Tennant A, Badley EM: A confidence interval approach to investigating non-response bias and monitoring response to postal questionnaires. J Epidemiol Community Health. 1991, 45: 81-85.PubMedPubMedCentralCrossRef Tennant A, Badley EM: A confidence interval approach to investigating non-response bias and monitoring response to postal questionnaires. J Epidemiol Community Health. 1991, 45: 81-85.PubMedPubMedCentralCrossRef
35.
go back to reference Ronco G, Segnan N, Giordano L, Pilutti S, Senore C, Ponti A, Volante R: Interaction of spontaneous and organised screening for cervical cancer in Turin, Italy. Eur J Cancer. 1997, 33: 1262-1267. 10.1016/S0959-8049(97)00076-2.PubMedCrossRef Ronco G, Segnan N, Giordano L, Pilutti S, Senore C, Ponti A, Volante R: Interaction of spontaneous and organised screening for cervical cancer in Turin, Italy. Eur J Cancer. 1997, 33: 1262-1267. 10.1016/S0959-8049(97)00076-2.PubMedCrossRef
36.
go back to reference Ronco G, Senore C, Giordano L, Quadrino S, Ponti A, Segnan N: Who does Pap-test? The effect of one call program on coverage and determinants of compliance. Epidemiol Prev. 1994, 18: 218-223.PubMed Ronco G, Senore C, Giordano L, Quadrino S, Ponti A, Segnan N: Who does Pap-test? The effect of one call program on coverage and determinants of compliance. Epidemiol Prev. 1994, 18: 218-223.PubMed
37.
go back to reference Schofield MJ, Sanson-Fisher R, Halpin S, Redman S: Notification and follow-up of Pap test results: current practice and women's preferences. Prev Med. 1994, 23: 276-283. 10.1006/pmed.1994.1039.PubMedCrossRef Schofield MJ, Sanson-Fisher R, Halpin S, Redman S: Notification and follow-up of Pap test results: current practice and women's preferences. Prev Med. 1994, 23: 276-283. 10.1006/pmed.1994.1039.PubMedCrossRef
38.
go back to reference Thornberry OT, Wilson RW, Golden PM: Health promotion data for the 1990 objectives. Estimates from the National Health Interview Survey of Health Promotion and Disease Prevention: United States, 1985. Adv Data. 1-16. 1986 Sep 19, 126 Thornberry OT, Wilson RW, Golden PM: Health promotion data for the 1990 objectives. Estimates from the National Health Interview Survey of Health Promotion and Disease Prevention: United States, 1985. Adv Data. 1-16. 1986 Sep 19, 126
39.
go back to reference Centers for Disease Control (CDC): Pap smear screening – Behavioral Risk Factor Surveillance System, 1988. MMWR Morb Mortal Wkly Rep. 1989, 38: 777-779. Centers for Disease Control (CDC): Pap smear screening – Behavioral Risk Factor Surveillance System, 1988. MMWR Morb Mortal Wkly Rep. 1989, 38: 777-779.
40.
go back to reference van Ballegooijen M, van den Akker-van Marle E, Patnick J, Lynge E, Arbyn M, Anttila A, Ronco G, Dik J, Habbema F: Overview of important cervical cancer screening process values in European Union (EU) countries, and tentative predictions of the corresponding effectiveness and cost-effectiveness. Eur J Cancer. 2000, 36: 2177-2188. 10.1016/S0959-8049(00)00330-0.PubMedCrossRef van Ballegooijen M, van den Akker-van Marle E, Patnick J, Lynge E, Arbyn M, Anttila A, Ronco G, Dik J, Habbema F: Overview of important cervical cancer screening process values in European Union (EU) countries, and tentative predictions of the corresponding effectiveness and cost-effectiveness. Eur J Cancer. 2000, 36: 2177-2188. 10.1016/S0959-8049(00)00330-0.PubMedCrossRef
41.
go back to reference Abrami R, Cattaneo A: [Determinant factors for the use of screening for cervical cancer in Friuli Venezia Giulia]. Minerva Ginecol. 1999, 51: 335-341.PubMed Abrami R, Cattaneo A: [Determinant factors for the use of screening for cervical cancer in Friuli Venezia Giulia]. Minerva Ginecol. 1999, 51: 335-341.PubMed
42.
go back to reference Ravaioli A, Scarpellini M, Livi C, Monti F, Desiderio F, Tononi A, Nicolini M: Patterns of Pap smear use in the Rimini area: an analysis of women's attitudes to the test. Eur J Cancer Prev. 1993, 2: 307-312.PubMedCrossRef Ravaioli A, Scarpellini M, Livi C, Monti F, Desiderio F, Tononi A, Nicolini M: Patterns of Pap smear use in the Rimini area: an analysis of women's attitudes to the test. Eur J Cancer Prev. 1993, 2: 307-312.PubMedCrossRef
43.
go back to reference Perucci CA, Rapiti E, Davoli M, Lagorio S, Arca M, Miller AB: Rome women's screening study: knowledge, attitudes and practices of women regarding screening for breast and cervical cancer. Tumori. 1990, 76: 365-369.PubMedCrossRef Perucci CA, Rapiti E, Davoli M, Lagorio S, Arca M, Miller AB: Rome women's screening study: knowledge, attitudes and practices of women regarding screening for breast and cervical cancer. Tumori. 1990, 76: 365-369.PubMedCrossRef
44.
go back to reference Lawrence VA, De Moor C, Glenn ME: Systematic differences in validity of self-reported mammography behavior: A problem for intergroup comparisons?. Prev Med. 1999, 29: 577-580. 10.1006/pmed.1999.0575.PubMedCrossRef Lawrence VA, De Moor C, Glenn ME: Systematic differences in validity of self-reported mammography behavior: A problem for intergroup comparisons?. Prev Med. 1999, 29: 577-580. 10.1006/pmed.1999.0575.PubMedCrossRef
45.
go back to reference Barratt A, Cockburn J, Smith D, Redman S: Reliability and validity of women's recall of mammographic screening. Aust N Z J Public Health. 2000, 24: 79-81.PubMedCrossRef Barratt A, Cockburn J, Smith D, Redman S: Reliability and validity of women's recall of mammographic screening. Aust N Z J Public Health. 2000, 24: 79-81.PubMedCrossRef
Metadata
Title
Estimation of Pap-test coverage in an area with an organised screening program: challenges for survey methods
Authors
Paolo Giorgi Rossi
Gennaro Esposito
Silvia Brezzi
Angela Brachini
Patrizio Raggi
Antonio Federici
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2006
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-6-36

Other articles of this Issue 1/2006

BMC Health Services Research 1/2006 Go to the issue