Skip to main content
Top
Published in: European Radiology 5/2018

Open Access 01-05-2018 | Radiological Education

Fourteen years of progress testing in radiology residency training: experiences from The Netherlands

Authors: D. R. Rutgers, F. van Raamt, W. van Lankeren, C. J. Ravesloot, A. van der Gijp, Th. J. ten Cate, J. P. J. van Schaik

Published in: European Radiology | Issue 5/2018

Login to get access

Abstract

Objectives

To describe the development of the Dutch Radiology Progress Test (DRPT) for knowledge testing in radiology residency training in The Netherlands from its start in 2003 up to 2016.

Methods

We reviewed all DRPTs conducted since 2003. We assessed key changes and events in the test throughout the years, as well as resident participation and dispensation for the DRPT, test reliability and discriminative power of test items.

Results

The DRPT has been conducted semi-annually since 2003, except for 2015 when one digital DRPT failed. Key changes in these years were improvements in test analysis and feedback, test digitalization (2013) and inclusion of test items on nuclear medicine (2016). From 2003 to 2016, resident dispensation rates increased (Pearson’s correlation coefficient 0.74, P-value <0.01) to maximally 16 %. Cronbach´s alpha for test reliability varied between 0.83 and 0.93. The percentage of DRPT test items with negative item-rest-correlations, indicating relatively poor discriminative power, varied between 4 % and 11 %.

Conclusions

Progress testing has proven feasible and sustainable in Dutch radiology residency training, keeping up with innovations in the radiological profession. Test reliability and discriminative power of test items have remained fair over the years, while resident dispensation rates have increased.

Key Points

• Progress testing allows for monitoring knowledge development from novice to senior trainee.
• In postgraduate medical training, progress testing is used infrequently.
• Progress testing is feasible and sustainable in radiology residency training.
Literature
1.
2.
go back to reference Van der Vleuten CPM (2000) Validity of final examinations in undergraduate medical training. BMJ 321:1217–1219CrossRef Van der Vleuten CPM (2000) Validity of final examinations in undergraduate medical training. BMJ 321:1217–1219CrossRef
3.
go back to reference Freeman A, der Vleuten CPM V, Nouns Z, Ricketts C (2010) Progress testing internationally. Medical Teacher 32:451–455CrossRefPubMed Freeman A, der Vleuten CPM V, Nouns Z, Ricketts C (2010) Progress testing internationally. Medical Teacher 32:451–455CrossRefPubMed
4.
go back to reference Albanese M, Case SM (2016) Progress testing: critical analysis and suggested practices. Adv Health Sci Educ Theory Pract 21:221–234CrossRefPubMed Albanese M, Case SM (2016) Progress testing: critical analysis and suggested practices. Adv Health Sci Educ Theory Pract 21:221–234CrossRefPubMed
5.
go back to reference Van der Vleuten CPM, Verwijnen GM, Wijnen WHFW (1996) Fifteen years of experience with progress testing in a problem-based learning curriculum. Med Teach 18:103–109CrossRef Van der Vleuten CPM, Verwijnen GM, Wijnen WHFW (1996) Fifteen years of experience with progress testing in a problem-based learning curriculum. Med Teach 18:103–109CrossRef
7.
go back to reference McHarg J, Bradley P, Chamberlain S, Ricketts C, Searle J, McLachlan JC (2005) Assessment of progress tests. Med Educ 39:221–227CrossRefPubMed McHarg J, Bradley P, Chamberlain S, Ricketts C, Searle J, McLachlan JC (2005) Assessment of progress tests. Med Educ 39:221–227CrossRefPubMed
8.
go back to reference Ravesloot C, van der Schaaf M, Haaring C et al (2012) Construct validation of progress testing to measure knowledge and visual skills in radiology. Med Teach 34:1047–1055CrossRefPubMed Ravesloot C, van der Schaaf M, Haaring C et al (2012) Construct validation of progress testing to measure knowledge and visual skills in radiology. Med Teach 34:1047–1055CrossRefPubMed
9.
go back to reference Muijtjens AM, Mameren HV, Hoogenboom RJ, Evers JL, van der Vleuten CP (1999) The effect of a 'don't know' option on test scores: number-right and formula scoring compared. Med Educ 33:267–275CrossRefPubMed Muijtjens AM, Mameren HV, Hoogenboom RJ, Evers JL, van der Vleuten CP (1999) The effect of a 'don't know' option on test scores: number-right and formula scoring compared. Med Educ 33:267–275CrossRefPubMed
10.
11.
go back to reference Ravesloot CJ, van der Schaaf MF, van Schaik JP et al (2015) Volumetric CT-images improve testing of radiological image interpretation skills. Eur J Radiol 84:856-861 Ravesloot CJ, van der Schaaf MF, van Schaik JP et al (2015) Volumetric CT-images improve testing of radiological image interpretation skills. Eur J Radiol 84:856-861
12.
go back to reference Alderson PO, Becker GJ (2008) The new requirements and testing for American Board of Radiology certification in diagnostic radiology. Radiology 248:707–709CrossRefPubMed Alderson PO, Becker GJ (2008) The new requirements and testing for American Board of Radiology certification in diagnostic radiology. Radiology 248:707–709CrossRefPubMed
13.
go back to reference Ilyas S, Beatie A, Pettet G et al (2014) Junior Radiologists' Forum (JRF): National trainee survey. Clin Radiol 69:952–958CrossRefPubMed Ilyas S, Beatie A, Pettet G et al (2014) Junior Radiologists' Forum (JRF): National trainee survey. Clin Radiol 69:952–958CrossRefPubMed
14.
go back to reference Di Marco L, Conway WF, Chapin R (2015) Radiology Resident Education in France from Medical School Through Board Certification. J Am Coll Radiol 12:1097–1102CrossRefPubMed Di Marco L, Conway WF, Chapin R (2015) Radiology Resident Education in France from Medical School Through Board Certification. J Am Coll Radiol 12:1097–1102CrossRefPubMed
15.
go back to reference Dijksterhuis MG, Scheele F, Schuwirth LW, Essed GG, Nijhuis JG, Braat DD (2009) Progress testing in postgraduate medical education. Med Teach 31:e464–e468CrossRefPubMed Dijksterhuis MG, Scheele F, Schuwirth LW, Essed GG, Nijhuis JG, Braat DD (2009) Progress testing in postgraduate medical education. Med Teach 31:e464–e468CrossRefPubMed
16.
go back to reference van Leeuwen YD, Mol SS, Pollemans MC, van der Vleuten CP, Grol R, Drop MJ (1997) Selection for postgraduate training for general practice: the role of knowledge tests. Br J Gen Pract 47:359-362 van Leeuwen YD, Mol SS, Pollemans MC, van der Vleuten CP, Grol R, Drop MJ (1997) Selection for postgraduate training for general practice: the role of knowledge tests. Br J Gen Pract 47:359-362
17.
go back to reference Wrigley W, van der Vleuten CP, Freeman A, Muijtjens A (2012) A systemic framework for the progress test: strengths, constraints and issues: AMEE Guide No. 71. Med Teach 34:683–697CrossRefPubMed Wrigley W, van der Vleuten CP, Freeman A, Muijtjens A (2012) A systemic framework for the progress test: strengths, constraints and issues: AMEE Guide No. 71. Med Teach 34:683–697CrossRefPubMed
18.
20.
go back to reference Colliver JA, Conlee MJ, Verhulst SJ (2012) From test validity to construct validity ... and back? Med Educ 46:366–371CrossRefPubMed Colliver JA, Conlee MJ, Verhulst SJ (2012) From test validity to construct validity ... and back? Med Educ 46:366–371CrossRefPubMed
Metadata
Title
Fourteen years of progress testing in radiology residency training: experiences from The Netherlands
Authors
D. R. Rutgers
F. van Raamt
W. van Lankeren
C. J. Ravesloot
A. van der Gijp
Th. J. ten Cate
J. P. J. van Schaik
Publication date
01-05-2018
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 5/2018
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-017-5138-8

Other articles of this Issue 5/2018

European Radiology 5/2018 Go to the issue