Skip to main content
Top
Published in: Perspectives on Medical Education 1/2012

Open Access 01-03-2012 | Review Article

The use of progress testing

Authors: Lambert W. T. Schuwirth, Cees P. M. van der Vleuten

Published in: Perspectives on Medical Education | Issue 1/2012

Login to get access

Abstract

Progress testing is gaining ground rapidly after having been used almost exclusively in Maastricht and Kansas City. This increased popularity is understandable considering the intuitive appeal longitudinal testing has as a way to predict future competence and performance. Yet there are also important practicalities. Progress testing is longitudinal assessment in that it is based on subsequent equivalent, yet different, tests. The results of these are combined to determine the growth of functional medical knowledge for each student, enabling more reliable and valid decision making about promotion to a next study phase. The longitudinal integrated assessment approach has a demonstrable positive effect on student learning behaviour by discouraging binge learning. Furthermore, it leads to more reliable decisions as well as good predictive validity for future competence or retention of knowledge. Also, because of its integration and independence of local curricula, it can be used in a multi-centre collaborative production and administration framework, reducing costs, increasing efficiency and allowing for constant benchmarking. Practicalities include the relative unfamiliarity of faculty with the concept, the fact that remediation for students with a series of poor results is time consuming, the need to embed the instrument carefully into the existing assessment programme and the importance of equating subsequent tests to minimize test-to-test variability in difficulty. Where it has been implemented—collaboratively—progress testing has led to satisfaction, provided the practicalities are heeded well.
Literature
1.
go back to reference Aarts R, Steidell K, Manuel BAF, Driessen EW. Progress testing in resource-poor countries: a case from Mozambique. Med Teach. 2010;32:461–3.PubMedCrossRef Aarts R, Steidell K, Manuel BAF, Driessen EW. Progress testing in resource-poor countries: a case from Mozambique. Med Teach. 2010;32:461–3.PubMedCrossRef
2.
go back to reference Bennett J, Freeman A, Coombs L, Kay L, Ricketts C. Adaptation of medical progress testing to a dental setting. Med Teach. 2010;32:500–2.PubMedCrossRef Bennett J, Freeman A, Coombs L, Kay L, Ricketts C. Adaptation of medical progress testing to a dental setting. Med Teach. 2010;32:500–2.PubMedCrossRef
3.
go back to reference Blake JM, Norman GR, Keane DR, Barber Mueller C, Cunnington J, Didyk N. Introducing progress testing in McMaster University’s problem-based medical curriculum: psychometric properties and effect on learning. Acad Med. 1996;71:1002–7.PubMedCrossRef Blake JM, Norman GR, Keane DR, Barber Mueller C, Cunnington J, Didyk N. Introducing progress testing in McMaster University’s problem-based medical curriculum: psychometric properties and effect on learning. Acad Med. 1996;71:1002–7.PubMedCrossRef
4.
go back to reference Freeman A, Van der Vleuten C, Nouns Z, Ricketts C. Progress testing internationally. Med Teach. 2010;32:451–5.PubMedCrossRef Freeman A, Van der Vleuten C, Nouns Z, Ricketts C. Progress testing internationally. Med Teach. 2010;32:451–5.PubMedCrossRef
5.
6.
go back to reference Schuwirth L, Bosman G, Henning R, Rinkel R, Wenink A. Collaboration on progress testing in medical schools in the Netherlands. Med Teach. 2010;32:476–9.PubMedCrossRef Schuwirth L, Bosman G, Henning R, Rinkel R, Wenink A. Collaboration on progress testing in medical schools in the Netherlands. Med Teach. 2010;32:476–9.PubMedCrossRef
7.
go back to reference Swanson D, Holtzman K, Butler A, et al. Collaboration across the pond: the multi-school progress testing project. Med Teach. 2010;32:480–5.PubMedCrossRef Swanson D, Holtzman K, Butler A, et al. Collaboration across the pond: the multi-school progress testing project. Med Teach. 2010;32:480–5.PubMedCrossRef
8.
go back to reference Van der Vleuten C, Schuwirth L, Muijtjens A, Thoben A, Cohen-Schotanus J, Van Boven C. Cross institutional collaboration in assessment: a case on progress testing. Med Teach. 2004;26:719–25.PubMedCrossRef Van der Vleuten C, Schuwirth L, Muijtjens A, Thoben A, Cohen-Schotanus J, Van Boven C. Cross institutional collaboration in assessment: a case on progress testing. Med Teach. 2004;26:719–25.PubMedCrossRef
9.
go back to reference Verhoeven B, Snellen-Balendong H, Hay I, et al. The versatility of progress testing assessed in an international context: a start for benchmarking global standardization? Med Teach. 2005;27:514–20.PubMedCrossRef Verhoeven B, Snellen-Balendong H, Hay I, et al. The versatility of progress testing assessed in an international context: a start for benchmarking global standardization? Med Teach. 2005;27:514–20.PubMedCrossRef
11.
go back to reference Van der Vleuten CPM, Verwijnen GM, Wijnen WHFW. Fifteen years of experience with progress testing in a problem-based learning curriculum. Med Teach. 1996;18:103–10.CrossRef Van der Vleuten CPM, Verwijnen GM, Wijnen WHFW. Fifteen years of experience with progress testing in a problem-based learning curriculum. Med Teach. 1996;18:103–10.CrossRef
12.
go back to reference Freeman A, Ricketts C. Choosing and designing knowledge assessments: experience at a new medical school. Med Teach. 2010;32:578–81.PubMedCrossRef Freeman A, Ricketts C. Choosing and designing knowledge assessments: experience at a new medical school. Med Teach. 2010;32:578–81.PubMedCrossRef
13.
go back to reference McHarg J, Bradley P, Chambelain S, Ricketts C, Searle J, McLachlan J. Assessment of progress tests. Med Educ. 2005;39:221–7.PubMedCrossRef McHarg J, Bradley P, Chambelain S, Ricketts C, Searle J, McLachlan J. Assessment of progress tests. Med Educ. 2005;39:221–7.PubMedCrossRef
14.
go back to reference Cohen-Schotanus J. Student assessment and examination rules. Med Teach. 1999;21:318–21.CrossRef Cohen-Schotanus J. Student assessment and examination rules. Med Teach. 1999;21:318–21.CrossRef
15.
go back to reference Norman G, Neville A, Blake J, Mueller B. Assessment steers learning down the right road: impact of progress testing on licensing examination performance. Med Teach. 2010;32:496–9.PubMedCrossRef Norman G, Neville A, Blake J, Mueller B. Assessment steers learning down the right road: impact of progress testing on licensing examination performance. Med Teach. 2010;32:496–9.PubMedCrossRef
16.
go back to reference Ricketts C, Freeman A, Coombes L. Standard setting for progress tests: combining external and internal standards. Med Educ. 2009;43:589–93.PubMedCrossRef Ricketts C, Freeman A, Coombes L. Standard setting for progress tests: combining external and internal standards. Med Educ. 2009;43:589–93.PubMedCrossRef
17.
go back to reference Verhoeven B, Verwijnen G, Scherpbier A, van der Vleuten C. Growth of medical knowledge. Med Educ. 2002;36:711–7.PubMedCrossRef Verhoeven B, Verwijnen G, Scherpbier A, van der Vleuten C. Growth of medical knowledge. Med Educ. 2002;36:711–7.PubMedCrossRef
18.
go back to reference Verhoeven BH, Verwijnen GM, Scherpbier AJJA, Schuwirth LWT, van der Vleuten CPM. Quality assurance in test construction: the approach of a multidisciplinary central test committee. Educ Health. 1999;12:49–60. Verhoeven BH, Verwijnen GM, Scherpbier AJJA, Schuwirth LWT, van der Vleuten CPM. Quality assurance in test construction: the approach of a multidisciplinary central test committee. Educ Health. 1999;12:49–60.
19.
go back to reference Albano MG, Cavallo F, Hoogenboom R, et al. An international comparison of knowledge levels of medical students: the Maastricht Progress Test. Med Educ. 1996;30:239–45.PubMedCrossRef Albano MG, Cavallo F, Hoogenboom R, et al. An international comparison of knowledge levels of medical students: the Maastricht Progress Test. Med Educ. 1996;30:239–45.PubMedCrossRef
20.
go back to reference van der Vleuten C, Schuwirth L. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–17.PubMedCrossRef van der Vleuten C, Schuwirth L. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–17.PubMedCrossRef
21.
go back to reference Langer M, Swanson D. Practical considerations in equating progress tests. Med Teach. 2010;32:509–12.PubMedCrossRef Langer M, Swanson D. Practical considerations in equating progress tests. Med Teach. 2010;32:509–12.PubMedCrossRef
22.
go back to reference Muijtjens A, Timmermans I, Donkers J, et al. Flexible electronic feedback using the virtues of progress testing. Med Teach. 2010;32:491–5.PubMedCrossRef Muijtjens A, Timmermans I, Donkers J, et al. Flexible electronic feedback using the virtues of progress testing. Med Teach. 2010;32:491–5.PubMedCrossRef
23.
go back to reference Muijtjens A, Schuwirth L, Cohen-Schotanus J, van der Vleuten C. Differences in knowledge development exposed by multi-curricular progress test data. Adv Health Sci Educ. 2008;13:593–605.CrossRef Muijtjens A, Schuwirth L, Cohen-Schotanus J, van der Vleuten C. Differences in knowledge development exposed by multi-curricular progress test data. Adv Health Sci Educ. 2008;13:593–605.CrossRef
24.
go back to reference Ricketts C, Moyeed R. Improving progress test score estimation using Bayesian statistics. Med Educ. 2011;45:570–7.PubMedCrossRef Ricketts C, Moyeed R. Improving progress test score estimation using Bayesian statistics. Med Educ. 2011;45:570–7.PubMedCrossRef
25.
go back to reference Schauber S, Nouns Z. Using the cumulative deviation method for cross-institutional benchmarking in the Berling progress test. Med Teach. 2010;32:471–5.PubMedCrossRef Schauber S, Nouns Z. Using the cumulative deviation method for cross-institutional benchmarking in the Berling progress test. Med Teach. 2010;32:471–5.PubMedCrossRef
26.
go back to reference Swanson DB, Norcini JJ. Factors influencing reproducibility of tests using standardized patients. Teach Learn Med. 1989;1:158–66.CrossRef Swanson DB, Norcini JJ. Factors influencing reproducibility of tests using standardized patients. Teach Learn Med. 1989;1:158–66.CrossRef
27.
go back to reference Van der Vleuten CPM, Swanson D. Assessment of clinical skills with standardized patients: state of the art. Teach Learn Med. 1990;2:58–76.CrossRef Van der Vleuten CPM, Swanson D. Assessment of clinical skills with standardized patients: state of the art. Teach Learn Med. 1990;2:58–76.CrossRef
28.
go back to reference Van der Vleuten CPM, Norman GR, De Graaf E. Pitfalls in the pursuit of objectivity: issues of reliability. Med Educ. 1991;25:110–8.PubMedCrossRef Van der Vleuten CPM, Norman GR, De Graaf E. Pitfalls in the pursuit of objectivity: issues of reliability. Med Educ. 1991;25:110–8.PubMedCrossRef
29.
go back to reference Ricketts C, Freeman A, Pagliuca G, Coombes L, Archer J. Difficult decisions for progress testing: how much and how often? Med Teach. 2010;32:513–5.PubMedCrossRef Ricketts C, Freeman A, Pagliuca G, Coombes L, Archer J. Difficult decisions for progress testing: how much and how often? Med Teach. 2010;32:513–5.PubMedCrossRef
30.
go back to reference Medema H. The effect of formula scoring versus number right scoring on partial knowledge and reliability in Progress testing. Maastricht: Department of Educational Development and Research, Maastricht University; 2010. p. 33. Medema H. The effect of formula scoring versus number right scoring on partial knowledge and reliability in Progress testing. Maastricht: Department of Educational Development and Research, Maastricht University; 2010. p. 33.
31.
go back to reference Muijtjens AMM, van Mameren H, Hoogenboom RJI, Evers JLH, Van der Vleuten C. The effect of a ‘don’t know’ option on test scores: number-right and formula scoring compared. Med Educ. 1999;33:267–75.PubMedCrossRef Muijtjens AMM, van Mameren H, Hoogenboom RJI, Evers JLH, Van der Vleuten C. The effect of a ‘don’t know’ option on test scores: number-right and formula scoring compared. Med Educ. 1999;33:267–75.PubMedCrossRef
32.
go back to reference Van Berkel HJM, Nuy HJP, Geerligs T. The influence of progress tests and block tests on study behaviour. Instr Sci. 1995;22:317–22.CrossRef Van Berkel HJM, Nuy HJP, Geerligs T. The influence of progress tests and block tests on study behaviour. Instr Sci. 1995;22:317–22.CrossRef
33.
go back to reference Van Til C. Voortgang in Voortgangstoetsing [Progress in Progress Testing]. Educational Research and Educational Development. University of Maastricht, Maastricht; 1998. Van Til C. Voortgang in Voortgangstoetsing [Progress in Progress Testing]. Educational Research and Educational Development. University of Maastricht, Maastricht; 1998.
34.
go back to reference Cilliers F, Schuwirth L, Herman N, Adendorff H, van der Vleuten C. A model of the sources, consequences and mechanism of impact of summative assessment on how students learn. Adv Health Sci Educ. 2011. Cilliers F, Schuwirth L, Herman N, Adendorff H, van der Vleuten C. A model of the sources, consequences and mechanism of impact of summative assessment on how students learn. Adv Health Sci Educ. 2011.
35.
go back to reference De Champlain A, Cuddy M, Scoles P, et al. Progress testing in clinical science education: results of a pilot project between the National Board of Medical Examiners and a US medical schools. Med Teach. 2010;32:503–8.PubMedCrossRef De Champlain A, Cuddy M, Scoles P, et al. Progress testing in clinical science education: results of a pilot project between the National Board of Medical Examiners and a US medical schools. Med Teach. 2010;32:503–8.PubMedCrossRef
36.
go back to reference Dijkstra J, Galbraith R, Hodges B, et al. Development and validation of guidelines for designing programmes of assessment: a modified Delphi-study, submitted. Dijkstra J, Galbraith R, Hodges B, et al. Development and validation of guidelines for designing programmes of assessment: a modified Delphi-study, submitted.
37.
go back to reference Dijkstra J, Van der Vleuten C, Schuwirth L. A new framework for designing programmes of assessment. Adv Health Sci Educ. 2010;15:379–93. Dijkstra J, Van der Vleuten C, Schuwirth L. A new framework for designing programmes of assessment. Adv Health Sci Educ. 2010;15:379–93.
Metadata
Title
The use of progress testing
Authors
Lambert W. T. Schuwirth
Cees P. M. van der Vleuten
Publication date
01-03-2012
Publisher
Bohn Stafleu van Loghum
Published in
Perspectives on Medical Education / Issue 1/2012
Print ISSN: 2212-2761
Electronic ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-012-0007-2

Other articles of this Issue 1/2012

Perspectives on Medical Education 1/2012 Go to the issue

Review Article

Workplace learning