INTERNATIONAL JOURNAL OF CHANGES IN EDUCATION
Research Article
May 24, 2024 1 1

Progress on Progress Test: International vs Local Experience

Abdul Sattar Khan 1 * ,
Abdulrahman AlMulhem 2,
Shereen Refaie 3,
Asma F. A. Dawood 3,
Glenda Angeles 3,
Jose Karlo Pangan 3
1 Family & Community Medicine Department, King Faisal University, Saudi Arabia2 Surgery Department, King Faisal University, Saudi Arabia3 Bio-Medical Science Department, King Faisal University, Saudi Arabia* Corresponding Author
International Journal of Changes in Education, 1(2), 2024, 57-62, https://doi.org/10.47852/bonviewIJCE42022373
Publication date: May 24, 2024
Full Text (PDF)

ABSTRACT

This paper discusses the implementation and evolution of progress testing as an assessment technique in problem-based learning at the College of Medicine, King Faisal University, in collaboration with the University of Groningen, Netherlands. Despite the successful introduction of a local progress test, this paper notes the reluctance of students in Arab culture to embrace this method due to concerns about its impact on their grade point average. The research outlines a 5-year experience with international high-stakes progress testing based on European universities and describes the establishment of a local progress test system. A cross-sectional study design was employed to analyze the passing rates of medical students from their first to fifth year, using data from 2018 to 2020. The study population included 1450 students with a gender distribution of 50/50. The results highlight two main achievements of the local progress test system. Firstly, the development of a blueprint based on block teaching contents and curriculum learning outcomes from year 1 to 5. This blueprint served as a foundation for the assessment. Secondly, the establishment of an individual performance feedback system, facilitated by a confidential online platform using students’ academic numbers. In conclusion, the research suggests that progress testing can be successfully integrated into Arab culture, serving as a comprehensive assessment tool. It emphasizes the importance of recognizing progress testing as a key knowledge assessment method in the curriculum. This paper provides insights into the process, compares international and local experiences, and offers recommendations for further improvement of the local progress testing system.

KEYWORDS

progress test GPA PBL assessment Arab culture

CITATION (APA)

Khan, A. S., AlMulhem, A., Refaie, S., Dawood, A. F. A., Angeles, G., & Pangan, J. K. (2024). Progress on Progress Test: International vs Local Experience. International Journal of Changes in Education, 1(2), 57-62. https://doi.org/10.47852/bonviewIJCE42022373
Harvard
Khan, A. S., AlMulhem, A., Refaie, S., Dawood, A. F. A., Angeles, G., and Pangan, J. K. (2024). Progress on Progress Test: International vs Local Experience. International Journal of Changes in Education, 1(2), pp. 57-62. https://doi.org/10.47852/bonviewIJCE42022373
Vancouver
Khan AS, AlMulhem A, Refaie S, Dawood AFA, Angeles G, Pangan JK. Progress on Progress Test: International vs Local Experience. International Journal of Changes in Education. 2024;1(2):57-62. https://doi.org/10.47852/bonviewIJCE42022373
AMA
Khan AS, AlMulhem A, Refaie S, Dawood AFA, Angeles G, Pangan JK. Progress on Progress Test: International vs Local Experience. International Journal of Changes in Education. 2024;1(2), 57-62. https://doi.org/10.47852/bonviewIJCE42022373
Chicago
Khan, Abdul Sattar, Abdulrahman AlMulhem, Shereen Refaie, Asma F. A. Dawood, Glenda Angeles, and Jose Karlo Pangan. "Progress on Progress Test: International vs Local Experience". International Journal of Changes in Education 2024 1 no. 2 (2024): 57-62. https://doi.org/10.47852/bonviewIJCE42022373
MLA
Khan, Abdul Sattar et al. "Progress on Progress Test: International vs Local Experience". International Journal of Changes in Education, vol. 1, no. 2, 2024, pp. 57-62. https://doi.org/10.47852/bonviewIJCE42022373

REFERENCES

  1. Freeman, A., van der Vleuten, C., Nouns, Z., & Ricketts, C. (2010). Progress testing internationally. Medical Teacher, 32(6), 451–455. https://doi.org/10.3109/0142159X.2010.485231
  2. Verhoeven, B. H. (2003). Progress testing: The utility of an assessment concept. PhD Thesis, Maastricht University. https://doi.org/10.26481/dis.20030425bv
  3. Freeman, A. C., & Ricketts, C. (2010). Choosing and designing knowledge assessments: Experience at a new medical school. Medical Teacher, 32(7), 578–581. https://doi.org/10.3109/01421591003614858
  4. Blake, J. M., Norman, G. R., Keane, D. R., Mueller, C. B., Cunnington, J., & Didyk, N. (1996). Introducing progress testing in McMaster University’s problem-based medical curriculum: Psychometric properties and effect on learning. Academic Medicine, 71(9), 1002–1007. https://doi.org/10.1097/00001888-199609000-00016
  5. Tio, R. A., Schutte, B., Meiboom, A. A., Greidanus, J., Dubois, E. A., Bremers, A. J. A., & Dutch Working Group of the Interuniversity Progress Test of Medicine. (2016). The progress test of medicine: The Dutch experience. Perspectives on Medical Education, 5(1), 51–55. https://doi.org/10.1007/s40037-015-0237-1
  6. Khan, A. S. (2018). ‘Spoon-fed’ versus self-directed learning in an Arab context. Sultan Qaboos University Medical Journal, 18(2), e247–248. https://doi.org/10.18295/squmj.2018.18.02.025
  7. Dehler, G. E., & Welsh, M. A. (2014). Against spoon-feeding. For learning. Reflections on students’ claims to knowledge. Journal of Management Education, 38(6), 875–893. https://doi.org/10.1177/1052562913511436
  8. Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2012). The use of progress testing. Perspectives on Medical Education, 1(1), 24–30. https://doi.org/10.1007/s40037-012-0007-2
  9. Wagener, S., Möltner, A., Tımbıl, S., Gornostayeva, M., Schultz, J. H., Brüstle, P., ..., & Jünger, J. (2015). Development of a competency-based formative progress test with student-generated MCQs: Results from a multi-centre pilot study. GMS Journal for Medical Education, 32(4). https://doi.org/10.3205/zma000988
  10. Chen, Y., Henning, M., Yielder, J., Jones,R., Wearn, A., & Weller, J. (2015). Progress testing in the medical curriculum: Students’ approaches to learning and perceived stress. BMC Medical Education, 15(1), 147. https://doi.org/10.1186/s12909-015-0426-y
  11. Bhakta, B., Tennant, A., Horton, M., Lawton, G., & Andrich, D. (2005). Using item response theory to explore the psychometric properties of extended matching questions examination in undergraduate medical education. BMC Medical Education, 5(1), 9. https://doi.org/10.1186/1472-6920-5-9
  12. Cecilio-Fernandes, D., Nagtegaal, M., Noordzij, G., & Tio, R. A. (2018). Cumulative assessment: Does it improve students’ knowledge acquisition and retention? Scientia Medica, 28(4), 31880.
  13. Pinheiro, O. L., Spadella, M. A., Moreira, H. M., Ribeiro, Z. M. T., Guimarães, A. P. C., Almeida Filho, O. M., & Hafner, M. D. L. M. B. (2015). Teste de Progresso: Uma ferramenta avaliativa para a gestão acadêmica. Revista Brasileira de Educação Médica, 39(1), 68–78. https://doi.org/10.1590/1981-52712015v39n1e02182013
  14. Sakai, M. H., Ferreira Filho, O. F., & Matsuo, T. (2011). Avaliação do crescimento cognitivo do estudante de medicina: Aplicação do teste de equalização no teste de progresso. Revista Brasileira de Educação Médica, 35(4), 493–501.
  15. McHarg, J., Bradley, P., Chamberlain, S., Ricketts, C., Searle, J., & McLachlan, J. C. (2005). Assessment of progress tests. Medical Education, 39(2), 221–227. https://doi.org/10.1111/j.1365-2929.2004.02060.x
  16. van der Vleuten, C. P. M., Verwijnen, G. M., & Wijnen, W. H. F. W. (1996). Fifteen years of experience with progress testing in a problem-based learning curriculum. Medical Teacher, 18(2), 103–109. https://doi.org/10.3109/01421599609034142
  17. Arnold, L., & Willoughby, T. L. (1990). The quarterly profile examination. Academic Medicine, 65(8), 515–516. https://doi.org/10.1097/00001888-199008000-00005
  18. Swanson, D. B., & Norcini, J. J. (1989). Factors influencing reproducibility of tests using standardized patients. Teaching and Learning in Medicine, 1(3), 158–166. https://doi.org/10.1080/10401338909539401
  19. van der Vleuten, C. P. M., & Swanson, D. B. (1990). Assessment of clinical skills with standardized patients: State of the art. Teaching and Learning in Medicine, 2(2), 58–76. https://doi.org/10.1080/10401339009539432
  20. Finucane, P., Flannery, D., Keane, D., & Norman, G. (2010). Cross-institutional progress testing: Feasibility and value to a new medical school. medical education, 44(2), 184–186. https://doi.org/10.1111/j.1365-2923.2009.03567.x
  21. Mookherjee, S., Chang, A., Boscardin, C. K., & Hauer, K. E. (2013). How to develop a competency-based examination blueprint for longitudinal standardized patient clinical skills assessments. Medical Teacher, 35(11), 883–890. https://doi.org/10.3109/0142159X.2013.809408
  22. Evans, C. (2013). Making sense of assessment feedback in higher education. Review of Educational Research, 83(1), 70–120. https://doi.org/10.3102/0034654312474350
  23. Alfarhan, M., Khan, A. S., & Aldossary, S. (2019). Progress testing in medical education still a dilemma in Arab culture. Unpublished manuscript.
  24. Frambach, J. M., Driessen, E. W., Chan, L. C., & van der Vleuten, C. P. (2012). Rethinking the globalisation of problem-based learning: How culture challenges selfdirected learning. medical education, 46(8), 738–747. https://doi.org/10.1111/j.1365-923.2012.04290.x

LICENSE

Creative Commons License
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.