Validity Evidence for a Bovine Uterine Prolapse Reduction Model and Rubric for Use in Teaching and Low-Stakes Assessment of Veterinary Students
Publication: Journal of Veterinary Medical Education
Advance Access
Abstract
Bovine uterine prolapse is a common but emergent condition typically arising in the time surrounding calving. Without treatment, it can result in tissue trauma, infection, hemorrhage, and death. Teaching veterinary students to perform uterine prolapse reduction has historically been dependent upon adequate clinical caseload requiring the procedure. This study sought to develop and collect validation evidence for a silicone bovine uterine prolapse reduction model and associated scoring rubric to enable procedural practice without the presentation of live animals requiring the procedure. This study utilized a validation framework consisting of content evidence (expert opinion), internal structure evidence (reliability of scores produced by the rubric), and relationship with other variables evidence (level of training, novice-to-expert comparison). Veterinary students (n = 37, novices) and veterinarians (n = 11, experts) performed the procedure on the model while being video recorded. All participants then completed a survey about the model. Veterinarians’ survey results indicated that the model adequately represented the task and was suitable for teaching and assessing veterinary students’ skill in the procedure (content evidence). Scores produced by the rubric had a marginal Cronbach's alpha (.607), suggesting that the rubric may be adequate for low-stakes assessment but would require additional items or modification in order to improve reliability and be suitable for high-stakes assessment (internal structure evidence). Finally, experts achieved higher total rubric scores than novices did (relationship with other variables evidence). This study demonstrated content evidence and relationship with other variables evidence for the bovine uterine prolapse model, indicating its usefulness for teaching this important clinical skill.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Miesner MD, Anderson D. Vaginal and uterine prolapse. In: Anderson DE, Rings DM, editors. Current veterinary therapy food animal practice. St. Louis: Saunders Elsevier; 2017.
2.
Risco CA, Reynolds JP, Hird D. Uterine prolapse and hypocalcemia in dairy cows. J Am Vet Med Assoc. 1984;185(12):1517–9.
3.
Carluccio A, De Amicis I, Probo M, Giangaspero B, Veronesi MC. Prevalence, survival, and subsequent fertility of dairy and beef cows with uterine prolapse. Acta Vet Hung. 2020;68(1):91–4. https://doi.org/10.1556/004.2020.00017.
4.
AAVMC Council on Outcomes-based Veterinary Education, Chaney KP, Hodgson JL, Banse HE, Danielson JA, Foreman JH, et al. CBVE 2.0 Model [Internet]. Washington, DC; 2024 [cited 2024 Oct 31]. Available from: https://cbve.org/cbve-20
5.
Morin DE, Constable PD, Troutt HF, Johnson AL. Surgery, anesthesia, and restraint skills expected of entry-level veterinarians in bovine practice. J Am Vet Med Assoc. 2002;221(7):969–74. https://doi.org/10.2460/javma.2002.221.969.
6.
Wood S, Sellers E, Vallis R, Baillie S. Prioritising practical skills for farm animal veterinary graduates using a Delphi technique. Vet Rec. 2023;192(8):e2643. https://doi.org/10.1002/vetr.2643.
7.
Larkin M. US veterinary colleges increase seats at accelerating rate [Internet]. AVMA News. 2023 [cited 2024 May 15]. Available from: https://www.avma.org/news/us-veterinary-colleges-increase-seats-accelerating-rate
8.
Hunt J, Simons M, Anderson S. If you build it, they will learn: a review of models in veterinary surgical education. Vet Surg. 2022;51(1):52–61. https://doi.org/10.1111/vsu.13683.
9.
Dilly M, Read EK, Baillie S. A survey of established veterinary clinical skills laboratories from Europe and North America: present practices and recent developments. J Vet Med Educ. 2017;44(4):580–9. https://doi.org/10.3138/jvme.0216-030R1.
10.
Baillie S, Dilly M, Ciappesoni JL, Read E. The rapid and international expansion of veterinary clinical skills laboratories: a survey to establish recent developments. J Vet Med Educ. 2023;51(3):e20220113.
11.
Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79:S70–81. https://doi.org/10.1097/00001888-200410001-00022.
12.
Ericsson KA, Krampe RT, Tesch-Römer C. Development of elite performance and deliberate practice. Psychol Rev. 1993;100(3):363–406. https://doi.org/10.1037/0033-295X.100.3.363.
13.
Russell WMS, Burch RL, Hume CW. The principles of humane experimental technique. London: Methuen; 1959.
14.
AAVMC Task Force on the Use of Animals in Education, Hunt JA, Baillie S, Beaver BV, Carey AMJ, Cary JA, et al. Guidelines for the use of animals in veterinary education [Internet]. Washington DC; 2022 [cited 2024 Oct 16]. Available from: https://www.aavmc.org/wp-content/uploads/2023/05/AAVMC-Guidelines-AnimalUse.pdf
15.
Gibbons P, Koziol J, Root C, Chambers C, Awosile B, Dascanio J. Development and validation of a uterine prolapse, epidural, and vaginal suture model. J Vet Med Educ. 2023;51(6):e20230062.
16.
Eignor D. The standards for educational and psychological testing. In: Geisinger K, Bracken B, Carlson J, Hansen J, Kuncel N, Reise S, et al., editors. APA handbook of testing and assessment in psychology. Vol 1: Test theory and testing and assessment in industrial and organizational psychology. Washington, DC: American Psychological Association; 2013. p. 245–50.
17.
American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Commission on Standards for Educational and Psychological Testing. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 2014.
18.
Cook D, Beckman T. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119(2):166.e7–166.e16. https://doi.org/10.1016/j.amjmed.2005.10.036.
19.
Kane M. An argument-based approach to validity. Psychol Bull. 1992;112(3):527. https://doi.org/10.1037/0033-2909.112.3.527.
20.
Kane MT. The argument-based approach to validation. Soc Psychol Rev. 2013;42:448–57.
21.
Trantham N, Kelly C, Hunt JA, Bonnema H, Stephens S, Miller LMJ. Development and validation of a bovine coccygeal venipuncture model and rubric. J Vet Med Educ. 2024; 51(2):in press.
22.
Hunt J, Rogers-Scarlett S, Schmidt P, Thompson R, Gilley A, Devine E, et al. Validation of a rubric used for skills-based assessment of veterinary students performing simulated ovariohysterectomy on a model. J Vet Med Educ. 2022;50(3):3271–336.
23.
Bonnema H, Kelly C, Hunt J, Trantham N, Miller L. Can a simple model have value without validation? A study to develop and (attempt to) validate a bovine caudal epidural model and rubric. J Vet Med Educ. 2024; 51(2):In press.
24.
Hunt JA, Heydenburg M, Kelly CK, Anderson SL, Dascanio JJ. Development and validation of a canine castration model and rubric. J Vet Med Educ. 2020;47(1):78–90. https://doi.org/10.3138/jvme.1117-158r1.
25.
Williamson JA, Farrell R, Skowron C, Brisson BA, Anderson S, Spangler D, et al. Evaluation of a method to assess digitally recorded surgical skills of novice veterinary students. Vet Surg. 2018;47(3):378–84. https://doi.org/10.1111/vsu.12772.
26.
Williamson JA. Construct validation of a small-animal thoracocentesis simulator. J Vet Med Educ. 2014;41(4):384–9. https://doi.org/10.3138/jvme.0314-037R.
27.
Williamson J, Hughes C, Asciutto M, Johnson J. Development and validation of a feline medial saphenous venipuncture model and rubric. J Vet Med Educ. 2020;47(3):333–41.
28.
Hunt JA, Heydenburg M, Kelly CK, Anderson SL, Dascanio JJ. Development and validation of a canine castration model and rubric. J Vet Med Educ. 2020;47(1):78–90. https://doi.org/10.3138/jvme.1117-158r1.
29.
Anderson S, Miller L, Gibbons P, Hunt J, Roberson J, Raines J, et al. Development and validation of a bovine castration model and rubric. J Vet Med Educ. 2021;48(1):96–104. https://doi.org/10.3138/jvme.2018-0016.
30.
Gibbons P, Devine E, Dutton D, Pulliam T, Anderson S, Hunt J. Development and validation of an ovine caesarean section model and rubric. Clin Theriogenol. 2022;14(4):348–55. https://doi.org/10.58292/ct.v14i4.9170.
31.
Noyes J, Carbonneau K, Matthew S. Comparative effectiveness of training with simulators versus traditional instruction in veterinary education: meta-analysis and systematic review. J Vet Med Educ. 2022;49(1):25–38. https://doi.org/10.3138/jvme-2020-0026.
32.
Bauer M. A survey of the use of live animals, cadavers, inantimate models, and computers in teaching veterinary surgery. J Am Vet Med Assoc. 1993;203(7):1047–51. https://doi.org/10.2460/javma.1993.203.07.1047.
33.
Duvivier RJ, Dalen J Van, Muijtjens AM, Moulaert VRMP, van der Vleuten CPM. The role of deliberate practice in the acquisition of clinical skills. BMC Med Educ. 2011;11(1):1–7. https://doi.org/10.1186/1472-6920-11-101.
34.
Langebaek R, Eika B, Jensen A, Tanggaard L, Toft N, Berendt M. Anxiety in veterinary surgical students: a quantitative study. J Vet Med Educ. 2012;39(4):331–40. https://doi.org/10.3138/jvme.1111-111R1.
35.
Annandale A, Scheepers E, Fosgate GT. The effect of an ovariohysterectomy model practice on surgical times for final-year veterinary students’ first live-animal ovariohysterectomies. J Vet Med Educ. 2020;47(1):44–55. https://doi.org/10.3138/jvme.1217-181r1.
36.
European Association of Establishments for Veterinary Education. European System of Evaluation of Veterinary Training (ESEVT): standard operating procedure 2023, Standard 6.1 [Internet]. 2023 Jun [cited 2024 Apr 17]. Available from: https://www.eaeve.org/fileadmin/downloads/SOP/ESEVT_SOP_2023_adopted_by_the_36th_GA_in_Leipzig_on_8_June_2023.pdf
37.
Schout BMA, Hendrikx AJM, Scheele F, Bemelmans BLH, Scherpbier AJJA. Validation and implementation of surgical simulators: a critical review of present, past, and future. Surg Endosc. 2010;24:536–46. https://doi.org/10.1007/s00464-009-0634-9
38.
Read E, Vallevand A, Farrell R. Evaluation of veterinary student surgical skills preparation for ovariohysterectomy using simulators: a pilot study. J Vet Med Educ. 2016;43(2):190–213. https://doi.org/10.3138/jvme.0815-138R1.
39.
Baillie S, Christopher R, Catterall A, Kruydenberg A, Lawrenson K, Wonham K, et al. Comparison of a silicon skin pad and a tea towel as models for learning a simple interrupted suture. J Vet Med Educ. 2019;47(4):516–22. https://doi.org/10.3138/jvme.2018-0001.
40.
Williamson JA, Brisson BA, Anderson SL, Farrell RM, Spangler D. Comparison of 2 canine celiotomy closure models for training novice veterinary students. Vet Surg. 2019;48:966–74. https://doi.org/10.1111/vsu.13224.
41.
Hunt J, Schmidt P, Perkins J, Newton G, Anderson S. Comparison of three canine models for teaching veterinary dental cleaning. J Vet Med Educ. 2021;48(5):573–83. https://doi.org/10.3138/jvme-2020-0001.
42.
Tavakol M, Dennick R. Making sense of Cronbach's alpha. Int J Med Educ. 2011;2:53–5.
43.
George D, Mallery P. SPSS for Windows step by step: a simple guide and reference. 11.0 update. Boston: Allyn & Bacon; 2003.
44.
Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
45.
Schrepp M. On the usage of Cronbach's alpha to measure reliability of UX scales. J Usability Stud. 2020;15(4):247–58.
46.
Devine E, McCracken M, Miller L, Miller D, Anderson SL, Hunt JA. Development and validation of an equine castration model and rubric. J Vet Med Educ. 2023;51(6):834–43.
47.
Cook DA. Much ado about differences: why expert-novice comparisons add little to the validity argument. Adv Health Sci Educ. 2015;20(3):829–34. https://doi.org/10.1007/s10459-014-9551-3.
48.
Hunt J, Anderson S, White J, Kelly C, Spangler D. The impact of extracurricular surgical experience on veterinary students’ performance of canine ovariohysterectomy and orchidectomy in a clinical skills curriculum. J Vet Med Educ. 2021;48(1):105–14. https://doi.org/10.3138/jvme.2019-0008.
49.
Farrell R, Gilbert G, Betance L, Huck J, Hunt J, Dundas J, et al. Evaluating validity evidence for two assessment instruments developed to assess students’ surgical skills in a simulated environment. Vet Surg. 2022;51(5):788–800. https://doi.org/10.1111/vsu.13791.
50.
Tan J-Y, Ma IWY, Hunt JA, Kwong GPS, Farrell R, Bell C, et al. Video recording in veterinary medicine OSCEs: feasibility and inter-rater agreement between live performance examiners and video recording reviewing examiners. J Vet Med Educ. 2021;48(4):485–91. https://doi.org/10.3138/jvme-2019-0142.
51.
Williamson JA, Dascanio JJ, Christmann U, Johnson JW, Rohleder B, Titus L. Development and validation of a model for training equine phlebotomy and intramuscular injection skills. J Vet Med Educ. 2016;43(3):235–42. https://doi.org/10.3138/jvme.0915-159R.
Information & Authors
Information
Published In
Journal of Veterinary Medical Education
Advance Access • 1 February 2025
Copyright
© American Association of Veterinary Medical Colleges (AAVMC), 2025. For their own personal use, users may read, download, print, search, or link to the full text. Manuscripts published in the Journal of Veterinary Medical Education are copyrighted to the American Association of Veterinary Medical Colleges. Requests for permission to reproduce this article should be made to the University of Toronto Press using the Permission Request Form: https://www.utpjournals.press/about/permissions or by email: [email protected].
History
Received: 17 October 2024
Revision received: 21 November 2024
Accepted: 3 December 2024
Published in print: 1 February 2025
Published online: 20 February 2025
Key Words:
Authors
Conflicts of Interest
The authors have no conflicts of interest to disclose.
Funding
This project was funded by the Southeast Veterinary Educational Consortium.
Metrics & Citations
Metrics
Related Content
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Download article citation data for:
Journal of Veterinary Medical Education 0 0:0
Journal of Veterinary Medical Education 0 0:0