Home > Educational Resources > Abstract Catalog > Abstract Details > Does Self Evaluation Improve Surgical Skills? A Randomized Control Trial: A Pilot Study

« Back to Search

Does Self Evaluation Improve Surgical Skills? A Randomized Control Trial: A Pilot Study

Précis: This study investigated the effect of self-evaluation on the improvement of surgical skills by comparing OSATS scores over a 4-month period to determine if the addition of a self-evaluation improved surgical skills more than instructor evaluation alone. 

Purpose: To determine if self-evaluation improves surgical performance more than instructor evaluation alone.

Background: The OSATS score is a validated rating scale for the evaluation of surgical skills. Self-evaluation using OSATS has been compared to instructor evaluation to determine the correlation of the scores. Self-evaluation in combination with instructor evaluation to improve surgical skills has not been studied.

Methods: A RCT was performed in which learners, PGY 1-4, were randomized into either the control group who only received instructor OSATS evaluations or the experimental group who received instructor evaluations as well as self-evaluations. Everyone received the same instructions and performed the same simulation which was videotaped for review.  The instructor was blinded to each arm and the simulation was repeated after four months. The primary outcome was the change in instructor OSATS score over the study period.

Results: Fifteen residents were enrolled and completed the study. There was no difference in the change in instructor OSATS score (p=0.726). There was a correlation in the learner and instructor score for time and motion (p= 0.02) and instrument handling (p=0.008). All participants reported that self-evaluation was a useful educational tool. Only participants from the experimental group reported practicing on their own time.

Discussion: The current study attempted to demonstrate the utility of self-evaluation on surgical education. The correlation between learner and instructor scores are consistent with the literature. Self-evaluation did not improve overall change in score; however, all participants found it useful and it did increase practice at home. 


Topics: SES, 2020, Resident, Faculty, Clerkship Director, Residency Director, Practice-Based Learning & Improvement, GME, Assessment, Simulation, Independent Study,

General Information


Intended
Audience
Resident,Faculty,Clerkship Director,Residency Director,
Competencies
Addressed
Practice-Based Learning & Improvement,
Educational
Continuum
GME,
Educational
Focus
Assessment,Simulation,Independent Study,
Clinical Focus

Author Information

Julia Keltz, M.D. 

Additional Materials


Related Abstracts


CONTACT US

2130 Priest Bridge Drive, Suite 7,
Crofton, MD 21114
(P) 410-451-9560 | (F) 410-451-9568

DONATE

Learn more about the programs
supported by your dues and donations.

JOIN US

APGO offers several membership and subscriber options to give you the support and resources you need to be successful.