Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees

Abstract

Introduction and Objectives: The Victorian section of the Urological Association of Australia and New Zealand (USANZ) implemented a surgical skills training programme in 2004. A retrospective review of end-user experience over the initial 6 years of the program was published in 2011. This prospective review of feedback from 2011 to 2016 is to re-assess the perceived benefit and relevance of the sessions to urology trainees and to identify areas for potential improvement. Comparison between this evaluation and the previous study aims to assess the programme's response to user feedback. Methods: All trainees attending skills training sessions between 2011 and 2016 were asked to complete a structured questionnaire at the completion of the session. The questionnaire included 11 topic areas ranging from the year of surgical training to degree of usefulness of the session, including several sections for free text response to offer more detailed feedback. Sessions were examined both individually and collectively to assess end user satisfaction with the structure and content of the program. Results: 24 individual skills sessions were held over the 6-year period, with a total of 355 attendees. Of these, 331 attendees completed the majority of the questionnaire, a response rate of over 93%. Overall 88% of the surveyed attendees stated that they had both the support of their supervising consultant and the flexibility of workload to attend the session. 90% of trainees felt that there was adequate reading material provided prior to the skills session, an improvement from 76% in the previous study period. 97% of those surveyed felt that the existing session structure was appropriate and the same proportion found the sessions both useful and interesting, compared to just 63% in the previous study period. Analysis of individual topics demonstrates some variability in outcome measures, but for nearly every assessed parameter greater than 90% of participants agreed that the session fulfilled the expected criteria. New topics developed since the 2011 analysis, including renal transplant and vascular repair, also had high levels of satisfaction. The practical models used have been refined and achieved higher scores than those in the previous assessment period. Conclusions: The urology skills based training programme has been well received by the surveyed trainees and is now embedded and well accepted as part of the Victorian training program. The format of the sessions has matured and the overall rating, both individually and collectively was high. There has been a clear increase in satisfaction across most areas assessed when compared to previous feedback. Despite this, there remain areas that can be improved, such as the amount and quality of available equipment and the inclusion of video demonstrations of operative techniques.