Development and validation of a Web-based assessment tool for the Extended focused assessment with sonography in trauma examination

Abstract

Objectives-Extended focused assessment with sonography in trauma (EFAST) examinations are routinely performed by emergency physicians and general surgeons as an integral part of trauma care. Although guidelines for competency in the EFAST examination exist, tools to assess competency are lacking. Our goal was to develop and validate a Web-based competency assessment tool to evaluate providers who perform the EFAST examination. Methods-A multiple-choice test regarding the performance and interpretation of the EFAST examination was developed following National Board of Medical Examiner guidelines. Five emergency physician experts with fellowship training in emergency ultrasound established face and content validity. The test was administered to emergency medicine residents and ultrasound fellows. Concurrent validity was evaluated by assessing the correlation of scores on our test with guidelines set by the American College of Emergency Physicians (ACEP) for emergency ultrasound. Scores were analyzed, and statistical analysis was performed. Results-Sixty-three emergency medicine residents and 2 ultrasound fellows from 2 residency programs completed the assessment tool. Examinees who met ACEP guidelines scored significantly higher than those who had not: 70.4% (95% confidence interval, 67.3%-73.4%) versus 48.3% (43.2%-53.5%). Evaluation of scores showed a significant correlation between an increased level of training, participation in an ultrasound rotation, and the number of EFAST and total ultrasound examinations performed with higher test scores. However, overall test scores were lower than initially anticipated. Conclusions-Use of this assessment tool for interpretation of EFAST images showed face and content validity. Score trends showed a significant correlation with existing ACEP guidelines, ultrasound experience, and the training level. Scores continued to improve with experience beyond ACEP recommended guidelines. © 2011 by the American Institute of Ultrasound in Medicine.