A framework for developing a deeper understanding of the factors that influence success and failure in undergraduate engineering capstone design experiences

Abstract

The engineering undergraduate curriculum presents substantial opportunities for improvement. Society is calling for a transformation (https://tuee.asee.org/). As the culminating experience for undergraduate engineering students, capstone design team projects represent a window on the curriculum and a particularly fertile ground for understanding these opportunities. However, the factors that influence success and failure in capstone remains an area of inquiry. The framework presented here proposes to help us develop a deeper understanding of these factors. We present a mixed methods analysis approach for identifying the critical factors impacting capstone design team success, where success is defined by student satisfaction. The proposed framework includes factors and their interactions in three fundamental areas: faculty mentorship, student backgrounds, and various contextual influences. The proposed framework capitalizes on the use of existing survey tools and course data to conduct a mapping of faculty mentor beliefs/practices against student perception and recognition of those practices. In conjunction with student reflective memos containing self-evaluations of their project and team experiences, interactions with faculty mentors, and overall satisfaction with their educational experience, this data will combine to provide a multifaceted assessment of which factors are influential and are value-added to the program. The mixed methods approach will include quantitative statistical analysis of programmatic data, qualitative social network analysis-based assessment of peer evaluations, and case-study triangulation with student-authored reflective memorandum and faculty self-assessments. Preliminary results from application of the proposed framework at a large public metropolitan research one university will be shared. The ultimate objective of this work is to provide a meaningful in-depth understanding of the capstone design experience and insights based upon careful analysis and observations of engineering students working on real-world projects. It is envisioned that the results of the research will provide meaningful guidance to students, instructors and stakeholders for improved preparation of young engineers for the profession.