Benchmarking AI design skills: insights from ChatGPT’s participation in a prototyping hackathon

Abstract

This study provides insights into the capabilities and performance of generative AI, specifically ChatGPT, in engineering design. ChatGPT participated in a 48-hour hackathon by instructing two participants who acted out its instructions, successfully designing and prototyping a NERF dart launcher that finished second among six teams. The paper highlights the potential and limitations of generative AI as a tool for ideation, decision-making, and optimization in engineering tasks, demonstrating the practical applicability of generating viable design solutions under real-world constraints.