PolyVerif: An Open-Source Environment for Autonomous Vehicle Validation and Verification Research Acceleration

Abstract

Validation and Verification (V&V) of Artificial Intelligence (AI) based cyber physical systems such as Autonomous Vehicles (AVs) is currently a vexing and unsolved problem. AVs integrate subsystems in areas such as detection, sensor fusion, localization, perception, and path planning. Each of these subsystems contains significant AI content integrated with traditional hardware and software components. The complexity for validating even a subsystem is daunting and the task of validating the whole system is nearly impossible. Fundamental research in advancing the state-of-the-art for AV V&V is required. However, for V&V researchers, it is exceedingly difficult to make progress because of the massive infrastructure requirements to demonstrate the viability of any solution. This paper presents PolyVerif, the world's first open-source solution focused on V&V researchers with the objective of accelerating the state-of-the-art for AV V&V research. PolyVerif provides an AI design and verification framework consisting of a digital twin creation process, an open-source AV engine, access to several open-source physics based simulators, and open-source symbolic test generation engines. PolyVerif's objective is to arm V&V researchers with a framework which extends the state-of-the-art on any one of the many major axes of interest and use the remainder of the infrastructure to quickly demonstrate the viability of their solution. Given its open-source nature, researchers can also contribute their innovations to the project. Using this critical property of open-source environments, the innovation rate of the whole research community to solve these vexing issues can be greatly accelerated. Finally, the paper also presents results from several projects which have used PolyVerif.