Verifiable autonomy and responsible robotics

Abstract

The move towards greater autonomy presents challenges for software engineering. As we may be delegating greater responsibility to software systems and as these autonomous systems can make their own decisions and take their own actions, a step change in the way the systems are developed and verified is needed. This step involves moving from just considering what the system does, but also why it chooses to do it (since decision-making may be delegated). In this chapter, we provide an overview of our programme of work in this area: utilising hybrid agent architectures, exposing and verifying the reasons for decisions, and applying this to assessing a range of properties of autonomous systems.