Challenges in Adapting LLMs for Transparency: Complying with Art. 14 EU AI Act

Abstract

This paper investigates the technical potential of developing explainable transformer-based large language models (LLMs) that meet users' needs and comply with regulations such as the EU AI Act. We implement and evaluate a proof-of-concept explainable LLM-based system. Furthermore, we demonstrate its potential for regulatory compliance and identify technical challenges to be tackled.