Abstract
Large language models (LLMs) achieve remarkable predictive capabilities but remain opaque in their internal reasoning, creating a pressing need for more interpretable artificial intelligence. Here, we propose bridging this explanatory gap by drawing on concepts from topological quantum computing (TQC), specifically the anyonic frameworks arising from (Formula presented.) theories. Anyons interpolate between fermions and bosons, offering a mathematical language that may illuminate the latent structure and decision-making processes within LLMs. By examining how these topological constructs relate to token interactions and contextual dependencies in neural architectures, we aim to provide a fresh perspective on how meaning and coherence emerge. After eliciting insights from ChatGPT and exploring low-level cases of (Formula presented.) models, we argue that the machinery of modular tensor categories and topological phases could inform more transparent, stable, and robust AI systems. This interdisciplinary approach suggests that quantum-theoretic principles may underpin a novel understanding of explainable AI.
Author supplied keywords
Cite
CITATION STYLE
Planat, M., & Amaral, M. (2024). What ChatGPT Has to Say About Its Topological Structure: The Anyon Hypothesis. Machine Learning and Knowledge Extraction, 6(4), 2876–2891. https://doi.org/10.3390/make6040137
Register to see more suggestions
Mendeley helps you to discover research relevant for your work.