Principles and Guidelines for Quantum Performance Analysis

Abstract

Expanding access to practical quantum computers prompts a widespread need to evaluate their performance. Principles and guidelines for carrying out sound empirical work on quantum computing systems are proposed. The guidelines draw heavily on classical experience in experimental algorithmics and computer systems performance analysis, with some adjustments to address issues in quantum computing. The focus is on issues related to quantum annealing processors, although much of the discussion applies to more general scenarios.