A dynamic programming approach to efficient sampling from Boltzmann distributions

Abstract

Markov chain methods for Boltzmann sampling work in phases with decreasing temperatures. The number of transitions in each phase crucially affects terminal state distribution. We employ dynamic programming to allocate iterations to phases to improve guarantees on sample quality. Numerical experiments on the Ising model are presented. © 2008 Elsevier B.V. All rights reserved.