Mixtures of probabilistic logic programs

Abstract

Structure learning (SL) is a fundamental task in Statistical Relational Artificial Intelligence, where the goal is to learn a program from data. Among the possible target languages, there is Probabilistic Logic Programming. Mixture models have recently gained attention thanks to their effectiveness in modeling complex distributions by combining simpler ones. In this paper, we propose learning a mixture of probabilistic logic programs to handle SL. Our method consists of three steps: 1) generating mixture components with a specific structure, 2) applying parameter learning to each component, and 3) optimizing the weights associated with each component. Furthermore, to possibly reduce the number of components and mitigate overfitting, we also explore the use of L1 and L2 regularization. Empirical results obtained by considering both the full set of components and only a fraction of them demonstrate that our approach, despite being seemingly simple, is competitive with state-of-the-art solvers.