Evaluating Information Retrieval Metrics Based on Bootstrap Hypothesis Tests

Abstract

This paper describes how the bootstrap approach to statistics can be applied to the evaluation of IR effectiveness metrics. More specifically, we describe straightforward methods for comparing the discriminative power of IR metrics based on Bootstrap ...