CensorCheck: A Tool for Evaluating Protected Health Information Detection Systems

Abstract

Identifying protected health identifiers (PHIs) in free text is core to anonymising clinical notes for research. There is no standard metric for the quality of a PHI detection algorithm, resulting in papers reporting heterogeneous results. CensorCheck is presented, which computes specialised metrics for evaluating PHI detection taking into account the peculiarities of anonymisation tasks.