Planning, executing, and evaluating the winograd schema challenge

Abstract

The Winograd Schema Challenge (WSC) was proposed by Hector Levesque in 2011 as an alternative to the Turing test. Chief among its features is a simple question format that can span many commonsense knowledge domains. Questions are chosen so that they do not require specialized know-eldge or training and are easy for humans to answer. This article details our plans to run the WSC and evaluate results.