A Method of Automated Nonparametric Content Analysis for Social Science

  • Gary King
  • Daniel J. Hopkins
  • 11


    Mendeley users who have this article in their library.
  • N/A


    Citations of this article.


The increasing availability of digitized text presents enormous opportunities for social scientists. Yet hand coding many blogs, speeches, government records, newspapers, or other sources of unstructured text is infeasible. Although computer scientists have methods for automated content analysis, most are optimized to classify individual documents, whereas social scientists instead want generalizations about the population of documents, such as the proportion in a given category. Unfortunately, even a method with a high percent of individual documents correctly classified can be hugely biased when estimating category proportions. By directly optimizing for this social science goal, we develop a method that gives approximately unbiased estimates of category proportions even when the optimal classifier performs poorly. We illustrate with diverse data sets, including the daily expressed opinions of thousands of people about the U.S. presidency. We also make available software that implements our methods and large corpora of text for further

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in


  • Gary King

  • Daniel J. Hopkins

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free