Interrogating new methods in socio-legal studies: Content analysis, case law and artificial intelligence

Abstract

This article explores the limits and risks of using artificial intelligence (AI) and large language models (LLMs) as tools to expedite and streamline empirical legal research and content analysis of cases. It emphasises the current risks and limits of AI for enabling socio-legal research and case-based analysis, including a lack of reproducibility, bias, hallucinations and inaccuracy. It concludes that, at present, legal researchers should be exceedingly cautious when utilising new tools and need to put in place stringent procedures to better evaluate the outputs of AI models.