Spiral: splitters for identifiers in source code files

Abstract

Spiral is a Python package that implements numerous algorithms for splitting identifiers. Identifier splitting (also known as identifier name tokenization) is the task of partioning program identifiers such as readUTF8stream into component tokens: [read, UTF8, stream]. The need for splitting identifiers arises in a variety of contexts, including natural language processing (NLP) methods applied to source code analysis and program comprehension.