CoDesc: A Large Code-Description Parallel Dataset

7Citations
Citations of this article
60Readers
Mendeley users who have this article in their library.

Abstract

Translation between natural language and source code can help software development by enabling developers to comprehend, ideate, search, and write computer programs in natural language. Despite growing interest from the industry and the research community, this task is often difficult due to the lack of large standard datasets suitable for training deep neural models, standard noise removal methods, and evaluation benchmarks. This leaves researchers to collect new small-scale datasets, resulting in inconsistencies across published works. In this study, we present CoDesc - a large parallel dataset composed of 4.2 million Java methods and natural language descriptions. With extensive analysis, we identify and remove prevailing noise patterns from the dataset. We demonstrate the proficiency of CoDesc in two complementary tasks for code-description pairs: code summarization and code search. We show that the dataset helps improve code search by up to 22% and achieves the new state-of-the-art in code summarization. Furthermore, we show CoDesc's effectiveness in pre-training-finetuning setup, opening possibilities in building pretrained language models for Java. To facilitate future research, we release the dataset, a data processing tool, and a benchmark at https://github.com/csebuetnlp/CoDesc.

Cite

CITATION STYLE

APA

Hasan, M., Muttaqueen, T., Al Ishtiaq, A., Mehrab, K. S., Haque, M. M. A., Hasan, T., … Shahriyar, R. (2021). CoDesc: A Large Code-Description Parallel Dataset. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 (pp. 210–218). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/2021.findings-acl.18

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free