Discovering software developer's coding expertise through deep learning

Abstract

The field of software development is growing rapidly and prevailing in every walk of life. The role of software developers in such a challenging and complex activity is very much important. The allocation of right software developers (i.e. who possesses appropriate coding skills) to projects is one of the crucial factors for successful software development. The problem is that it is very difficult for a client, project manager, as well as for software development organisations to find out an appropriate developer and assign him/her to a particular project. To achieve this, there is a need for such a sound mechanism that could detect the level of software developer coding expertise. This study has formulated criteria for novice and expert developers and carried out such criteria to discover the level of coding expertise of software developers using three different models of deep learning. These models include long short-term memory (LSTM), convolution 1D and hybrid (a combination of LSTM and convolution 1D). The deep learning models have analysed software developers' previously written source code collected from the GitHub repository. An experiment was conducted to evaluate the performance of models. The results showed that the LSTM model performed better in comparison to other models by achieving 96.25% accuracy.