Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations

Abstract

Conducting a pilot study is an important step in both qualitative and quantitative research process. Pilot study enable researchers to evaluate research methods and in particular research instruments with the aim of enhancing reliability and validity of data to be collected from the main study. Pilot study help researchers to detect flaws which lead to adequate and appropriate adjustments of the research instruments. Findings presented in this paper are drawn from an in-depth analysis using a documentary guide of randomly selected PhD thesis and dissertations from one public university in Kenya. The aim of this desk study was to examine ways in which PhD students/graduates use findings from pilot studies and in particular for purposes of improving the validity and reliability of research instruments. The study revealed that PhD students/graduates ignore pilot studies or give it minimal attention. Out of the seven students/graduates only 2 discussed pilot study in a stand-alone section, while others integrated it in the subsections of reliability and validity. Although two of the students/graduates mentioned the purpose of pilot study, they however, were not specific on the research instruments being piloted. Four of the students/graduates did not report how they analyzed data from the pilot study, while two indicated that they analyzed data but details on how it was done are missing. This study concludes that PhD students/graduates neglect or give general information about pilot studies in their thesis and dissertations. The students/graduates do not show how data analyzed from the pilot studies was used to revise, review or improve the research methodology and in particular research instruments. Findings from this study confirms that pilot study is a 'neglected part of the research process'. The study recommends that researchers especially post graduate students should be sensitized on the importance of taking pilot studies seriously. In addition, supervisors should provide effective and adequate guidance to their PhD and Masters students on how to conduct, and appropriately use findings from the pilot study.