Instrument for critical analysis of research reports: Thesis and dissertations

Abstract

Objective: this article aims to present a tool for critical analysis of a specific type of research report: theses and dissertations. Methods: this instrument was developed to carry out an activity in the Scientific Methodology course of the Postgraduate Program in Management & Knowledge Organization at the Federal University of Minas Gerais (PPGGOC/UFMG), in the first semester of 2019. The purpose of the instrument was to analyze the adherence of a scientific research to the recommendations of Creswell (2014) and other works on scientific methodology. It consists of 9 items, subdivided into 67 criteria, in the form of questions. For evaluation, each criterion is rated on a 5-point Likert-type scale, with a value of 1 corresponding to the less precise presentation of the criterion and a value of 5 to the more accurate presentation. The option “Not applicable (N / A)” was inserted in the instrument for those criteria in which the evaluator believes that it does not match the structural proposal of the research. Results: After describing the basis for its development, the instrument is presented. Next it was tested through the evaluation of a doctoral dissertation and a master thesis. Conclusions: Results show on that the instrument was adequate for the purpose proposed, that is, the evaluation of research reports of theses and dissertations, with the recommendation that the style and specificity of each investigation must be taken into account.