Enhancing the h index for the objective assessment of healthcare researcher performance and impact

Abstract

Objective To investigate whether the h index (a bibliometric tool which is increasingly used to assess and appraise an individual's research performance) could be improved to better measure the academic performance and citation profile for individual healthcare researchers. Design Cohort study. Setting Faculty of Medicine, Imperial College London, UK. Participants Publication lists from 1 January 2000 until 31 December 2009 for 501 academic healthcare researchers from the Faculty of Medicine. Main outcome measures The h index for each researcher was calculated over a nine-year period. The citation count for each researcher was differentiated into high (h2 upper), core (h2 centre) and low (h2 lower) visibility areas. Segmented regression model (sRM) was usedtostatistically estimate number of high visibility publications (sRM value). Validity of the h index and other proposed adjuncts were analysed against academic rank and conventional bibliometric indicators. Results Construct validity was demonstrated for h index, h2 upper, h2 centre, h2 lower and sRM value (all P < 0.05). Convergent validity of the h index and sRM value was shown by significant correlations with total number of publications (r =0.89 and 0.86 respectively, P<0.05) and total number of citations (r = 0.96 and 0.65, respectively, P<0.05). Significant differences in h index and sRM value existed between non-physician and physician researchers (P < 0.05). Conclusions This study supports the construct validity of the h index as a measure of healthcare researcher academic rank. It also identifies the assessment value of our developed indices of h2 upper, h2 centre, h2 lower and sRM. These can be applied in combination with the h index to provide additional objective evidence to appraise the performance and impact of an academic healthcare researcher.