Value of updating a systematic review in surgery using individual patient data

Abstract

Background: Previous research has highlighted the advantages of individual patient data (IPD) meta-analyses. However, they are resource intensive and take considerable time to complete. The aim of this study was to determine whether the extra investment is justified by greater accuracy or usefulness by means of a case study in surgery. Methods: An updated review using IPD, where possible, was compared with an earlier version based on aggregate published data to determine whether there were statistically significant changes in estimates of effectiveness for hernia recurrence and persisting pain. Differences related to the type of laparoscopic repair, the type of open repair and methodological quality were also explored. Results: The results for hernia recurrence changed little. However, the IPD update led to divergent conclusions for persisting pain. The published data implied a statistically significant benefit in favour of open repair, whereas the IPD result implied a statistically significant benefit in favour of laparoscopic repair (P < 0.001). Methodological quality did not account for this difference. Conclusion: Updating of systematic reviews using IPD can be conducted successfully in surgery. This example led to little change in estimates of effectiveness for hernia recurrence but yielded qualitatively different estimates for persisting pain, an outcome rarely included in the published reports.