Explaining the mixed findings of a randomised controlled trial of telehealth with centralised remote support for heart failure: multi-site qualitative study using the NASSS framework

Abstract

Background: The SUPPORT-HF2 randomised controlled trial compared telehealth technology alone with the same technology combined with centralised remote support, in which a clinician responds promptly to biomarker changes. The intervention was implemented differently in different sites; no overall impact was found on the primary endpoint (proportion of patients on optimum treatment). We sought to explain the trial’s findings in a qualitative evaluation. Methods: Fifty-one people (25 patients, 3 carers, 18 clinicians, 4 additional researchers) were interviewed and observed in 7 UK trial sites in 2016–2018. We collected 110 pages of documents. The analysis was informed by the NASSS framework, a multi-level theoretical lens which considers non-adoption and abandonment of technologies by individuals and challenges to scale-up, spread and sustainability. In particular, we used NASSS to tease out why a ‘standardised’ socio-technical intervention played out differently in different sites. Results: Patients’ experiences of the technology were largely positive, though influenced by the nature and severity of their illness. In each trial site, existing services, staffing levels, technical capacity and previous telehealth experiences influenced how the complex intervention of ‘telehealth technology plus centralised specialist remote support’ was interpreted and the extent to which it was adopted and used to its full potential. In some sites, the intervention was quickly mobilised to fill significant gaps in service provision. In others, it was seen as usefully extending the existing care model for selected patients. Elsewhere, the new model was actively resisted and the technology little used. In one site, centralised provision of specialist advice aligned awkwardly with an existing community-based heart failure support service. Conclusions: Complex socio-technical interventions, even when implemented in a so-called standardised way with uniform inclusion and exclusion criteria, are inevitably implemented differently in different local settings because of how individual staff members interpret the technology and the trial protocol and because of the practical realities and path dependencies of local organisations. Site-specific iteration and embedding of a new technology-supported complex intervention may be required (in addition to co-design of the user interface) before such interventions are ready for testing in clinical trials. Trial registration: BMC ISRCTN Registry 86212709. Retrospectively registered on 5 September 2014