OP345 Evaluation Of An Artificial Intelligence-assisted Service For Cardiac Monitoring As Part Of A National Institute For Health And Care Excellence (NICE) Digital Health Technology Pilot

Abstract

Introduction. Zio XT Service was one of five Digital Health Technologies (DHTs) to be assessed by the National Institute for Health and Care Excellence (NICE) as part of their evaluation pilot. The King's Technology Evaluation Centre (KiTEC) act as an External Assessment Centre for NICE and worked on this pilot evaluation. The service comprises a I-Lead ECG patch, an inbuilt software that makes use of artificial intelligence (AI) algorithms to record, store and analyze ECG traces, and a team of cardiac physiologists. Methods. Although the methods were based on NICE's existing Medical Technologies Guidance Process, they were modified to suit the assessment of DHTs. The process was split into two sections, with the option to discontinue the assessment if it was considered that insufficient evidence was available for the technology. Clinical experts and patients were consulted through the process and clinical, economic and technical evidence was considered. Costs for three care pathways were modelled. Results. A total of thirty relevant clinical studies were identified, with a further study being reviewed as part of a separate technical assessment, focusing on the AI component of the technology. Four of the studies were considered to be pivotal to the decision problem, one of which was a Randomized Controlled Trial. The technology was found to have a greater diagnostic yield than a standard ambulatory monitor, however diagnostic accuracy measures were absent in the literature. Three economic models were developed to represent three care pathways: patients with syncope, patients who have had a stroke or transient ischaemic attack and a third model assessing downstream costs associated with stroke treatment. Conclusions. Digital Health Technologies and Artificial Intelligence Technologies pose novel and unique challenges to health technology assessment (HTA) bodies. Zio XT Service is a diagnostic tool, with both human and AI input, making it a particularly complex technology to assess. This work serves as a case-study in the evaluation of DHTs and AI and the lessons learned may contribute to the development of guidelines for such technologies incorporating headroom analysis, return on investment, one-way sensitivity analysis and scenario analyses using data from secondary sources. Results. The review of the literature, focus groups with CKD patients, and qualitative interviews with technology developers helped to understand relevant characteristics of WDHT and user preferences helped inform the next R&D iteration. Compared to the standard care, WDHT that support stage & ge;3 CKD patients self-management at home by measuring blood pressure and monitor mobility has the potential to be costeffective at conventional cost-effectiveness threshold levels. From the headroom analysis, novel WDHT can be priced up to GBP280 (EUR315, USD360) and still be cost-effective compared to standard home blood pressure monitoring. Conclusions. Our study provides valuable information for the further development of the WDHT, such as defining a go/no-go decision, as well as providing a template for performing early HTA of Digital Health Interventions.