551PD Validation study to assess performance of IBM cognitive computing system Watson for oncology with Manipal multidisciplinary tumour board for 1000 consecutive cases: An Indian experience

Abstract

Background: IBM Watson for Oncology (WFO) developed in collaboration with MSKCC, NY is a cognitive computing system. WFO is designed to assist oncologists in making treatment decisions by bringing in together all the available medical information. In the present study we try to evaluate WFOtreatment recommendations with Manipal multidisciplinary tumour board (MMDT), a quaternary centre for 1000 cases. Methods:MMDT treatment recommendation and data of 1000 cases of 4 different cancers breast (638), colon (126), rectum (124) and lung (112) which were treated in last 3 years was collected by team of two doctors who were working in oncology department for more than 3 years. The treatment recommendations given by WFO was recorded. WFO treatment option were compared withMMDT treatment recommendation. Treatment recommendation by WFO came in three category with colour coding, Green is the recommended standard treatment (REC), Orange is to be considered (FC) and Red is not recommended (NREC). Concordance betweenMMDT and WFO was analysed. Results: Of the treatment recommendations given by MMDT, WFO provided 50% in REC, 28% in FC, 17% in NREC. Nearly 80% of theMMDT treatment recommendations were in WFO REC and WFO-FC group. However 5% of the treatment provided by MMDTwas not available with WFO. WFO-REC treatment for Organ was high in Rectum with 85% and least in Lung with 17.8%. In breast cancer alone the WFO-REC treatment was high with triple negative disease with 67.9% and least with hormone positive, Her 2neu negative disease with 35%. WFO took a median of 40 seconds to capture, analyze and give the treatment. Conclusions: WFO-REC and WFO-FC together were in 80% of time concordant with theMMDT treatment recommendations. WFO could be an essential tool to oncologists by reducing the cognitive burden of physicians in keeping up with medical literature by providing clinically actionable insights to assist them in treating patients. The median time of about 15 minutes needed per patient might be of concern in a busy OPD. However WFO will be only a assisting tool and it will never be able to replace the patient-doctor relationship which is a very essential component of treating a patient suffering with cancer.