Developing and testing a set of quality indicators for pharmacist home visit services: A mixed methods study in Japan

Abstract

Objective: Quality indicators (QIs) are an important mechanism by which health services can be evaluated. We aimed to develop a set of QIs for pharmacist home visit services and assess their measurement properties. Methods: A three-step procedure was applied: (1) Selection of existing content-validated QIs from the international literature and the development of QIs based on national guidelines and home healthcare professionals' opinions; (2) Expert panel consensus of a preliminary set of QIs using the RAND/UCLA Appropriateness Method; (3) Field testing to evaluate their measurement properties (feasibility, applicability, improvement potential, discriminatory capacity, sensitivity to change, acceptability and implementation issues) followed by exploratory semistructured interviews in Japan. Results: Fifty-two preliminary QIs were prepared and 45 were judged as “appropriate”by the expert panel. Sixty-one community pharmacies were recruited to this study with 41 contributing QI data monthly over the 6-month period. Field testing showed that 20 QIs met six measurement properties (ie, feasibility, applicability, improvement potential, discriminatory capacity, acceptability and implementation issues). Nine of these QIs also had high sensitivity to change. Additionally, interviews identified that the main positive impact on practice of using QIs was the early detection of causes of drug-related problems but a negative impact was decrease of pharmacists' motivation. Auto extraction of QIs was seen as a major facilitator, given the time taken to manually extract QI data. Conclusions: A set of QIs for pharmacist home visit services was rigorously developed and tested. This QI set may be useful in evaluating the quality of such services.