Evaluating the implementation of community volunteer assessment and referral of sick babies: Lessons learned from the Ghana Newhints home visits cluster randomized controlled trial

Abstract

A World Health Organization (WHO)/United Nations Children's Fund (UNICEF) (2009) joint statement recommended home visits by community-based agents as a strategy to improve newborn survival, based on promising results from Asia. This article presents detailed evaluation of community volunteer assessment and referral implemented within the Ghana Newhints home visits cluster-Randomized Controlled Trial (RCT). It highlights the lessons learned to inform implementation/scale-up of this model in similar settings. The evaluation used a conceptual framework adopted for increasing access to care for sick newborns and involves three main steps, each with a specific goal and key requirements to achieving this. These steps are: sick newborns are identified within communities and referred; families comply with referrals and referred babies receive appropriate management at health facilities. Evaluation data included interviews with 4006 recently delivered mothers; records on 759 directly observed volunteer assessments and 52 validation of supervisors' assessments; newborn care quality assessment in 86 health facilities and in-depth interviews (IDIs) with 55 mothers, 21 volunteers and 15 health professionals. Assessment accuracy of volunteers against supervisors and physician was assessed using Kappa (agreement coefficient). IDIs were analysed by generating and indexing into themes, and exploring relationships between themes and their contextual interpretations. This evaluation demonstrated that identifying, understanding and implementing the key requirements for success in each step of volunteer assessment and referrals was pivotal to success. In Newhints, volunteers (CBSVs) were trusted by families, their visits were acceptable and they engaged mothers/families in decisions, resulting in unprecedented 86% referral compliance and increased (55-77%) care seeking for sick newborns. Poor facility care quality, characterized by poor health worker attitudes, limited the mortality reduction. The important implication for future implementation of home visits in similar settings is that, with 100% specificity but 80% sensitivity of referral decisions, volunteers might miss some danger signs but if successful implementation must translate into mortality reductions, concurrent improvement in facility newborn care quality is imperative.