A hazardous substance exposure prevention rating method for intervention needs assessment and effectiveness evaluation: The Small Business Exposure Index

Abstract

Aims. This paper describes the refinement and adaptation to small business of a previously developed method for systematically prioritizing needs for intervention on hazardous substance exposures in manufacturing worksites, and evaluating intervention effectiveness. Methods. We developed a checklist containing six unique sets of yes/no variables organized in a 2 × 3 matrix of exposure potential versus exposure protection at three levels corresponding to a simplified hierarchy of controls: materials, processes, and human interface. Each of the six sets of indicator variables was reduced to a high/moderate/low rating. Ratings from the matrix were then combined to generate an exposure prevention 'Small Business Exposure Index' (SBEI) Summary score for each area. Reflecting the hierarchy of controls, material factors were weighted highest, followed by process, and then human interface. The checklist administered by an industrial hygienist during walk-through inspection (N = 149 manufacturing processes/areas in 25 small to medium-sized manufacturing worksites). One area or process per manufacturing department was assessed and rated. A second hygienist independently assessed 36 areas to evaluate inter-rater reliability. Results. The SBEI Summary scores indicated that exposures were well controlled in the majority of areas assessed (58% with rating of 1 or 2 on a 6-point scale), that there was some room for improvement in roughly one-third of areas (31% of areas rated 3 or 4), and that roughly 10% of the areas assessed were urgently in need of intervention (rated as 5 or 6). Inter-rater reliability of EP ratings was good to excellent (e.g., for SBEI Summary scores, weighted kappa = 0.73, 95% CI 0.52-0.93). Conclusion. The SBEI exposure prevention rating method is suitable for use in small/medium enterprises, has good discriminatory power and reliability, offers an inexpensive method for intervention needs assessment and effectiveness evaluation, and complements quantitative exposure assessment with an upstream prevention focus.