Spondyloarthritis Research Consortium of Canada sacroiliac joint inflammation and structural scores: Change score reliability and recalibration utility in children

Abstract

Background: The SPARCC sacroiliac joint inflammation (SIS) and structural (SSS) scores are reliable measures to quantify abnormalities in the pediatric sacroiliac joint. We aimed to evaluate the utility of online calibration modules for the SIS and SSS and the reliability of their component change scores. Methods: Change score reliability of 6 raters was assessed by overall and pairwise intraclass correlation coefficients (ICCs) before and after the use of real-time iterative calibration (RETIC) modules for both the SIS and SSS comprised of 20 adult cases. Acceptable ICC for change scores was > 0.7 for SIS and > 0.5 for all SSS components. Sensitivity to change was assessed by the standardized response mean (SRM). Results: In scoring exercise 1, the SIS had acceptable reliability with a change score ICC of 0.80 and sclerosis was the only SSS lesion that met the acceptability threshold with a change score ICC of 0.52. After RETIC calibration, the SIS overall (ICC = 0.83) and mean pairwise (ICC = 0.83) change scores remained reliable with a large SRM (0.90). All SSS components except sclerosis met the overall and mean pairwise change score ICC acceptability thresholds - backfill: overall = 0.54, mean pairwise = 0.50; fat metaplasia: overall = 0.65, mean pairwise = 0.57; erosion: overall = 0.60, mean pairwise = 0.58; and ankylosis: overall = 0.96, mean pairwise = 0.96. The SSS RETIC module augmented the number of SSS components surpassing the acceptability threshold from 1 to 4. Sensitivity to change, as measured by the SRM, was large for erosion (0.96), moderate for backfill (0.55) and sclerosis (0.70), and small for fat metaplasia (0.36) and ankylosis (0.28). Conclusion: RETIC modules improved the overall reliability of SPARCC SIS and SSS change scores for previously calibrated raters. SIS recalibration was not as helpful to the most experienced raters who achieved high levels of agreement before recalibration. The SPARCC SIS and all SSS components except sclerosis are reliable measures to quantify change over time in children. A pediatric-specific RETIC tool should be developed to enhance the calibration of readers.