A New Questionnaire to Assess Respiratory Symptoms (The Respiratory Symptom Experience Scale): Quantitative Psychometric Assessment and Validation Study

Abstract

Background: Smokers often experience respiratory symptoms (eg, morning cough), and those who stop smoking, including those who do so by switching completely to electronic nicotine delivery systems (ENDS), may experience reductions in symptoms. Existing respiratory symptom questionnaires may not be suitable for studying these changes, as they are intended for patient populations, such as those with chronic obstructive pulmonary disease (COPD). Objective: This study aimed to develop a respiratory symptom questionnaire appropriate for current smokers and for assessing changes when smokers stop smoking. Methods: The Respiratory Symptom Experience Scale (RSES) was derived from existing instruments and subject matter expert input and refined through cognitive debriefing interviews (n=49). Next, for purposes of the quantitative psychometric evaluation, the RSES was administered to smokers (n=202), former smokers (no tobacco use in >6 months; n=200), and switchers (n=208, smokers who switched to ENDS for >6 months), all of whom had smoked for at least 10 years (mean age 33 years). Participants, who averaged 62 (SD 12) years of age, included 28% (173/610) with respiratory allergy symptoms and 17% (104/610) with COPD. Test-retest reliability was assessed by repeat assessment after 1 week in 128 participants. Results: A generalized partial credit model confirmed that the response options were ordered, and a parallel analysis using principal components confirmed that the scale was unidimensional. With allowance for 2 sets of correlated errors between pairs of items, a 1-factor graded response model fit the data. Discrimination parameters were approximately 1 or greater for all items. Scale reliability was 0.80 or higher across a broad range of severity (standardized scores -0.40 to 3.00). Test-retest reliability (absolute intraclass correlation) was good, at 0.89. RSES convergent validity was supported by substantial differences (Cohen d=0.74) between those with and without a diagnosis of respiratory disease (averaging 0.57 points, indicating that differences of this size or smaller represent meaningful differences). RSES scores also strongly differentiated those with and without COPD (d=1.52). Smokers’ RSES scores were significantly higher than former smokers’ scores (P