Validation of sleep measurement in a multisensor consumer grade wearable device in healthy young adults

Abstract

Study Objectives: Our objective was to examine the ability of a consumer-grade wearable device (Basis B1) with accelerometer and heart rate technology to assess sleep patterns compared with polysomnography (PSG) and research-grade actigraphy in healthy adults. Methods: Eighteen adults underwent consecutive nights of sleep monitoring using Basis B1, actigraphy, and PSG; 40 nights were used in analyses. Discrepancies in gross sleep parameters and epoch-by-epoch agreements in sleep/wake classification were assessed. Results: Basis B1 accuracy was 54.20 ± 8.20%, sensitivity was 98.90 ± 2.70%, and specificity was 8.10 ± 15.00%. Accuracy, sensitivity, and specificity for distinguishing between the different sleep stages were 60-72%, 48-62%, and 57-86%, respectively. Pearson correlations demonstrated strong associations between Basis B1 and PSG estimates of sleep onset latency and total sleep time; moderate associations for sleep efficiency, duration of light sleep, and duration of rapid eye movement sleep; and a weak association for duration of deep sleep. Basis B1 significantly overestimates total sleep time, sleep efficiency, and duration of light sleep and significantly underestimates wake after sleep onset and duration of deep sleep. Conclusions: Basis B1 demonstrated utility for estimates of gross sleep parameters and performed similarly to actigraphy for estimates of total sleep time. Basis B1 specificity was poor, and Basis B1 is not useful for the assessment of wake. Basis B1 accuracy for sleep stages was better than chance but is not a suitable replacement for PSG assessment. Despite low cost, ease of use, and attractiveness for patients, consumer devices are not yet accurate or reliable enough to guide treatment decision making in clinical settings.