vlog

[Skip to Navigation]
Sign In
Visual Abstract.Voice-Activated Cognitive Behavioral Therapy for Insomnia
Figure. CONSORT Diagram for Recruitment and Retention

CBT-I indicates cognitive behavioral therapy for insomnia; CSD, Consensus Sleep Diary; DSPS, delayed sleep phase syndrome; ISI, Insomnia Severity Index.

Table 1. Baseline Participant Demographics
Table 2. Change in ISI Scores From Baseline to End of Study
Table 3. Estimated Marginal Means for Sleep Diary Variables Comparing the Intervention and Control Arms and Linear Mixed Model Resultsa
Table 4. Changes in Quality-of-Life Measures Based on the PROMIS-29
1.
American Cancer Society. Key statistics for breast cancer. Updated January 17, 2024. Accessed March 29, 2024.
2.
O’Donnell JF. Insomnia in cancer patients. Clin Cornerstone. 2004;6(suppl 1D):S6-S14. doi:
3.
Ancoli-Israel S. Recognition and treatment of sleep disturbances in cancer. J Clin Oncol. 2009;27(35):5864-5866. doi:
4.
National Heart, Lung, and Blood Institute. What is insomnia? Updated March 22, 2022. Accessed March 29, 2024.
5.
Liu L, Ancoli-Israel S. disturbances in cancer. Psychiatr Ann. 2008;38(9):627-634. doi:
6.
Garbarino S, Lanteri P, Bragazzi NL, Magnavita N, Scoditti E. Role of sleep deprivation in immune-related disease risk and outcomes. Commun Biol. 2021;4(1):1304. doi:
7.
Wu TT, Zou YL, Xu KD, et al. Insomnia and multiple health outcomes: umbrella review of meta-analyses of prospective cohort studies. Public Health. 2023;215:66-74. doi:
8.
Qaseem A, Kansagara D, Forciea MA, Cooke M, Denberg TD; Clinical Guidelines Committee of the American College of Physicians. Management of chronic insomnia disorder in adults: a clinical practice guideline from the American College of Physicians. Ann Intern Med. 2016;165(2):125-133. doi:
9.
Denlinger CS, Sanft T, Baker KS, et al. Survivorship, version 2.2018, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Canc Netw. 2018;16(10):1216-1247. doi:
10.
Edinger JD, Arnedt JT, Bertisch SM, et al. Behavioral and psychological treatments for chronic insomnia disorder in adults: an American Academy of Sleep Medicine systematic review, meta-analysis, and GRADE assessment. J Clin Sleep Med. 2021;17(2):263-298. doi:
11.
Koffel E, Bramoweth AD, Ulmer CS. Increasing access to and utilization of cognitive behavioral therapy for insomnia (CBT-I): a narrative review. J Gen Intern Med. 2018;33(6):955-962. doi:
12.
Espie CA, Kyle SD, Williams C, et al. A randomized, placebo-controlled trial of online cognitive behavioral therapy for chronic insomnia disorder delivered via an automated media-rich web application. . 2012;35(6):769-781. doi:
13.
Zhou ES, Suh S, Youn S, Chung S. Adapting cognitive-behavior therapy for insomnia in cancer patients. Med Res. 2017;8(2):51-61. doi:
14.
Zachariae R, Amidi A, Damholdt MF, et al. Internet-delivered cognitive-behavioral therapy for insomnia in breast cancer survivors: a randomized controlled trial. J Natl Cancer Inst. 2018;110(8):880-887. doi:
15.
Ritterband LM, Thorndike FP, Gonder-Frederick LA, et al. Efficacy of an internet-based behavioral intervention for adults with insomnia. Arch Gen Psychiatry. 2009;66(7):692-698. doi:
16.
Hassoon A, Schrack J, Naiman D, et al. Increasing physical activity amongst overweight and obese cancer survivors using an Alexa-based intelligent agent for patient coaching: protocol for the Physical Activity by Technology Help (PATH) Trial. JMIR Res Protoc. 2018;7(2):e27. doi:
17.
Steinberg D, Kay M, Burroughs J, Svetkey LP, Bennett GG. The effect of a digital behavioral weight loss intervention on adherence to the Dietary Approaches to Stop Hypertension (DASH) dietary pattern in medically vulnerable primary care patients: results from a randomized controlled trial. J Acad Nutr Diet. 2019;119(4):574-584. doi:
18.
Militello L, Sezgin E, Huang Y, Lin S. Delivering perinatal health information via a voice interactive app (SMILE): mixed methods feasibility study. JMIR Form Res. 2021;5(3):e18240. doi:
19.
Managing Insulin With a Voice AI (MIVA). ClinicalTrials.gov identifier: NCT05081011. Updated January 2, 2024. Accessed June 20, 2024.
20.
Nurse AMIE: Addressing Metastatic Individuals Everyday (NurseAMIE). ClinicalTrials.gov identifier: NCT03975621. Updated January 21, 2021. Accessed June 20, 2024.
21.
Starling CM, Greenberg D, Zhou E, et al. Testing delivery of components of cognitive behavioral therapy for insomnia to breast cancer survivors by smart speaker: a study protocol. BMC Med Inform Decis Mak. 2022;22(1):163. doi:
22.
Carney CE, Buysse DJ, Ancoli-Israel S, et al. The Consensus Sleep Diary: standardizing prospective sleep self-monitoring. . 2012;35(2):287-302. doi:
23.
Morin CM, Belleville G, Bélanger L, Ivers H. The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response. . 2011;34(5):601-608. doi:
24.
Huang W, Rose AJ, Bayliss E, et al. Adapting summary scores for the PROMIS-29 v2.0 for use among older adults with multiple chronic conditions. Qual Life Res. 2019;28(1):199-210. doi:
25.
HealthMeasures. PROMIS. Updated March 27, 2023. Accessed March 29, 2024.
26.
Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum Comput Interact. 2008;24(6):574-594. doi:
27.
Vlachogianni P, Tselios N. Perceived usability evaluation of educational technology using the Post-Study System Usability Questionnaire (PSSUQ): a systematic review. ܲٲԲٲ. 2023;15(17):12954. doi:
28.
Weiner BJ, Lewis CC, Stanick C, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108. doi:
29.
American Association for Cancer Research. AACR cancer disparities progress report 2024. Accessed August 15, 2024.
30.
Centers for Disease Control and Prevention. Morningness/Eveningess Questionnaire (Adan, Almirall, 1991). Accessed March 29, 2024.
31.
Garland S, Kutana S, Zhou ES. There’s an app for that: digital health solutions for treating insomnia in cancer survivors. ASCO Post. September 10, 2023. Accessed July 1, 2024.
32.
Ritterband LM, Bailey ET, Thorndike FP, Lord HR, Farrell-Carnahan L, Baum LD. Initial evaluation of an internet intervention to improve the sleep of cancer survivors with insomnia. ʲ⳦ǴDzԳDZDz. 2012;21(7):695-705. doi:
33.
Ritterband LM, Thorndike FP, Ingersoll KS, et al. Effect of a web-based cognitive behavior therapy for insomnia intervention with 1-year follow-up: a randomized clinical trial. JAMA Psychiatry. 2017;74(1):68-75. doi:
34.
Zhou ES, Ritterband LM, Bethea TN, Robles YP, Heeren TC, Rosenberg L. Effect of culturally tailored, internet-delivered cognitive behavioral therapy for insomnia in Black women: a randomized clinical trial. JAMA Psychiatry. 2022;79(6):538-549. doi:
35.
Dozeman E, Verdonck-de Leeuw IM, Savard J, van Straten A. Guided web-based intervention for insomnia targeting breast cancer patients: feasibility and effect. Internet Interv. 2017;9:1-6. doi:
36.
Amidi A, Buskbjerg CR, Damholdt MF, et al. Changes in sleep following internet-delivered cognitive-behavioral therapy for insomnia in women treated for breast cancer: a 3-year follow-up assessment. Med. 2022;96:35-41. doi:
37.
Alimoradi Z, Jafari E, Broström A, et al. Effects of cognitive behavioral therapy for insomnia (CBT-I) on quality of life: a systematic review and meta-analysis. Med Rev. 2022;64:101646. doi:
38.
Thorndike FP, Ritterband LM, Gonder-Frederick LA, Lord HR, Ingersoll KS, Morin CM. A randomized controlled trial of an internet intervention for adults with insomnia: effects on comorbid psychological and fatigue symptoms. J Clin Psychol. 2013;69(10):1078-1093. doi:
39.
Ramfjord LS, Faaland P, Scott J, et al. Digital cognitive behaviour therapy for insomnia in individuals with self-reported insomnia and chronic fatigue: a secondary analysis of a large scale randomized controlled trial. J Sleep Res. 2023;32(5):e13888. doi:
40.
Hasan F, Tu YK, Yang CM, et al. Comparative efficacy of digital cognitive behavioral therapy for insomnia: a systematic review and network meta-analysis. Med Rev. 2022;61:101567. doi:
41.
Ritterband LM, Thorndike FP, Morin CM, et al. Real-world evidence from users of a behavioral digital therapeutic for chronic insomnia. Behav Res Ther. 2022;153:104084. doi:
42.
Derose SF, Rozema E, Chen A, Shen E, Hwang D, Manthena P. A population health approach to insomnia using internet-based cognitive behavioral therapy for insomnia. J Clin Sleep Med. 2021;17(8):1675-1684. doi:
Original Investigation
Public Health
ٱ𳾲24, 2024

Voice-Activated Cognitive Behavioral Therapy for Insomnia: A Randomized Clinical Trial

Author Affiliations
  • 1Implementation Science, Healthcare Delivery Research, MedStar Health Research Institute, Washington, DC
  • 2Media Rez, Washington, DC
  • 3Sleep Health and Wellness Center, Santa Barbara, California
  • 4Department of Psychosocial Oncology and Palliative Care, Dana-Farber Cancer Institute, Boston, Massachusetts
  • 5George Washington University, Washington, DC
  • 6Center for Biostatistics, Informatics, and Data Science, MedStar Health Research Institute, Hyattsville, Maryland
  • 7Department of Oncology, Georgetown University, Washington DC
JAMA Netw Open. 2024;7(9):e2435011. doi:10.1001/jamanetworkopen.2024.35011
Key Points

Question Does a daily, in-home, voice-interactive program delivering cognitive behavioral therapy for insomnia (CBT-I) impact insomnia symptoms among breast cancer survivors?

Findings In this randomized clinical trial of 76 women, participants who received the CBT-I intervention demonstrated a clinically marked reduction in Insomnia Severity Index scores compared with the control group.

Meaning The findings suggest that this in-home, voice-interactive CBT-I program has potential for widespread dissemination to address insomnia symptoms.

Abstract

Importance Insomnia symptoms affect an estimated 30% to 50% of the 4 million US breast cancer survivors. Previous studies have shown the effectiveness of cognitive behavioral therapy for insomnia (CBT-I), but high insomnia prevalence suggests continued opportunities for delivery via new modalities.

Objective To determine the efficacy of a CBT-I–informed, voice-activated, internet-delivered program for improving insomnia symptoms among breast cancer survivors.

Design, Setting, and Participants In this randomized clinical trial, breast cancer survivors with insomnia (Insomnia Severity Index [ISI] score >7) were recruited from advocacy and survivorship groups and an oncology clinic. Eligible patients were females aged 18 years or older who had completed curative treatment more than 3 months before enrollment and had not undergone other behavioral sleep treatments in the prior year. Individuals were assessed for eligibility and randomized between March 2022 and October 2023, with data collection completed by December 2023.

Intervention Participants were randomized 1:1 to a smart speaker with a voice-interactive CBT-I program or educational control for 6 weeks.

Main Outcomes and Measures Linear mixed models and Cohen d estimates were used to evaluate the primary outcome of changes in ISI scores and secondary outcomes of sleep quality, wake after sleep onset, sleep onset latency, total sleep time, and sleep efficiency.

Results Of 76 women enrolled (38 each in the intervention and control groups), 70 (92.1%) completed the study. Mean (SD) age was 61.2 (9.3) years; 49 (64.5%) were married or partnered, and participants were a mean (SD) of 9.6 (6.8) years from diagnosis. From baseline to follow-up, ISI scores changed by a mean (SD) of −8.4 (4.7) points in the intervention group compared with −2.6 (3.5) in the control group (P < .001) (Cohen d, 1.41; 95% CI, 0.87-1.94). Sleep diary data showed statistically significant improvements in the intervention group compared with the control group for sleep quality (0.56; 95% CI, 0.39-0.74), wake after sleep onset (9.54 minutes; 95% CI, 1.93-17.10 minutes), sleep onset latency (8.32 minutes; 95% CI, 1.91-14.70 minutes), and sleep efficiency (−0.04%; 95% CI, −0.07% to −0.01%) but not for total sleep time (0.01 hours; 95% CI, −0.27 to 0.29 hours).

Conclusions and Relevance This randomized clinical trial of an in-home, voice-activated CBT-I program among breast cancer survivors found that the intervention improved insomnia symptoms. Future studies may explore how this program can be taken to scale and integrated into ambulatory care.

Trial Registration ClinicalTrials.gov Identifier:

Introduction

There were over 4 million breast cancer survivors in the US in 2023.1 The cancer-related physiological processes, effects of oncotherapies, induced menopause, comorbid mood disorders, and psychosocial and economic stressors associated with breast cancer treatment are all potential triggers for development or exacerbation of insomnia.2,3 Insomnia describes trouble falling asleep, staying asleep, and/or poor-quality sleep that impacts daytime function.4 Insomnia is a persistent issue experienced by around 30% to 50% of breast cancer survivors.5 Chronic insomnia has been associated with decrements in cardiometabolic and immune system health, neurobehavioral function, depression, fatigue, quality of life, and mortality.6,7

Cognitive behavioral therapy for insomnia (CBT-I) is the primary recommended insomnia treatment,8 endorsed by the National Comprehensive Cancer Network, American College of Physicians, and American Academy of Sleep Medicine.8-10 However, in-person CBT-I is not readily accessible due to scarcity of trained practitioners and a 4- to 8-week program that poses engagement challenges.11

Digital CBT-I interventions delivered via the internet have demonstrated effectiveness,12-15 addressing some concerns about access. Recent research has also explored the use of voice-activated programs for managing chronic conditions and supporting patients with cancer during chemotherapy,16-20 offering new avenues to engage individuals in the home. However, to our knowledge, this technology has not previously been used to deliver CBT-I. Smart speakers might increase accessibility of CBT-I and emulate therapist interactions via voice interactions. Feasibility trial results suggested that breast cancer survivors with insomnia favorably responded to a smart speaker program.21 Therefore, our objective was to test the impact of a 6-week, in-home, daily CBT-I smart speaker program (intervention) compared with web-based educational content (control). We hypothesized we would see greater improvement in insomnia symptoms on the Insomnia Severity Index (ISI) and on sleep diaries in the intervention group compared with the control group.

Methods

Study methods and reporting of this randomized clinical trial followed the Consolidated Standards of Reporting Trials () reporting guideline.21 This study was approved by the MedStar-Georgetown institutional review board and was registered on ClinicalTrials.gov (). There were no changes to the protocol (Supplement 1) after registration. Informed consent was obtained from study participants verbally and documented in the MedStar Health Research Institute REDCap platform by the person obtaining consent.

Most participants were recruited through the Love Research Army of the Dr Susan Love Foundation and local survivorship groups. We also recruited from an urban breast medical oncology clinic with a large proportion of Black or African American participants, focusing on women attending survivorship visits. Eligible participants were aged 18 years or older, self-reported or had a documented diagnosis of breast cancer, were female, completed curative treatment (surgery, radiation, chemotherapy, and/or immunotherapy) more than 3 months prior to enrollment, agreed to consistent use of prescribed sleep and/or psychiatric medications during the study period, had not undergone other behavioral sleep treatments in the prior year, and scored higher than 7 on the ISI, a 7-item self-reported questionnaire characterizing insomnia severity over the 2 previous weeks (scores range from 0 to 28, with 0 to 7 indicating no clinically significant insomnia; 8 to 14, subthreshold insomnia; 15 to 21, moderately severe clinical insomnia; and 22 to 28, severe clinical insomnia). Individuals were not eligible if they reported untreated obstructive sleep apnea syndrome, narcolepsy, restless leg syndrome, periodic limb movement disorder, delayed sleep phase syndrome, or central apnea syndrome. Exclusion criteria included poorly controlled psychiatric disorders and a history of bipolar disorder, schizophrenia, alcohol or drug use disorder in the prior year, shift work, regular travel to a location more than 1 time zone away for 2 or more days, or current or expected pregnancy.

The study team screened participants for eligibility by telephone. The ISI (single survey) and Consensus Sleep Diary (CSD)22 (10 consecutive days) were sent via the REDCap system at baseline prior to randomization. If participants completed 7 or more CSDs during the study run-in, they were randomized into the study. Participants also completed the ISI and CSDs via REDCap at the end of the study. A biostatistician designed randomization assignments in a 1:1 allocation ratio using random block sizes between 4 and 6. A sample size of 29 participants in each arm was required for an effect size of 0.65 and preintervention-postintervention correlation of 0.5 with 80% power. To account for 20% dropout, we recruited 76 participants (38 per arm) (Figure). Participants were enrolled between March 2022 and October 2023, and data collection was completed by December 2023.

Intervention

Participants assigned to the intervention received a smart speaker (Echo Dot, third generation [Amazon]) with a voice-activated program (Faster Asleep).21 At study intake, participants entered information on sleep concerns (eg, general sleep health and duration of insomnia), sleep patterns (bed and wake times, naps), sleep behaviors and sleep hygiene practice (eg, use of bed outside sleep times, caffeine intake), exercise, and use of sleep aids on the accompanying smartphone application (a smartphone was provided to participants). After study intake, all content was delivered by voice interaction. Participants activated the program by saying “Echo, launch Faster Asleep.” After collecting sleep diaries, the program provided education on fundamental CBT-I components, including sleep restriction, schedule modifications, stimulus control, and sleep hygiene. Only general education could be read on the app; participants could not complete sleep diaries or receive tailored feedback, including sleep restriction, without voice activation. After completion of nightly questionnaires, the program offered relaxation content. Recommendations based on CBT-I were tailored to individuals’ responses to the intake data and algorithms incorporating daily responses on sleep diaries.

Control

Control group participants received access to a website developed by the research team with information about CBT-I, sleep, and cancer survivorship. Participants could engage with the website as desired within a 6-week period. There was no tailoring or interactive feedback.

Outcome Measures

The primary outcome was change in scores on the ISI. A decrease of 7 points is considered moderate improvement and 8 points is marked improvement.23 All participants who completed the ISI at baseline were included in mixed models; additional analyses were performed with the participants who completed both beginning and end-of-study forms.

Secondary outcomes were calculated using results from the CSD at baseline and end of study. Three members of the study team (C.M.S., D.L., and H.A.) performed quality control of sleep diary data. Observations exceeding a 2-hour deviation from typical sleep or wake times or those with unexplained logical inconsistencies in the sleep diary were reviewed by a board-certified sleep specialist (D.L.), who determined exclusion for values that indicated incorrect diary completion. Additionally, observations recorded during travel across more than 1 time zone were omitted, and when time in bed and time to sleep were reversed, values were switched. After quality control, between 6 and 10 observations per participant at baseline and 2 and 10 observations per participant at end of study were used in mixed models. Sleep diary data yielded the following variables: sleep quality, wake after sleep onset, sleep onset latency, total sleep time, and sleep efficiency. Participants were asked to rate sleep quality on a 5-point Likert scale from very poor to very good, and sleep diary responses were averaged to generate a single score per participant. Total sleep time was calculated by subtracting sleep onset latency and wake after sleep onset from sleep duration (time to sleep to time awake). Time in bed was computed from the period between going in bed and getting out of bed, and sleep efficiency was derived from the ratio of total sleep time to time in bed.

At baseline and the end of study, participants also completed the Patient-Reported Outcomes Measurement Information System (PROMIS) 29-item scale in REDCap. Seven domains include 4 items each on a 5-point Likert scale: physical function, anxiety, depression, fatigue, ability to participate in social roles and activities, pain interference, and sleep disturbance. A single pain-intensity item was also included.24,25 We also administered the System Usability Scale (SUS)26,27 and evaluated participant satisfaction with the smart speaker program by asking participants whether they would recommend it to friends or family. To assess acceptability and appropriateness, we used an 8-item measure with Likert scale responses from 1 to 5, where higher scores were better.28

Covariates

Participants self-reported demographic and medical history data, including age, sex, cancer stage at diagnosis, years since diagnosis, years with insomnia, height, weight, race, ethnicity, marital status, employment status, educational level, and sleep aid use. Race and ethnicity were collected per federal reporting standards; categories included Asian, Black or African American (hereafter, Black), White, multiracial, and Hispanic or Latinx. We purposively recruited from a hospital serving a large proportion of Black individuals with a history of cancer, as many previous studies on CBT-I for insomnia have included overwhelmingly White populations yet Black patients with cancer have worse outcomes than their White counterparts.29 We asked all participants about motivation to complete the study and expectation to see benefit on a Likert scale of 1 to 5, with 1 being highly motivated or expecting significant improvement and 5 indicating not at all motivated or expecting very little improvement. We also collected the Morningness-Eveningness Questionnaire short form, which includes 5 items that distinguish between morning and evening types.30 Participants received $75 and an Echo Dot for completing end-of-study questionnaires.

Statistical Analysis

Baseline data were summarized using percentages, means with SDs, and medians with IQRs. We used D’Agostino-Pearson tests for normality. Fisher exact test, Student t test, and Kruskal-Wallis rank sum test were performed as appropriate to compare differences between groups. We used linear mixed models for analyses of all participants and Cohen d estimates among those who completed the study, with the corresponding percentile to evaluate effect size. Given the multiple measurements per person for sleep diary data, we used linear mixed models fit by restricted maximum likelihood. Regressor time points, arms, and an interaction term were included in the model. Estimated marginal means were calculated to present the start, end, and start-end contrast of the trial arms. Analyses were conducted in R, version 4.3.1 (R Project for Statistical Computing). Two-sided P <.05 was considered significant.

Results

A total of 95 breast cancer survivors were assessed for eligibility; 10 never consented, 5 did not meet eligibility criteria, and 4 discontinued during the run-in period (Figure). Among the 76 included participants, 38 were randomized to the intervention group and 38 to the control group. Mean (SD) age was 61.2 (9.3) years, and mean (SD) time from diagnosis was 9.6 (6.8) years (Table 1). Participants had a median body mass index (calculated as weight in kilograms divided by height in meters squared) of 25.8 (range, 17.8-48.3). Two participants (2.6%) identified as Asian, 16 (21.1%) as Black, 2 (2.6%) as Hispanic or Latinx, 53 (69.7%) as White, and 3 (3.9%) as multiracial. Over half of participants were married or partnered (49 [64.5%]). With regard to employment, 29 (38.2%) worked full-time, 11 (14.5%) worked part-time, 31 (40.8%) were retired, and 5 (6.6%) were unemployed. Most participants had a college or graduate-level degree (66 [86.8%]). Participants had experienced insomnia for a mean (SD) of 10.3 (9.4) years. There was a varying distribution of breast cancer stage at diagnosis, with 2 participants (2.6%) at stage 0; 33 (43.4%), stage 1; 29 (38.2%), stage 2; 8 (10.5%), stage 3; and 4 (5.3%), stage 4. We compared the 70 people who completed the intervention (92.1%) with the 6 (7.9%) who did not and found no statistically significant differences except by race, by which the proportion of individuals who dropped out was higher among multiracial participants (1 of 3 [33.3%]) and Black participants (3 of 16 [18.8%]) compared with White participants (1 of 53 [1.9%]) (P = .03).

Primary Outcome

We found a significantly greater reduction in ISI score among intervention participants (mean [SD] score at baseline, 16.0 [3.5]; 6-week follow up, 7.4 [3.5]) compared with control participants (mean [SD] score at baseline, 15.4 [4.4]; 6-week follow-up, 12.7 [4.9]) (P < .001) (Table 2). The mean (SD) of the difference in ISI scores at the patient level was −8.4 (4.7) points in the intervention group compared with −2.6 (3.5) in the control group (P < .001); the estimated mean difference among those who completed the study was 5.83 (95% CI, 3.84-7.81), and Cohen d was 1.41 (95% CI, 0.87-1.94). The linear mixed model with all participants yielded the same contrast estimate. In further analysis stratified by median baseline ISI score, there was a mean (SD) change of −10.8 (4.3) for intervention participants and −3.8 (4.2) for control participants among those with a baseline ISI score higher than 15 compared with mean (SD) changes of −6.4 (4.1) and −1.6 (2.5) for intervention and control participants, respectively, for those with a baseline ISI score of 15 or lower. At the 6-week follow-up, 31 of the 35 individuals in the control arm (88.6%) had a worse score than the typical participant in the intervention group. To assess clinically relevant remission, the percentage of participants with an ISI score of 14 or lower (subclinical insomnia) after the intervention was considered; 94.3% (33 of 35 participants) in the intervention group reached the threshold, while 71.4% (25 of 35 participants) in the control group reached the threshold. In assessment of the percentage of participants who reached a score of 7 or lower (no clinically significant insomnia), 51.4% (18 participants) in the intervention arm met the criteria for remission compared with 11.4% (4 participants) in the control group.

Secondary Outcomes

Sleep diary data showed improvements from baseline to end of study across multiple domains (Table 3). We observed statistically significant improvements in estimated marginal means for sleep quality (0.56; 95% CI, 0.39-0.74), wake after sleep onset (9.54 minutes; 95% CI, 1.93-17.10 minutes), sleep onset latency (8.32 minutes; 95% CI, 1.91-14.70 minutes), time in bed (0.42 hours; 95% CI, 0.16-0.69 hours), and sleep efficiency (−0.04%; 95% CI, −0.07% to −0.01%) in the intervention group compared with the control group but no statistically significant difference for total sleep time (0.01 hours; 95% CI, −0.27 to 0.29 hours).

Comparing quality of life from baseline to end of study by group, there was no statistically significant difference for ability to participate in social roles or activities, anxiety, depression, pain interference, or physical function (Table 4). A statistically significant improvement in sleep disturbance was observed, with the intervention group showing a mean (SD) score change of −10.7 (7.0) compared with a change of −1.9 (4.7) in the control group, a difference of 8.79 (95% CI, 5.96-11.61). The PROMIS scale T score is based on a population norm of 50 and an SD of 10, suggesting that the intervention group improved from 59.7 to 48.6, closing the gap to the population norm. Additionally, fatigue levels significantly improved in the intervention group (mean [SD] score change, −6.3 [7.6]) compared with the control group (−0.8 [7.9]), with a difference of 5.44 (95% CI, 1.78-9.11). Linear mixed model analysis supported these findings with contrast estimates for fatigue (5.39; 95% CI, 1.74-9.04) and sleep disturbance (8.62; 95% CI, 6.11-11.70).

Intervention group participants reported a mean (SD) SUS score of 72.2 (16.6; range, 22.5-100), exceeding the average rating of 68. The mean (SD) acceptability score was 3.81 (0.9) of 5. Similarly, the mean (SD) appropriateness score was 3.85 (0.9) of 5. Furthermore, 30 of 35 intervention participants (85.7%) strongly agreed or agreed that they were satisfied with the program, and 30 of 35 (85.7%) reported that they would recommend the smart speaker program to friends or family. For the control group, the mean (SD) SUS score was 50.79 (15.9; range, 15.0-92.5). The mean (SD) acceptability score was 2.93 (0.9) of 5. The mean (SD) appropriateness score was 2.89 (0.9) of 5. Among the control group, 11 of 35 participants (31.4%) expressed satisfaction, while 14 of 35 participants (40.0%) indicated they would recommend the program to others.

Engagement

The 35 participants who completed the study in the intervention arm completed between 15 and 42 days of daily sleep diaries (mean [SD], 39 [10.22] days) and education content (mean [SD], 39 [10.33] days), and 25 (71.4%) completed all diaries and education during the program; this information was used to provide sleep restriction guidance daily to achieve greater than 85% sleep efficiency. As nightly questionnaires were not required for new recommendations to generate, nighttime log completion ranged from 1 to 41 days (mean [SD], 31 [12.62] days); 5 participants (14.3%) completed all nightly questionnaires. Among the 35 in the control arm who completed the study, 29 (82.9%) engaged with the website at least once. The mean (SD) number of website visits was 5.55 (5.23; range, 1-26).

Discussion

In this randomized clinical trial, participants using the smart speaker program showed marked improvements in insomnia symptoms compared with the control group.23 These findings support a novel method for addressing insomnia symptoms that presents new avenues for scalability and engagement.31

Our findings are similar to earlier studies using digital CBT-I programs such as SHUTi and I-Sleep, which have demonstrated similar improvements in insomnia severity (Cohen d ranging from 1.33 to 2.32) and sleep diary measures, although some previous studies showed a stronger effect in both shorter- and longer-term outcomes.32-36 The null results for total sleep time are similar to previous digital CBT-I findings33; this is not surprising, as CBT-I is focused on sleep initiation and continuity rather than total sleep time. Some of the participants in previous studies reported a slightly higher starting ISI score (mean, 17-18) than individuals in our study (mean, 15-16), which might explain a stronger effect size. Still, our findings suggest a robust effect on insomnia symptoms. A previous study also explored the effect of digital CBT-I on quality of life.37 Other studies have reported small to moderate improvements in fatigue (Cohen d, 0.24-0.44).35,38,39 While only 2 quality-of-life domains showed a difference by arm in our study, many of the quality-of-life domains may be less likely to change with improvements in insomnia symptoms. Our finding of changes in fatigue and sleep disturbance are expected, as these variables are directly related to decrements in sleep quality associated with insomnia. The smart speaker program was largely deemed user friendly, acceptable, and appropriate for its intended use. However, the variation in SUS scores, especially, suggests room for improvement. Technological issues with the study hotspots provided may have contributed to lower usability scores.

Strengths and Limitations

Study strengths include an innovative approach to administer CBT-I daily at home. While previous research40,41 has successfully delivered digital CBT-I, this study is unique in providing daily interaction and feedback to increase sleep efficiency and adherence to sleep recommendations. In contrast, most other CBT-I programs work on a weekly cadence. In addition to the daily interaction, this program embeds in the home and allows for interaction intended to mimic in-person therapy.

This study also has limitations. Despite efforts to recruit from a hospital with a large Black population and lower socioeconomic status, 69.7% of the study’s participants were White and 86.8% had completed college or graduate school. Consequently, our findings may be less generalizable to other populations. Still, enrollment of Black individuals (21.1%) was higher than in other landmark digital CBT-I studies, in which the percentage of Black participants was 7% or less33,42 or the population was all White.14,36 Additionally, we were unable to assess impact beyond 6 weeks. Moreover, reliance on self-reported sleep measures introduces the possibility of bias due to inaccurate recall. However, prior research has shown sleep diaries to be reliable and valid,33 and our technology for sleep data collection ensured that data from previous days could not be entered, reducing recall bias. Additional analyses of secondary data suggested that participants with more missing diaries had a smaller change in sleep quality, suggesting bias in reporting but also that effect size estimates may be conservative. Still, in future studies, stratified randomization by baseline sleep diary completion may be prudent to reduce bias in missingness.

Conclusions

Our study findings support the efficacy of a daily, in-home, voice-interactive CBT-I program among breast cancer survivors. Cancer centers may consider programs such as this to reach more breast cancer survivors with insomnia. Future studies should explore potential for scaling in-home sleep programs and increasing application of artificial intelligence and should compare engagement and noninferiority with other effective CBT-I programs.

Back to top
Article Information

Accepted for Publication: July 27, 2024.

Published: September 24, 2024. doi:10.1001/jamanetworkopen.2024.35011

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2024 Starling CM et al. vlog Open.

Corresponding Author: Hannah Arem, PhD, Implementation Science, Healthcare Delivery Research, MedStar Health Research Institute, 3007 Tilden St NW, Ste 6N, Washington, DC 20008 (Hannah.Arem@medstar.net).

Author Contributions: Ms Chou and Prof Arem had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Greenberg, Lewin, Shaw, Zhou, Lieberman, Arem.

Acquisition, analysis, or interpretation of data: Starling, Greenberg, Lewin, Shaw, Lieberman, Chou, Arem.

Drafting of the manuscript: Starling, Greenberg, Lewin, Zhou, Arem.

Critical review of the manuscript for important intellectual content: Greenberg, Lewin, Shaw, Zhou, Lieberman, Chou, Arem.

Statistical analysis: Starling, Chou, Arem.

Obtained funding: Greenberg, Arem.

Administrative, technical, or material support: Starling, Greenberg, Lewin, Shaw, Lieberman.

Supervision: Greenberg, Lewin, Zhou, Lieberman, Arem.

Conflict of Interest Disclosures: Dr Lewin reported receiving grants from the Sleep Health and Wellness Center during the conduct of the study. Prof Arem reported receiving grants from the National Cancer Institute (NCI) during the conduct of the study and funding from the Maryland Department of Health and the Centers for Disease Control and Prevention outside the submitted work. No other disclosures were reported.

Funding/Support: This work was supported by grant R44CA232905 from the NCI (Mr Greenberg and Prof Arem).

Role of the Funder/Sponsor: The NCI had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. The study protocol underwent full external peer review by the funding body as part of the peer review process.

Data Sharing Statement: See Supplement 2.

Additional Contributions: We thank all those who enrolled in or completed the study and the referring practitioners and support groups.

References
1.
American Cancer Society. Key statistics for breast cancer. Updated January 17, 2024. Accessed March 29, 2024.
2.
O’Donnell JF. Insomnia in cancer patients. Clin Cornerstone. 2004;6(suppl 1D):S6-S14. doi:
3.
Ancoli-Israel S. Recognition and treatment of sleep disturbances in cancer. J Clin Oncol. 2009;27(35):5864-5866. doi:
4.
National Heart, Lung, and Blood Institute. What is insomnia? Updated March 22, 2022. Accessed March 29, 2024.
5.
Liu L, Ancoli-Israel S. disturbances in cancer. Psychiatr Ann. 2008;38(9):627-634. doi:
6.
Garbarino S, Lanteri P, Bragazzi NL, Magnavita N, Scoditti E. Role of sleep deprivation in immune-related disease risk and outcomes. Commun Biol. 2021;4(1):1304. doi:
7.
Wu TT, Zou YL, Xu KD, et al. Insomnia and multiple health outcomes: umbrella review of meta-analyses of prospective cohort studies. Public Health. 2023;215:66-74. doi:
8.
Qaseem A, Kansagara D, Forciea MA, Cooke M, Denberg TD; Clinical Guidelines Committee of the American College of Physicians. Management of chronic insomnia disorder in adults: a clinical practice guideline from the American College of Physicians. Ann Intern Med. 2016;165(2):125-133. doi:
9.
Denlinger CS, Sanft T, Baker KS, et al. Survivorship, version 2.2018, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Canc Netw. 2018;16(10):1216-1247. doi:
10.
Edinger JD, Arnedt JT, Bertisch SM, et al. Behavioral and psychological treatments for chronic insomnia disorder in adults: an American Academy of Sleep Medicine systematic review, meta-analysis, and GRADE assessment. J Clin Sleep Med. 2021;17(2):263-298. doi:
11.
Koffel E, Bramoweth AD, Ulmer CS. Increasing access to and utilization of cognitive behavioral therapy for insomnia (CBT-I): a narrative review. J Gen Intern Med. 2018;33(6):955-962. doi:
12.
Espie CA, Kyle SD, Williams C, et al. A randomized, placebo-controlled trial of online cognitive behavioral therapy for chronic insomnia disorder delivered via an automated media-rich web application. . 2012;35(6):769-781. doi:
13.
Zhou ES, Suh S, Youn S, Chung S. Adapting cognitive-behavior therapy for insomnia in cancer patients. Med Res. 2017;8(2):51-61. doi:
14.
Zachariae R, Amidi A, Damholdt MF, et al. Internet-delivered cognitive-behavioral therapy for insomnia in breast cancer survivors: a randomized controlled trial. J Natl Cancer Inst. 2018;110(8):880-887. doi:
15.
Ritterband LM, Thorndike FP, Gonder-Frederick LA, et al. Efficacy of an internet-based behavioral intervention for adults with insomnia. Arch Gen Psychiatry. 2009;66(7):692-698. doi:
16.
Hassoon A, Schrack J, Naiman D, et al. Increasing physical activity amongst overweight and obese cancer survivors using an Alexa-based intelligent agent for patient coaching: protocol for the Physical Activity by Technology Help (PATH) Trial. JMIR Res Protoc. 2018;7(2):e27. doi:
17.
Steinberg D, Kay M, Burroughs J, Svetkey LP, Bennett GG. The effect of a digital behavioral weight loss intervention on adherence to the Dietary Approaches to Stop Hypertension (DASH) dietary pattern in medically vulnerable primary care patients: results from a randomized controlled trial. J Acad Nutr Diet. 2019;119(4):574-584. doi:
18.
Militello L, Sezgin E, Huang Y, Lin S. Delivering perinatal health information via a voice interactive app (SMILE): mixed methods feasibility study. JMIR Form Res. 2021;5(3):e18240. doi:
19.
Managing Insulin With a Voice AI (MIVA). ClinicalTrials.gov identifier: NCT05081011. Updated January 2, 2024. Accessed June 20, 2024.
20.
Nurse AMIE: Addressing Metastatic Individuals Everyday (NurseAMIE). ClinicalTrials.gov identifier: NCT03975621. Updated January 21, 2021. Accessed June 20, 2024.
21.
Starling CM, Greenberg D, Zhou E, et al. Testing delivery of components of cognitive behavioral therapy for insomnia to breast cancer survivors by smart speaker: a study protocol. BMC Med Inform Decis Mak. 2022;22(1):163. doi:
22.
Carney CE, Buysse DJ, Ancoli-Israel S, et al. The Consensus Sleep Diary: standardizing prospective sleep self-monitoring. . 2012;35(2):287-302. doi:
23.
Morin CM, Belleville G, Bélanger L, Ivers H. The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response. . 2011;34(5):601-608. doi:
24.
Huang W, Rose AJ, Bayliss E, et al. Adapting summary scores for the PROMIS-29 v2.0 for use among older adults with multiple chronic conditions. Qual Life Res. 2019;28(1):199-210. doi:
25.
HealthMeasures. PROMIS. Updated March 27, 2023. Accessed March 29, 2024.
26.
Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum Comput Interact. 2008;24(6):574-594. doi:
27.
Vlachogianni P, Tselios N. Perceived usability evaluation of educational technology using the Post-Study System Usability Questionnaire (PSSUQ): a systematic review. ܲٲԲٲ. 2023;15(17):12954. doi:
28.
Weiner BJ, Lewis CC, Stanick C, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108. doi:
29.
American Association for Cancer Research. AACR cancer disparities progress report 2024. Accessed August 15, 2024.
30.
Centers for Disease Control and Prevention. Morningness/Eveningess Questionnaire (Adan, Almirall, 1991). Accessed March 29, 2024.
31.
Garland S, Kutana S, Zhou ES. There’s an app for that: digital health solutions for treating insomnia in cancer survivors. ASCO Post. September 10, 2023. Accessed July 1, 2024.
32.
Ritterband LM, Bailey ET, Thorndike FP, Lord HR, Farrell-Carnahan L, Baum LD. Initial evaluation of an internet intervention to improve the sleep of cancer survivors with insomnia. ʲ⳦ǴDzԳDZDz. 2012;21(7):695-705. doi:
33.
Ritterband LM, Thorndike FP, Ingersoll KS, et al. Effect of a web-based cognitive behavior therapy for insomnia intervention with 1-year follow-up: a randomized clinical trial. JAMA Psychiatry. 2017;74(1):68-75. doi:
34.
Zhou ES, Ritterband LM, Bethea TN, Robles YP, Heeren TC, Rosenberg L. Effect of culturally tailored, internet-delivered cognitive behavioral therapy for insomnia in Black women: a randomized clinical trial. JAMA Psychiatry. 2022;79(6):538-549. doi:
35.
Dozeman E, Verdonck-de Leeuw IM, Savard J, van Straten A. Guided web-based intervention for insomnia targeting breast cancer patients: feasibility and effect. Internet Interv. 2017;9:1-6. doi:
36.
Amidi A, Buskbjerg CR, Damholdt MF, et al. Changes in sleep following internet-delivered cognitive-behavioral therapy for insomnia in women treated for breast cancer: a 3-year follow-up assessment. Med. 2022;96:35-41. doi:
37.
Alimoradi Z, Jafari E, Broström A, et al. Effects of cognitive behavioral therapy for insomnia (CBT-I) on quality of life: a systematic review and meta-analysis. Med Rev. 2022;64:101646. doi:
38.
Thorndike FP, Ritterband LM, Gonder-Frederick LA, Lord HR, Ingersoll KS, Morin CM. A randomized controlled trial of an internet intervention for adults with insomnia: effects on comorbid psychological and fatigue symptoms. J Clin Psychol. 2013;69(10):1078-1093. doi:
39.
Ramfjord LS, Faaland P, Scott J, et al. Digital cognitive behaviour therapy for insomnia in individuals with self-reported insomnia and chronic fatigue: a secondary analysis of a large scale randomized controlled trial. J Sleep Res. 2023;32(5):e13888. doi:
40.
Hasan F, Tu YK, Yang CM, et al. Comparative efficacy of digital cognitive behavioral therapy for insomnia: a systematic review and network meta-analysis. Med Rev. 2022;61:101567. doi:
41.
Ritterband LM, Thorndike FP, Morin CM, et al. Real-world evidence from users of a behavioral digital therapeutic for chronic insomnia. Behav Res Ther. 2022;153:104084. doi:
42.
Derose SF, Rozema E, Chen A, Shen E, Hwang D, Manthena P. A population health approach to insomnia using internet-based cognitive behavioral therapy for insomnia. J Clin Sleep Med. 2021;17(8):1675-1684. doi:
×