Acessibilidade / Reportar erro

Preliminary outcomes from a single-session, asynchronous, online stress and anxiety management workshop for college students

Abstract

Objectives

Self-guided, asynchronous, online interventions may provide college students access to evidence-based care, while mitigating barriers like limited hours of service. Thus, we examined the preliminary effectiveness of a 45-minute, self-guided, asynchronous, online, dialectical behavior therapy (DBT)-informed stress and anxiety management workshop. College undergraduates (n = 131) were randomized to either workshop (n = 65) or waitlist control (n = 66) conditions.

Methods

Participants in the workshop condition completed baseline measures of depression, stress, and anxiety, before completing the workshop. Participants in the waitlist control condition only completed the baseline measures. All participants were reassessed at 1-week follow-up.

Results

Controlling for baseline measures, students in the workshop condition experienced significantly less stress and greater self-efficacy to regulate stress and anxiety at follow-up, compared to waitlist controls.

Conclusion

A 45-minute, self-guided, asynchronous, online DBT skills-informed stress and anxiety management workshop may reduce stress and improve self-efficacy to regulate stress and anxiety.

Mental Health; stress; anxiety; dialectical behavior therapy; online intervention

Introduction

Research consistently indicates the presence of a mental health crisis among college students in the United States, with recent estimates of over 75% of US college students experiencing clinically significant stress and anxiety.11. American College Health Association. National College Health Assessment III: Undergraduate student reference group data report fall 2019. Silver Spring: American College Health Association; 2020. Such findings are likely the result of the multiple stressors that college students, and particularly diverse and non-traditional college students, face including identity development, academic and familial demands, financial strain, and discrimination.22. Byrd DR, McKinney KJ. Individual, interpersonal, and institutional level factors associated with the mental health of college students. J Am Coll Health. 2012;60:185-93.

3. Ketchen Lipson S, Gaddis SM, Heinze J, Beck K, Eisenberg D. Variations in student mental health and treatment utilization across us colleges and universities. J Am Coll Health. 2015;63:388-96.
-44. Syed M, Azmitia M. Longitudinal trajectories of ethnic identity during the college years. J Res Adolesc. 2009;19:601-24. Notably, experiences of stress and anxiety have been positively associated with a wide range of academic and mental health difficulties, including anxiety disorders, depressive disorders, eating disorders, substance abuse, and suicidality.55. Liu CH, Stevens C, Wong SHM, Yasui M, Chen JA. The prevalence and predictors of mental health diagnoses and suicide among US college students: Implications for addressing disparities in service use. Depress Anxiety. 2018;36:8-17.,66. Soet J, Sevig T. Mental health issues facing a diverse sample of college students: Results from the college student mental health survey. J NASPA. 2006;43:410-31. Despite this, a high percentage of US college students do not seek mental health services, with the majority of students citing mental health stigma, busy schedules, and limited hours of services as the primary barriers to doing so.77. Corrigan PW, Watson AC. Understanding the impact of stigma on people with mental illness. World Psychiatry. 2002;1:16-20.

8. National Alliance on Mental Illness. College students speak: A survey report on mental health. National Alliance on Mental Illness; 2012.
-99. Watson AC, Corrigan P, Larson JE, Sells M. Self-stigma in people with mental illness. Schizophr Bull. 2007;33:1312-8.

To address these barriers and to improve the accessibility of evidence-based mental health support, there has been an increase in development and implementation of self-guided asynchronous online stress and anxiety management interventions for college students.1010. Chiauzzi E, Brevard J, Thurn C, Decembrele S, Lord S. MyStudentBody–Stress: An online stress management intervention for college students. J Health Commun. 2008;13:555-72.

11. Cukrowicz KC, Joiner TE. Computer-based intervention for anxious and depressive symptoms in a non-clinical population. Cognit Ther Res. 2007;31:677-93.

12. Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR Ment Health. 2017;4:e19.

13. Frazier P, Meredith L, Greer C, et al. Randomized controlled trial evaluating the effectiveness of a web-based stress management program among community college students. Anxiety Stress Coping. 2015;28:576-86.

14. Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol. 2015;62:137-47.

15. Kvillemo P, Brandberg Y, Bränström R. Feasibility and outcomes of an internet-based mindfulness training program: A pilot randomized controlled trial. JMIR Ment Health. 2016;3:e33.

16. Levin ME, Hayes SC, Pistorello J, Seeley JR. Web-based self-help for preventing mental health problems in universities: Comparing acceptance and commitment training to mental health education. J Clin Psychol. 2016;72:207-25.

17. Levin ME, Haeger JA, Pierce BG, Twohig MP. Web-based acceptance and commitment therapy for mental health problems in college students. Behav Modif. 2017;41:141-62.
-1818. Levin ME, Pistorello J, Seeley JR, Hayes SC. Feasibility of a prototype web-based acceptance and commitment therapy prevention program for college students. J Am Coll Health. 2013;62:20-30. Here, an asynchronous intervention refers to the lack of any real-time or in-person facilitation, support, or guidance from a facilitator or researcher. Additionally, self-guided refers to the lack of any facilitator or coach included with the intervention. As such, self-guided, asynchronous, online interventions can both increase accessibility and decrease barriers to mental health support, as they can be completed at an individual’s own pace, at any time, and at any location with internet access. Strikingly, studies thus far indicate that such interventions result in a variety of positive mental health outcomes, including lower anxiety,1111. Cukrowicz KC, Joiner TE. Computer-based intervention for anxious and depressive symptoms in a non-clinical population. Cognit Ther Res. 2007;31:677-93.,1212. Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR Ment Health. 2017;4:e19.,1414. Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol. 2015;62:137-47.,1717. Levin ME, Haeger JA, Pierce BG, Twohig MP. Web-based acceptance and commitment therapy for mental health problems in college students. Behav Modif. 2017;41:141-62. lower stress,1010. Chiauzzi E, Brevard J, Thurn C, Decembrele S, Lord S. MyStudentBody–Stress: An online stress management intervention for college students. J Health Commun. 2008;13:555-72.,1414. Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol. 2015;62:137-47. lower depression,1111. Cukrowicz KC, Joiner TE. Computer-based intervention for anxious and depressive symptoms in a non-clinical population. Cognit Ther Res. 2007;31:677-93.,1414. Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol. 2015;62:137-47.,1717. Levin ME, Haeger JA, Pierce BG, Twohig MP. Web-based acceptance and commitment therapy for mental health problems in college students. Behav Modif. 2017;41:141-62.,1818. Levin ME, Pistorello J, Seeley JR, Hayes SC. Feasibility of a prototype web-based acceptance and commitment therapy prevention program for college students. J Am Coll Health. 2013;62:20-30. greater psychological wellbeing,1515. Kvillemo P, Brandberg Y, Bränström R. Feasibility and outcomes of an internet-based mindfulness training program: A pilot randomized controlled trial. JMIR Ment Health. 2016;3:e33. and greater psychological flexibility.1616. Levin ME, Hayes SC, Pistorello J, Seeley JR. Web-based self-help for preventing mental health problems in universities: Comparing acceptance and commitment training to mental health education. J Clin Psychol. 2016;72:207-25.

The positive outcomes indicate that self-guided, asynchronous, online stress and anxiety management interventions offer a way for students to access effective services, while mitigating barriers like limited hours of service, transportation, travel time, and the mental health stigma of physically seeking services.1919. Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital mental health interventions for depression, anxiety, and enhancement of psychological well-being among college students: Systematic review. J Med Internet Res. 2019;21:e12869. However, most interventions have limited accessibility by requiring participants to attend multiple sessions, thus placing greater time and scheduling burden on participants. Although one intervention was single-session,1111. Cukrowicz KC, Joiner TE. Computer-based intervention for anxious and depressive symptoms in a non-clinical population. Cognit Ther Res. 2007;31:677-93. the researchers required participants to complete the intervention in the lab, thus reducing external validity and excluding students experiencing the time, transportation, and scheduling barriers noted above. As such, there has not yet been an examination of a single-session, self-guided, asynchronous, online stress and anxiety management intervention delivered outside of the lab that further addresses the common barriers that many college students face.

One method of achieving this may be to implement a workshop-style intervention based on acceptance-based approaches and strategies, such as acceptance-based behavioral therapy (ABBT),2020. Orsillo SM, Roemer L. The mindful way through anxiety: Break free from chronic worry and reclaim your life. New York: Guilford; 2011. acceptance and commitment therapy (ACT),2121. Hayes SC, Strosahl KD, Wilson KG. Acceptance and commitment therapy: An experiential approach to behavior change. New York: Guilford; 1999. or dialectical behavior therapy (DBT),2222. Linehan MM. Skills training manual for treating borderline personality disorder. New York: Guilford; 1993.,2323. Linehan MM. DBT training manual. New York: The Guilford Press; 2014. which have demonstrated promising therapeutic outcomes. Although acceptance-based workshop approaches have yet to be studied in a self-guided, asynchronous, online format, they have been shown to have positive outcomes when delivered in-person to college students.

For example, Brown et al.2424. Brown LA, Forman EM, Herbert JD, Hoffman KL, Yuen EK, Goetter EM. A randomized controlled trial of acceptance-based behavior therapy and cognitive therapy for test anxiety: A pilot study. Behav Modif. 2011;35:31-53. utilized a 2-hour ACT-based test anxiety workshop and found a significant increase in test performance and trend toward decreased test anxiety.2424. Brown LA, Forman EM, Herbert JD, Hoffman KL, Yuen EK, Goetter EM. A randomized controlled trial of acceptance-based behavior therapy and cognitive therapy for test anxiety: A pilot study. Behav Modif. 2011;35:31-53.

Similarly, other studies indicate that, following an ABBT-based stress and anxiety management workshop, symptoms of stress and anxiety decreased at 1-month follow-up,2525. Eustis EH, Williston SK, Morgan LP, Graham JR, Hayes-Skelton SA, Roemer L. Development, acceptability, and effectiveness of an acceptance-based behavioral stress/anxiety management workshop for university students. Cogn Behav Pract. 2017;24:174-86. and depression severity decreased at 3-month follow up.2626. Danitz SB, Orsillo SM. The mindful way through the semester: An investigation of the effectiveness of an acceptance-based behavioral therapy program on psychological wellness in first-year students. Behav Modif. 2014;38:549-66. There is also emerging evidence for the benefits of DBT as a single-session intervention,2727. Ward-Ciesielski EF, Jones CB, Wielgus MD, Wilks CR, Linehan MM. Single-session dialectical behavior therapy skills training versus relaxation training for non-treatment engaged suicidal adults: A randomized controlled trial. BMC Psychol. 2016;4:13. as well as evidence for promising outcomes of abbreviated DBT-informed skills groups for college students, such as greater perceived emotion regulation and reductions in anxiety, stress, and depression.2828. Muhomba M, Chugani CD, Uliaszek AA, Kannan D. Distress tolerance skills for college students: A pilot investigation of a brief DBT group skills training program. J Coll Stud Psychother. 2017;31:247-56.

29. Panepinto AR, Uschold CC, Olandese M, Linn BK. Beyond borderline personality disorder: Dialectical behavior therapy in a college counseling center. J Coll Stud Psychother. 2015;29:211-26.

30. Rizvi SL, Steffel LM. A pilot study of 2 brief forms of dialectical behavior therapy skills training for emotion dysregulation in college students. J Am Coll Health. 2014;62:434-9.
-3131. Uliaszek AA, Rashid T, Williams GE, Gulamani T. Group therapy for university students: A randomized control trial of dialectical behavior therapy and positive psychotherapy. Behav Res Ther. 2016;77:78-85.

In sum, despite a high prevalence of stress and anxiety, many US college students do not seek mental health services due to mental health stigma, busy schedules, and being unavailable during hours of services.77. Corrigan PW, Watson AC. Understanding the impact of stigma on people with mental illness. World Psychiatry. 2002;1:16-20.

8. National Alliance on Mental Illness. College students speak: A survey report on mental health. National Alliance on Mental Illness; 2012.
-99. Watson AC, Corrigan P, Larson JE, Sells M. Self-stigma in people with mental illness. Schizophr Bull. 2007;33:1312-8. Self-guided, asynchronous, online interventions and single-session workshops have been proposed as a means of providing mental health intervention while overcoming some of these practical barriers.1010. Chiauzzi E, Brevard J, Thurn C, Decembrele S, Lord S. MyStudentBody–Stress: An online stress management intervention for college students. J Health Commun. 2008;13:555-72.

11. Cukrowicz KC, Joiner TE. Computer-based intervention for anxious and depressive symptoms in a non-clinical population. Cognit Ther Res. 2007;31:677-93.

12. Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR Ment Health. 2017;4:e19.

13. Frazier P, Meredith L, Greer C, et al. Randomized controlled trial evaluating the effectiveness of a web-based stress management program among community college students. Anxiety Stress Coping. 2015;28:576-86.

14. Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol. 2015;62:137-47.

15. Kvillemo P, Brandberg Y, Bränström R. Feasibility and outcomes of an internet-based mindfulness training program: A pilot randomized controlled trial. JMIR Ment Health. 2016;3:e33.

16. Levin ME, Hayes SC, Pistorello J, Seeley JR. Web-based self-help for preventing mental health problems in universities: Comparing acceptance and commitment training to mental health education. J Clin Psychol. 2016;72:207-25.

17. Levin ME, Haeger JA, Pierce BG, Twohig MP. Web-based acceptance and commitment therapy for mental health problems in college students. Behav Modif. 2017;41:141-62.
-1818. Levin ME, Pistorello J, Seeley JR, Hayes SC. Feasibility of a prototype web-based acceptance and commitment therapy prevention program for college students. J Am Coll Health. 2013;62:20-30.,2424. Brown LA, Forman EM, Herbert JD, Hoffman KL, Yuen EK, Goetter EM. A randomized controlled trial of acceptance-based behavior therapy and cognitive therapy for test anxiety: A pilot study. Behav Modif. 2011;35:31-53.

25. Eustis EH, Williston SK, Morgan LP, Graham JR, Hayes-Skelton SA, Roemer L. Development, acceptability, and effectiveness of an acceptance-based behavioral stress/anxiety management workshop for university students. Cogn Behav Pract. 2017;24:174-86.
-2626. Danitz SB, Orsillo SM. The mindful way through the semester: An investigation of the effectiveness of an acceptance-based behavioral therapy program on psychological wellness in first-year students. Behav Modif. 2014;38:549-66. The present study thus utilized a randomized waitlist control design to examine the preliminary effectiveness of a 45-minute, DBT-informed, stress and anxiety management workshop delivered asynchronously online. We hypothesized that, controlling for baseline measures, students in the workshop group would experience lower depression, anxiety, and stress compared to those in the waitlist control group at 1-week follow-up. Additionally, we hypothesized that, controlling for baseline measures, students in the workshop group would experience greater self-efficacy to regulate stress and anxiety compared to the waitlist control group at 1-week follow-up.

Methods

Participants

The study protocol was approved by the institutional review board of the Nevada State College, Henderson, NV, USA. We advertised the study on an open-access 4-year college campus using e-mails and course announcements advertising a two-part online Qualtrics study about a “stress and anxiety management workshop”. The study was open to all individuals meeting the inclusion criteria of being a current student aged from 18 to 65. All participants were randomly assigned by Qualtrics to the workshop or waitlist control conditions. A total of 131 participants (workshop = 65; waitlist control = 66) completed part one of the study, 97 of whom (workshop = 49; waitlist control = 48) completed part two at 1-week follow-up. The participant flowchart is shown in Figure 1. Study completers and non-completers were compared at baseline and no significant differences were found in any outcome measures (p values = 0.24-0.85). The demographic characteristics are shown in Table 1.

Figure 1
Flow chart representing study methodology and participant flow through conditions.

Table 1
Demographic characteristics

Measures

Depression, Anxiety, and Stress Scales – 21 item (DASS-21)3232. Lovibond SH, Lovibond PF. Manual for the Depression and Anxiety Stress Scales. Sydney: Psychology Foundation of Australia; 1995.

This 21-item self-report measure consists of three subscales: the depression subscale (DASS-D), the anxiety subscale (DASS-A), and the stress subscale (DASS-S). Each subscale is examined to measure symptoms of depression (DASS-D), situation-specific affective symptoms of anxiety (DASS-A), and generalized physiological symptoms of anxiety (DASS-S). Participants rated items on a scale from 0 (did not apply to me at all) to 3 (applied to me very much or most of the time). We used the DASS-21 to measure participants’ symptoms of depression, anxiety, and stress at baseline and at 1-week follow-up. The DASS-21 has been shown to have good convergent and discriminant validity and good internal consistency.3333. Brown TA, Chorpita BF, Korotitsch W, Barlow DH. Psychometric properties of the depression anxiety stress scales (DASS) in clinical samples. Behav Res Ther. 1997;35:79-89. Similarly, the measure demonstrated good internal consistency in our sample at baseline (α = 0.94) and at 1-week follow-up (α = 0.95).

Anxiety Self-Efficacy (ASE)

The ASE is a two-item, self-report measure created for this study, assessing respondents’ perceived ability to manage and tolerate anxiety. Participants utilized a 1 (not at all) to 9 (very) Likert response scale. All items were taken from the Self-Efficacy for Social Situation Scale (SESS)3434. Gaudiano BA, Herbert JD. Preliminary psychometric evaluation of a new self-efficacy scale and its relationship to treatment outcome in social anxiety disorder. Cognit Ther Res. 2003;27:537-55. and modified to be about stress and anxiety tolerance and management skills (e.g.: “Is it possible for you to tolerate and manage stress and anxiety well, despite any weaknesses you might have in stress and anxiety tolerance and management skills?”) rather than about social skills (e.g.: “Is it possible for you to perform well in social situations, despite any weaknesses you might have in social skills?”). The ASE was administered to assess participants’ self-efficacy to tolerate and manage stress and anxiety at baseline and at 1-week follow-up. The ASE demonstrated good internal consistency in our sample at baseline (α = 0.82) and at 1-week follow-up (α = 0.87)

Stress and Anxiety Management Workshop

The self-guided Stress and Anxiety Management Workshop was delivered asynchronously through Qualtrics and consisted of eight videos recorded by the first and second authors. To maximize student attention to the workshop and to reduce fatigue, all videos were less than 5 minutes long (range: 1 minute and 10 seconds to 4 minutes and 49 seconds). Each video was also followed by one to three engagement or reflection questions, which asked participants to reflect on their experiences with stress and anxiety and how they could apply each skill learned over the next week and to their daily lives. Each video and its corresponding engagement questions were presented on their own page. To ensure that participants watched the videos, each page was timed to the length of the video so that participants could not move on until the allotted time had passed. Participants were able to re-watch videos.

The workshop content was adapted from the distress tolerance and emotion regulation modules of the DBT skills manual.2222. Linehan MM. Skills training manual for treating borderline personality disorder. New York: Guilford; 1993.,2323. Linehan MM. DBT training manual. New York: The Guilford Press; 2014. Participants were first provided psychoeducation on the prevalence, consequences, symptoms, and function of stress and anxiety. Participants then learned about methods of tolerating their stress and anxiety in the moment by learning and practicing the TIPP skills.2323. Linehan MM. DBT training manual. New York: The Guilford Press; 2014. Participants also learned about methods of reducing vulnerability to stress and anxiety by learning the ABC Please skill.2323. Linehan MM. DBT training manual. New York: The Guilford Press; 2014. We chose to focus the workshop on teaching participants skills for tolerating and regulating stress and anxiety, given research on their negative associations with stress and anxiety.3535. Huang K, Szabo M, Han J. The relationship of low distress tolerance to excessive worrying and cognitive avoidance. Behav Change. 2009;26:223-34.

36. Keough ME, Riccardi CJ, Timpano KR, Mitchell MA, Schmidt NB. Anxiety symptomatology: The association with distress tolerance and anxiety sensitivity. Behav Ther. 2010;41:567-74.
-3737. Timpano KR, Buckner JD, Richey JA, Murphy DL, Schmidt NB. Exploration of anxiety sensitivity and distress tolerance as vulnerability factors for hoarding behaviors. Depress Anxiety. 2009;26:343-53.

Procedures

After providing informed consent, all participants were randomly assigned to either the workshop or waitlist control condition by Qualtrics. Participants in the workshop condition completed the baseline measures of the demographics questionnaire, the DASS-21, and the ASE, then completed the asynchronously delivered self-guided stress and anxiety management workshop. Participants in the waitlist control condition only completed the baseline measures.

Participants in both groups were then informed that they would receive a link to part two of the study in 1 week and be compensated with course research credit or a $10 Tango Rewards gift card, which allows participants to receive a gift card for a vendor of their choice. All participants were then automatically emailed a receipt for the compensation. Participants in the workshop condition also received a copy of the workshop slides.

After 1 week, participants were emailed a link to part two, and were asked to complete part two within the next 3 days, as the link to part two expired after 3 days. We chose to set an expiration date on the link to control for time elapsed since part one. Participants on the workshop condition completed DASS-21 and ASE follow-up measures and participants on the waitlist control condition completed the follow-up measures and the workshop. Participants were again compensated with either course research credit or a $10 Tango Rewards gift card and automatically emailed a compensation receipt. Participants in the waitlist control condition also received a copy of the workshop slides.

Statistical analysis

Our descriptive statistics were reported as frequencies, percentages, and means and standard deviations. To examine differences between outcome and demographic variables at baseline, we conducted t tests for continuous variables and chi-square analyses for categorical variables. For our primary analysis, we conducted a multivariate analysis of variance (MANCOVA) to examine differences in outcome variables at 1-week follow-up between conditions, with baseline scores of all outcome variables entered as covariates. Finally, to examine relations between outcome variables, we calculated residualized gain scores and conducted a correlation analysis. All data were analyzed using the Statistical Package for the Social Sciences (SPSS) version 22 and the significance level adopted was 0.05.

Results

Preliminary analyses

Table 2 provides the descriptive statistics for all outcome variables. All skewness and kurtosis values were within acceptable ranges. To examine differences between outcome and demographic variables at baseline, we conducted t tests for continuous variables and chi-square analyses for categorical variables. Although participants were randomized to the groups, initial pre-workshop scores on the DASS-D and DASS-S were significantly higher in the workshop group than in the waitlist control group (t[129] = -2.46, p = 0.02; t[129] p = 0.02, respectively). Scores on the DASS-A and the ASE did not differ significantly between groups (p = 0.17; p = 0.36, respectively). Baselines scores between groups also did not differ between age, gender, sexual orientation, race, or therapy experience (p values = 0.11-0.97).

Table 2
Outcome variables by condition

Primary analyses

We conducted a MANCOVA to test the hypothesis that, compared to waitlist control, students in the workshop group would experience greater decreases in depression, anxiety, and stress, and greater increases in self-efficacy to regulate stress and anxiety. The independent variable was condition (workshop group versus waitlist control group), and the dependent variables were DASS-D, DASS-A, DASS-S, and ASE scores at 1-week follow-up (Table 2). To adjust for baseline scores, baseline scores of all four outcome measures were entered as covariates. The results indicated that, controlling for baseline measures, the combined dependent variables were significantly different between groups with a large effect size, F(4, 88) = 4.98, p = 0.001, ηp2 = 0.18. Univariate analyses indicated that, controlling for baseline measures, students in the workshop group experienced significantly lower DASS-S scores with a medium effect size, F(1, 91) = 13.42, p < 0.001, ηp2 = 0.13, and significantly higher ASE scores with a medium effect size, F(1, 91) = 13.60, p < 0.001, ηp2 = 0.13. In contrast, there was no significant difference between groups in DASS-D scores, F(1, 91) = 2.87, p = 0.09, ηp2 = 0.03, or DASS-A scores, F(1, 91) = 3.20, p = 0.08, ηp2 = 0.03.

Additional analyses

Finally, given the findings indicating that only the DASS-S and ASE were significantly different between groups, as well as the literature implicating self-efficacy as an important mechanism of change in therapeutic outcomes, we examined the relations between the residualized gain scores, which adjust for baseline scores, for the DASS-D, DASS-A, DASS-S, and the ASE.

The findings indicated that the ASE residualized gains score was significantly associated with the DASS-S, r = -0.36, p < 0.001, but not the DASS-D, r = -0.16, p = 0.12, or the DASS-A, r = -0.20, p = 0.052.

Discussion

To increase accessibility to evidence-based interventions for stress and anxiety in college students, researchers have examined the positive outcomes of self-guided interventions delivered asynchronously online, single-session acceptance-based workshops, or abbreviated DBT skills-informed interventions. As such, the purpose of this study was to examine the preliminary effectiveness of a self-guided, DBT skills-informed stress and anxiety management workshop delivered asynchronously online. We hypothesized that, compared to waitlist controls, students completing the workshop would experience greater self-efficacy to regulate stress and anxiety, as well as lower depression, anxiety, and stress at 1-week follow-up. The results indicated that, controlling for baseline scores, participants in the workshop condition experienced significantly less stress and significantly greater self-efficacy to regulate stress and anxiety at 1-week follow-up compared to waitlist controls. This is consistent with the literature, which has similarly indicated that stress decreased2525. Eustis EH, Williston SK, Morgan LP, Graham JR, Hayes-Skelton SA, Roemer L. Development, acceptability, and effectiveness of an acceptance-based behavioral stress/anxiety management workshop for university students. Cogn Behav Pract. 2017;24:174-86.,3030. Rizvi SL, Steffel LM. A pilot study of 2 brief forms of dialectical behavior therapy skills training for emotion dysregulation in college students. J Am Coll Health. 2014;62:434-9. and perceived emotion regulation increased2828. Muhomba M, Chugani CD, Uliaszek AA, Kannan D. Distress tolerance skills for college students: A pilot investigation of a brief DBT group skills training program. J Coll Stud Psychother. 2017;31:247-56.

29. Panepinto AR, Uschold CC, Olandese M, Linn BK. Beyond borderline personality disorder: Dialectical behavior therapy in a college counseling center. J Coll Stud Psychother. 2015;29:211-26.

30. Rizvi SL, Steffel LM. A pilot study of 2 brief forms of dialectical behavior therapy skills training for emotion dysregulation in college students. J Am Coll Health. 2014;62:434-9.
-3131. Uliaszek AA, Rashid T, Williams GE, Gulamani T. Group therapy for university students: A randomized control trial of dialectical behavior therapy and positive psychotherapy. Behav Res Ther. 2016;77:78-85. following completion of an abbreviated acceptance-based intervention.

Of note, both the previous literature and the present study utilized the DASS-S to measure stress, which has been most closely related to physiological symptoms of generalized anxiety.3232. Lovibond SH, Lovibond PF. Manual for the Depression and Anxiety Stress Scales. Sydney: Psychology Foundation of Australia; 1995.,3838. Rutter LA, Brown TA. Psychometric properties of the Generalized Anxiety Disorder Scale-7 (GAD-7) in outpatients with anxiety and mood disorders. J Psychopathol Behav Assess. 2017;39:140-6. As such, results may indicate that the workshop was effective in increasing participants’ perceived ability to manage stress and anxiety, and in reducing physiological symptoms of generalized anxiety at 1-week follow-up. This is consistent with the workshop content, which focused on methods of reducing physiological arousal in the moment (via the TIPP skill) and on incorporating behavioral changes to promote physical and mental health and resiliency (via ABC Please).

Contrary to our hypothesis, the results also indicated that depression and anxiety were not significantly lower at 1-week follow-up compared to waitlist controls. Of note, the present study utilized the DASS-A to measure anxiety, which has been most closely related to situation-specific experiences of anxiety and fear (e.g., panic, social anxiety, phobias).3232. Lovibond SH, Lovibond PF. Manual for the Depression and Anxiety Stress Scales. Sydney: Psychology Foundation of Australia; 1995. As such, it is possible that our workshop, while targeting physiological symptoms of generalized anxiety, does not target situation-based fear and anxiety due to its delivery, length, and/or content. For example, unlike previous interventions that resulted in lower depression2626. Danitz SB, Orsillo SM. The mindful way through the semester: An investigation of the effectiveness of an acceptance-based behavioral therapy program on psychological wellness in first-year students. Behav Modif. 2014;38:549-66. or lower anxiety2525. Eustis EH, Williston SK, Morgan LP, Graham JR, Hayes-Skelton SA, Roemer L. Development, acceptability, and effectiveness of an acceptance-based behavioral stress/anxiety management workshop for university students. Cogn Behav Pract. 2017;24:174-86.,2929. Panepinto AR, Uschold CC, Olandese M, Linn BK. Beyond borderline personality disorder: Dialectical behavior therapy in a college counseling center. J Coll Stud Psychother. 2015;29:211-26.,3131. Uliaszek AA, Rashid T, Williams GE, Gulamani T. Group therapy for university students: A randomized control trial of dialectical behavior therapy and positive psychotherapy. Behav Res Ther. 2016;77:78-85. our workshop was conducted asynchronously online. Thus, it is possible that our workshop allowed for social isolation and decreased behavioral activation in a way that in-person interventions, which provide social support and an opportunity for behavioral activation, do not.

Our workshop was also significantly shorter (45 minutes) than previous interventions (range: 2-18 hours) and did not include mindfulness or interpersonal effectiveness skills, which may better target situation-based fear and anxiety.

Finally, our additional analyses indicated self-efficacy to regulate stress and anxiety was significantly associated with our measure of stress, but not depression or anxiety. Given self-efficacy’s role as an important mechanism of psychotherapeutic change,3939. Goldin PR, Ziv M, Jazaieri H, Werner K, Kraemer H, Heimberg RG, Gross JJ. Cognitive reappraisal self-efficacy mediates the effects of individual cognitive-behavioral therapy for social anxiety disorder. J Consult Clin Psychol. 2012;80:1034-40.

40. Lee CS, Hayes-Skelton SA. Finding personal meaning as a predictor of behavioral action over and above social anxiety. JTSP. 2020;5:26-34.

41. Lee CS, Yeghiazarian C. Personal value, self-efficacy, and social acceptability of a social behavior as correlates of behavioral action in social anxiety. Trends Psychiatry Psychother. 2021;43:217-24.
-4242. Rodebaugh TL. Self-efficacy and social behavior. Behav Res Ther. 2006;44:1831-8. these findings further indicate that our workshop was successful in targeting physiological symptoms of generalized anxiety, but not depression or situation-based fear and anxiety. To examine changes in all three constructs, while maximizing accessibility, future research should explore use of a more comprehensive intervention that still adheres to a brief, self-guided and asynchronous format.

Limitations and future directions

Our study should be considered in the context of several limitations. Importantly, we utilized a wait-list control design, in which participants in the control group did not receive a placebo or alternate intervention. As such, it is possible that the results are a due to engagement with a workshop, rather than the workshop content. Further research should thus utilize a placebo or a workshop comparison group. Although we utilized Qualtrics’ timed questions to control for engagement, we also ultimately could not fully control for participants’ engagement with the material or the presence of environmental distractions. Although this format ultimately increased external validity, we recognize that engagement with material likely impacts the extent to which participants experienced gains. Our workshop also utilized an adapted measure for self-efficacy, which was not evaluated for reliability and validity, outside of internal consistencies. However, the measure has been historically rated by a team of research assistants as having good face validity and was adapted from an established measure. Additionally, our study had relatively high attrition from part one to 1-week follow-up (25.95%). Although study non-completers did not significantly differ from study completers by condition or baseline measures, we cannot make conclusions about reasons for drop-out and future research should examine reasons for drop-out.

Several factors also impacted the generalizability of our findings. For example, because we only conducted a 1-week follow-up, we were unable to assess any long-term or sustained impacts of our workshop. As such, findings cannot be generalized as long-term changes and future research should examine outcomes after several months or years to do so. Finally, because students were recruited from a small, open-access college and were not a clinical sample, the findings cannot be generalized to other institutions or clinical samples.

Clinical implications

Despite its limitations, our findings ultimately suggest that utilizing a 45-minute self-guided DBT skills-informed workshop delivered asynchronously online can decrease physiological symptoms of generalized anxiety, but not symptoms of depression or situation-specific fear and anxiety. While further research and development is thus necessary to maximize outcomes and generalizability, the findings provide an encouraging outlook on the potential use of this modality as an easily distributed, low cost, and accessible way to disseminate evidence-based skills to student populations.

Acknowledgements

This study received financial support from the Provost Seed Grant at Nevada State College.

References

  • 1
    American College Health Association. National College Health Assessment III: Undergraduate student reference group data report fall 2019. Silver Spring: American College Health Association; 2020.
  • 2
    Byrd DR, McKinney KJ. Individual, interpersonal, and institutional level factors associated with the mental health of college students. J Am Coll Health. 2012;60:185-93.
  • 3
    Ketchen Lipson S, Gaddis SM, Heinze J, Beck K, Eisenberg D. Variations in student mental health and treatment utilization across us colleges and universities. J Am Coll Health. 2015;63:388-96.
  • 4
    Syed M, Azmitia M. Longitudinal trajectories of ethnic identity during the college years. J Res Adolesc. 2009;19:601-24.
  • 5
    Liu CH, Stevens C, Wong SHM, Yasui M, Chen JA. The prevalence and predictors of mental health diagnoses and suicide among US college students: Implications for addressing disparities in service use. Depress Anxiety. 2018;36:8-17.
  • 6
    Soet J, Sevig T. Mental health issues facing a diverse sample of college students: Results from the college student mental health survey. J NASPA. 2006;43:410-31.
  • 7
    Corrigan PW, Watson AC. Understanding the impact of stigma on people with mental illness. World Psychiatry. 2002;1:16-20.
  • 8
    National Alliance on Mental Illness. College students speak: A survey report on mental health. National Alliance on Mental Illness; 2012.
  • 9
    Watson AC, Corrigan P, Larson JE, Sells M. Self-stigma in people with mental illness. Schizophr Bull. 2007;33:1312-8.
  • 10
    Chiauzzi E, Brevard J, Thurn C, Decembrele S, Lord S. MyStudentBody–Stress: An online stress management intervention for college students. J Health Commun. 2008;13:555-72.
  • 11
    Cukrowicz KC, Joiner TE. Computer-based intervention for anxious and depressive symptoms in a non-clinical population. Cognit Ther Res. 2007;31:677-93.
  • 12
    Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR Ment Health. 2017;4:e19.
  • 13
    Frazier P, Meredith L, Greer C, et al. Randomized controlled trial evaluating the effectiveness of a web-based stress management program among community college students. Anxiety Stress Coping. 2015;28:576-86.
  • 14
    Hintz S, Frazier PA, Meredith L. Evaluating an online stress management intervention for college students. J Couns Psychol. 2015;62:137-47.
  • 15
    Kvillemo P, Brandberg Y, Bränström R. Feasibility and outcomes of an internet-based mindfulness training program: A pilot randomized controlled trial. JMIR Ment Health. 2016;3:e33.
  • 16
    Levin ME, Hayes SC, Pistorello J, Seeley JR. Web-based self-help for preventing mental health problems in universities: Comparing acceptance and commitment training to mental health education. J Clin Psychol. 2016;72:207-25.
  • 17
    Levin ME, Haeger JA, Pierce BG, Twohig MP. Web-based acceptance and commitment therapy for mental health problems in college students. Behav Modif. 2017;41:141-62.
  • 18
    Levin ME, Pistorello J, Seeley JR, Hayes SC. Feasibility of a prototype web-based acceptance and commitment therapy prevention program for college students. J Am Coll Health. 2013;62:20-30.
  • 19
    Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital mental health interventions for depression, anxiety, and enhancement of psychological well-being among college students: Systematic review. J Med Internet Res. 2019;21:e12869.
  • 20
    Orsillo SM, Roemer L. The mindful way through anxiety: Break free from chronic worry and reclaim your life. New York: Guilford; 2011.
  • 21
    Hayes SC, Strosahl KD, Wilson KG. Acceptance and commitment therapy: An experiential approach to behavior change. New York: Guilford; 1999.
  • 22
    Linehan MM. Skills training manual for treating borderline personality disorder. New York: Guilford; 1993.
  • 23
    Linehan MM. DBT training manual. New York: The Guilford Press; 2014.
  • 24
    Brown LA, Forman EM, Herbert JD, Hoffman KL, Yuen EK, Goetter EM. A randomized controlled trial of acceptance-based behavior therapy and cognitive therapy for test anxiety: A pilot study. Behav Modif. 2011;35:31-53.
  • 25
    Eustis EH, Williston SK, Morgan LP, Graham JR, Hayes-Skelton SA, Roemer L. Development, acceptability, and effectiveness of an acceptance-based behavioral stress/anxiety management workshop for university students. Cogn Behav Pract. 2017;24:174-86.
  • 26
    Danitz SB, Orsillo SM. The mindful way through the semester: An investigation of the effectiveness of an acceptance-based behavioral therapy program on psychological wellness in first-year students. Behav Modif. 2014;38:549-66.
  • 27
    Ward-Ciesielski EF, Jones CB, Wielgus MD, Wilks CR, Linehan MM. Single-session dialectical behavior therapy skills training versus relaxation training for non-treatment engaged suicidal adults: A randomized controlled trial. BMC Psychol. 2016;4:13.
  • 28
    Muhomba M, Chugani CD, Uliaszek AA, Kannan D. Distress tolerance skills for college students: A pilot investigation of a brief DBT group skills training program. J Coll Stud Psychother. 2017;31:247-56.
  • 29
    Panepinto AR, Uschold CC, Olandese M, Linn BK. Beyond borderline personality disorder: Dialectical behavior therapy in a college counseling center. J Coll Stud Psychother. 2015;29:211-26.
  • 30
    Rizvi SL, Steffel LM. A pilot study of 2 brief forms of dialectical behavior therapy skills training for emotion dysregulation in college students. J Am Coll Health. 2014;62:434-9.
  • 31
    Uliaszek AA, Rashid T, Williams GE, Gulamani T. Group therapy for university students: A randomized control trial of dialectical behavior therapy and positive psychotherapy. Behav Res Ther. 2016;77:78-85.
  • 32
    Lovibond SH, Lovibond PF. Manual for the Depression and Anxiety Stress Scales. Sydney: Psychology Foundation of Australia; 1995.
  • 33
    Brown TA, Chorpita BF, Korotitsch W, Barlow DH. Psychometric properties of the depression anxiety stress scales (DASS) in clinical samples. Behav Res Ther. 1997;35:79-89.
  • 34
    Gaudiano BA, Herbert JD. Preliminary psychometric evaluation of a new self-efficacy scale and its relationship to treatment outcome in social anxiety disorder. Cognit Ther Res. 2003;27:537-55.
  • 35
    Huang K, Szabo M, Han J. The relationship of low distress tolerance to excessive worrying and cognitive avoidance. Behav Change. 2009;26:223-34.
  • 36
    Keough ME, Riccardi CJ, Timpano KR, Mitchell MA, Schmidt NB. Anxiety symptomatology: The association with distress tolerance and anxiety sensitivity. Behav Ther. 2010;41:567-74.
  • 37
    Timpano KR, Buckner JD, Richey JA, Murphy DL, Schmidt NB. Exploration of anxiety sensitivity and distress tolerance as vulnerability factors for hoarding behaviors. Depress Anxiety. 2009;26:343-53.
  • 38
    Rutter LA, Brown TA. Psychometric properties of the Generalized Anxiety Disorder Scale-7 (GAD-7) in outpatients with anxiety and mood disorders. J Psychopathol Behav Assess. 2017;39:140-6.
  • 39
    Goldin PR, Ziv M, Jazaieri H, Werner K, Kraemer H, Heimberg RG, Gross JJ. Cognitive reappraisal self-efficacy mediates the effects of individual cognitive-behavioral therapy for social anxiety disorder. J Consult Clin Psychol. 2012;80:1034-40.
  • 40
    Lee CS, Hayes-Skelton SA. Finding personal meaning as a predictor of behavioral action over and above social anxiety. JTSP. 2020;5:26-34.
  • 41
    Lee CS, Yeghiazarian C. Personal value, self-efficacy, and social acceptability of a social behavior as correlates of behavioral action in social anxiety. Trends Psychiatry Psychother. 2021;43:217-24.
  • 42
    Rodebaugh TL. Self-efficacy and social behavior. Behav Res Ther. 2006;44:1831-8.

Publication Dates

  • Publication in this collection
    20 Oct 2023
  • Date of issue
    2023

History

  • Received
    13 Dec 2021
  • Accepted
    02 June 2022
Associação de Psiquiatria do Rio Grande do Sul Av. Ipiranga, 5311/202, 90610-001 Porto Alegre RS/ Brasil, Tel./Fax: (55 51) 3024 4846 - Porto Alegre - RS - Brazil
E-mail: trends@aprs.org.br