SciELO - Scientific Electronic Library Online

 
vol.29 número2La conectividad, la implicación y el aprendizaje mediante comunidades de trabajo social en LinkedIn índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Em processo de indexaçãoCitado por Google
  • Não possue artigos similaresSimilares em SciELO
  • Em processo de indexaçãoSimilares em Google

Compartilhar


Psychosocial Intervention

versão On-line ISSN 2173-4712versão impressa ISSN 1132-0559

Psychosocial Intervention vol.29 no.2 Madrid Mai. 2020  Epub 11-Maio-2020

https://dx.doi.org/10.5093/pi2020a7 

Articles

Cooperation after divorce: an RCT study of the effects of a digital intervention platform on self-perceived stress

La cooperación después del divorcio: un estudio RCT sobre los efectos en el estrés percibido de una intervención basada en una plataforma digital

Ana Ciprica  , Jenna M Strizzia  , Camilla S Øverupa  , Theis Langea  , Aleksandar Štulhoferb  , Søren Sandera  , Simone Gad-Kjelda  , Gert M Halda 

aUniversity of Copenhagen, Denmark.

bUniversity of Zagreb, Croatia.

ABSTRACT

Divorce has long been considered one of the most pervading stressful life events and has consistently been associated with high stress levels and subsequent poorer mental- and physical health. This study evaluates the effectiveness of the Cooperation after Divorce (CAD) online intervention on perceived stress immediately following divorce. The study's design was a one-year longitudinal randomized controlled trial including an intervention group (n = 1,031) and a no-treatment control group (n = 825) with four assessments of perceived stress levels (at baseline and 3, 6 and 12-months post-divorce). The CAD intervention consists of a 17-module online platform designed to support divorcees and their children post-divorce. Data analyses consisted of linear mixed effect modeling and means comparisons. The study found that the intervention significantly accelerated the reduction of perceived stress among recently divorced adults when compared with controls. Further, after one year, stress levels in the intervention group were reduced to normed national stress levels while the mean stress level in the control group remained substantially higher. The results suggest that online interventions may offer long-term public health benefits in reducing stress among newly divorced individuals and speak to potential implications related to the services provided for people undergoing divorce.

Keywords: Self-perceived stress; Divorce; Marital dissolution; RCT; Digital intervention

RESUMEN

El divorcio se ha considerado como uno de los eventos estresantes de la vida más persistentes y se ha asociado repetidamente con altos niveles de estrés y el deterioro de la salud mental y física. Este estudio evalúa la eficacia de la intervención online Cooperación Después del Divorcio (CAD) en el estrés percibido inmediatamente después de su ocurrencia. El diseño del estudio fue un ensayo controlado aleatorio longitudinal de un año que incluyó un grupo de intervención (n = 1,031) y otro de control sin tratamiento (n = 825) con cuatro evaluaciones del nivel de estrés percibido (línea base y 3, 6 y 12 meses después del divorcio). La intervención CAD consiste en una plataforma online de 17 módulos diseñada para apoyar a los divorciados y sus hijos después del divorcio. Los análisis de datos consistieron en modelos lineales de efectos mixtos y comparación de medias. El estudio encontró que la intervención aceleró significativamente la reducción del estrés percibido entre los adultos recientemente divorciados en comparación con el grupo control. Además, después de un año, el nivel de estrés en el grupo de intervención se redujo al nivel de estrés nacional normativo, mientras que el nivel de estrés promedio en el grupo control permaneció sustancialmente más alto. Los resultados sugieren que las intervenciones online pueden ofrecer ventajas para la salud pública a largo plazo para reducir el estrés entre las personas recién divorciadas y pueden tener implicaciones para los servicios que se prestan a las personas que se encuentran en un proceso de divorcio.

Palabras clave: Estrés percibido; Divorcio; Disolución del matrimonio; RCT; Intervención digital

Introduction

In most industrialized societies, including Denmark where the current study was conducted, the divorce rate exceeds 40% (Centers for Disease Control and Prevention, 2016; European Commission, 2015; Statistics Denmark, 2017). Divorce has consistently been found to be among the most stressful life events and is often perceived as a prolonged stressful situation by divorcees (Dohrenwend et al., 1978; Freeman et al., 2008; Hobson & Delunas, 2001). Experiencing a stressful life event and prolonged exposure to stressful situations are associated with an increased risk of illness and poorer overall physical and mental health. This includes bodily distress syndrome, increased depression and anxiety symptoms, unhealthy behaviors, such as smoking and physical inactivity, and reduced social interaction and support (Budtz-Lilly et al., 2015; Cohen et al., 1997; Danese & McEwen, 2012; Fink & Rosendal, 2015; Kessing et al., 2003; Nielsen et al., 2014; Sutin et al., 2010).

Psychological stress refers to an individual's evaluation of environmental experiences as threatening, excessively demanding, and/or potentially harmful coupled with the perception of inadequate abilities to cope with the experience (Allen et al., 2014; Cohen et al., 1997). Perceived stress refers to the degree to which people find their lives or specific (life) events stressful, appraises one's situation as unpredictable, and feel unable to manage day-to-day challenges and that one's problems keep piling up (Cohen et al., 1983; Dissing et al., 2019).

Although divorce is considered one of the most stressful life events, researchers and theorists highlight the importance of coping processes when studying the impact of these events on stress responses (Cohen et al., 1983). Therefore, this study focuses on perceived stress by assessing the experienced level of stress as a function of an objective stressful event (in this case, divorce) and coping processes (here, the coping skills obtained through the study intervention tested; Cohen et al., 1983).

In Denmark, where the current study was conducted, divorcees report the highest levels of perceived stress when compared to their continuously married, widowed, or single counterparts (Nielsen et al., 2008). This indicates that although adverse effects of divorce, such as stress, may be sensitive to a 'time heals' effect (Hald et al., in press; Thuen, 2001), whereby perceived stress naturally declining over time, to many divorcees post-divorce life remains stressful (Amato, 2014; Booth & Amato, 1991; Strohschein, 2005). This may be due to co-parenting, fewer financial resources, change of living condition, altered social status, loss of social support, and (eventually) new partners and new family members with stepfamilies being introduced (e.g., Kołodziej-Zaleska & Przybyła-Basista, 2016; Leopold, 2018; Perrig-Chiello et al., 2015). Accordingly, the development and effect testing of interventions which targets the divorcee's experience of stress over time is of public health relevance especially considering that prolonged levels of high stress can detrimentally affect health-related outcomes and be a significant financial burden to society (Budtz-Lilly et al., 2015; Fink & Rosendal, 2015).

The majority of divorce-related intervention programs have focused on children, divorce conflict, and co-parenting skills as the outcomes (Boring et al., 2015; Greenberg et al., 2019; Klein Velderman et al., 2018; McIntosh & Tan, 2017; Pelleboer-Gunnink et al., 2015; Sandler et al., 2018). Those that have targeted adults typically focus on depression or post-divorce adjustment as the outcomes in intervention assessment (e.g. Apraiz et al., 2015; Brodbeck et al., 2017; Yárnoz et al., 2008).

To the best of our knowledge, there are no published longitudinal RCT studies on the effectiveness of online interventions in reducing perceived stress among recently divorced adults. In this connection, researchers, health care professionals, public policymakers, and other stakeholders have highlighted both the need for and lack of research and evidence-based online interventions for adults and children experiencing divorce, particularly scalable cost-effective online interventions. Online interventions have the potential to improve availability, and often have greater convenience of use, equity, and cost-effectiveness than more traditional face-to-face interventions (Amato, 2000; Bowers et al., 2011, 2014; Dennis & Ebata, 2005; Eysenbach et al., 2011; Schramm & McCaulley, 2012).

To address this gap in knowledge, our study presents the results of a one-year longitudinal RCT digital intervention called 'Cooperation after Divorce' (CAD), focusing on the reduction of perceived stress levels among recently divorced individuals.

Specifically, we hypothesize and investigate the following:

Hypothesis 1: The CAD digital intervention will significantly decrease self-perceived stress among divorcees over a one-year period.

Research question 1: At the one-year follow-up, how will self-perceived stress levels be in the intervention and control group, respectively, compare with those of the Danish background population?

Method

Participants

A total of 1,856 recently divorced Danish residents (66.8% women) completed the baseline survey on average 4.74 days (SD = 7.10 days) after they obtained their juridical divorce and entered the present study. The average age of participants was 45.32 years (SD = 8.66). On average, participants had been married 12.74 years (SD = 8.03) before their divorce and for almost 88% of participants this was their first divorce. Most of the sample reported to have children (88.3%) with an average of 1.88 child (SD = 0.99) per participant. On average, children were13.50 years of age (SD = 8.16) at the time of divorce. For further sample description, please see Table 1.

Table 1. Descriptive Sample Characteristics of Recently Divorced Danes 

NoteThere were no significant between groups differences.

1Possible value range.

Response rates. Participants were recruited through an e-mail invitation along with the official divorce decree, which was sent by the Danish State Administration (DSA). As the DSA was not able to provide an exact number of survey links distributed during the study inclusion period (January 2016 to January 2018), the exact response rates cannot be calculated. Of the 1,882 individuals who agreed to participate in the study, 1,856 (98.6%) completed the baseline questionnaire and comprised the final analytical sample (see also Figure 1).

Figure 1. CONSORT Diagram 

Representativeness of the study sample. To assess possible response bias, the study sample was compared to national population data for all people who divorced in Denmark during the study period obtained from Statistics Denmark. The study sample was representative in terms of age, income, and marriage duration, but included more female participants, c2(1, n = 1,856) = 208.45, p < .001, more highly educated individuals, c2(2, n = 1,856) = 1135.23, p < .001, and individuals with fewer previous divorces, t(1855) = -8.47, p < .001 compared with the background population of divorcees.

Randomization bias. Randomization was conducted by the system on a two-week sequential interval schedule so that during the two-week period all people who enrolled in the study were assigned to either the intervention or the control group (depending on the two-week period schedule assignment). This resulted in a total of 27 recruitment rounds for the intervention group and 27 recruitment rounds for the control group (i.e., 108 weeks in total).

The assignment schedule was blinded to the researchers during the inclusion period. However, at certain times during the data collection process, the intervention received heavy media coverage, which may have influenced the likelihood of divorcees to join the study during these periods and explain the uneven allocation ratios (i.e., control group 44.5%; intervention group 55.5%). A total of 1,882 participants enrolled in the study and upon completion of the baseline survey, 1,050 were randomized into the intervention, and 832 into the control group. Of the individuals assigned to the intervention group, less than 1 percent (n = 8) elected not to use the intervention during the intervention period.

To assess possible selection bias introduced by allocation into the intervention or control groups, participants in these groups were compared on sociodemographic variables (gender, age at survey, education, income), divorce-related characteristics (marriage duration, times divorced, divorce initiation, having children, conflict degree with a former spouse), and relevant health-related variables (depression, anxiety, stress, and mental and physical health). There were no significant differences observed in the odds ratios of belonging to either of the two groups suggesting that the study randomization was successful (for details, see Table 1).

Attrition rate. Consistent with the high dropout rates of online-health evaluations (Donkin et al., 2011; Eysenbach, 2005; Geraghty et al., 2012; Lie et al., 2017) response rates dropped to 27.9% from T1 (n = 1,050) to T2 (n = 293) in the intervention group and to 29.8% from T1 (n = 832) to T2 (n = 248) in the control group. Attrition substantially decreased afterward, resulting in little change in group size over subsequent follow-ups (intervention group: T3 = 320 and T4 = 295; control group: T3 = 238 and T4 = 211).

Attrition bias. To determine if the attrition rate biased our findings, participants who only participated at baseline were compared to the rest of the sample in both the control and intervention groups. Participants were compared on sociodemographic (group membership, gender, age at survey, education, income), divorce-related (times divorced, marriage duration, number of children, conflict degree with a former spouse), and mental and physical health indicators (depression, anxiety, somatization, stress, mental and physical health). In the intervention group, multiple logistic regression analysis revealed that younger participants (AOR = -0.99, p < .05) and those of poorer physical health (AOR = -0.91, p < .05) were more likely to drop out. No indicators significantly predicted group membership in the control group. Nevertheless, all selected variables were included as controls in the main analyses. Further details are provided in Appendix A and B.

Procedure

These results are part of a larger 12-month longitudinal RCT study entitled Cooperation after Divorce (CAD). The intervention study sought to assess effects of the CAD online intervention on well-studied negatively affected psychological and physical health outcomes associated with divorce (perceived stress, anxiety, depression, somatization, mental and physical health, hostility, and parent reports of children's health-related quality of life). The study began in July 2015 through a collaboration with the Danish State Administration (DSA).

Initially, from July 2015 to January 2016, a trial period was initiated to test the CAD solution, user functionality, and data collection process. Subsequently, the effect study was carried out from January 2016 to January 2018. During this period, people initiated their legal divorce and separation procedures through the submission of an application to the DSA. Divorce was granted immediately in cases of mutual agreement. If there was disagreement to the divorce or its terms, a 6 months separation period was initiated after which the divorce was finalized – even in the absence of mutual agreement at the end of the separation period. According to the DSA, during the study period, approximately 70% of divorces were granted divorce without a separation period. From application submission to divorce decree issuance, the average processing time was 2-3 weeks in cases of mutual agreement to the divorce. With the official juridical divorce decree, the DSA sent a participation invitation letter and information regarding the study. In order to enroll in the study, divorcees used a digital link included in the invitation letter, created an account on the CAD platform, gave informed consent, and completed the baseline survey. After this, the system randomized participants into the intervention or the control group according to the blinded randomization schedule (see the Randomization bias section for a detailed description). The control group received treatment as usual (i.e., no systematic treatment) while the intervention group received free access to the CAD intervention. There was no compensation for study participation for members of the intervention group (except for access to the intervention) whereas control group members were entered into a raffle for cinema tickets.

The 3, 6, and 12-month follow-up surveys were conducted by contacting participants via e-mail at the email addresses provided by them at baseline. All responses were anonymized and stored in anonymous form on a secure server. The study was approved by the Danish Data Protection Agency. The research was exempt from further ethical evaluations following the rules and regulations set forth by the Scientific Ethical Committees of Denmark.

The Cooperation after Divorce Intervention (CAD) Intervention Platform

The CAD digital intervention platform consists of 17 digital learning modules addressing the following dimensions and themes:

  1. Yourself, includes six themes: a) how divorce affects you, b) let go and forgive, c) coping with grief, d) ways to deal with negative thoughts, e) how to handle a crisis, and f) anger management.

  2. The Children, comprising four themes: a) how children experience divorce, b) understanding children's feelings and reactions, c) putting children's needs first, and d) how to communicate with children about divorce.

  3. Co-parenting, consists of seven themes: a) avoiding typical pitfalls, b) making clear agreements, c) how to get through holidays and birthdays, d) roads to good co-parenting communications, e) dealing with conflicts, f) create good co-parental cooperation, and g) find common ground in child-rearing (see Appendix A and B for a more detailed description of the intervention).

Participants in the intervention group accessed the online CAD intervention from a computer, mobile device, or tablet. Modules each required 30-60 minutes to complete. Module content and themes address well-known areas that are relevant to individuals after divorce (Sander & Hald, 2020) to provide a combination of knowledge and tools designed to teach divorcees relevant coping strategies, and adequate behavioral changes and behaviors. Members of the intervention group choose freely which modules to engage with, when to engage them and for how long. This individually tailored approach was employed as divorce is a heterogeneous process (e.g., Symoens et al., 2013; Malgaroli et al., 2017) and the experience and needs of divorcees may change from one individual to the next and/or over time. As the intervention is individually tailored, the ideal dosage cannot be calculated. In the current study participants on averaged used 4.27 modules (SD = 2.94). For more detailed descriptions of the CAD intervention, please see Appendix A and B.

Measures

Sociodemographic variables. Several socio-demographic variables were assessed: a) Sexual identity was assessed by the following question: “Are you a man or a woman?” with the response options: 1 = man 2 = woman; b) Age at divorce was measured in years and months; c) Education level was assessed by the question: “What is the highest education you have completed?” with the following response options: 1 = low level of education (e.g. primary school, high school, business high school, vocational education), 2 = medium level of education (e.g. medium-cycle tertiary education, bachelor's degree) and 3 = high level of education (e.g. master's degree or higher); d) Monthly income was reported on a nine-point scale with 10,000 DKK intervals (approx. 1500 USD; at the time of the intervention, 1 USD approximated 6.50 DKK), from 1 = below 10,000 DKK to 8 = more than 80,000 DKK. According to Statistics Denmark, salaries may be categorized as: 1 = below average (≤ 30,000 DKK), 2 = average (30-40,000 DKK), and 3 = above average (≥ 40,000 DKK).

Divorce-related variables. We also assessed a variety of marriage and divorce-related variables: a) Marriage duration was calculated in years and months from marital date to the official divorce date; b) Divorce duration was calculated in days from the official date of divorce to the baseline survey response date; c) Number of divorces was obtained by asking participants: “How many times have you divorced?” with response options including 1 = one time, 2 = two times, 3 = three times, and 4 = more than three times; d) Parenthood status and Number of children were determined by asking how many children the participants had; e) Children's age was calculated from the birthdate(s) provided by the participants; f) Degree of conflict was assessed by the 6-item self-report Divorce Conflict Scale (DCS). The DCS assesses six dimensions of divorce-related conflict: communication, co-parenting, global assessment of former spouse, negative and pervasive negative exchanges and hostile, insecure emotional environment, and self-perceived conflict (Hald et al., 2019). The internal consistency of the scale was high (Cronbach's α = .88).

Individual differences. We assessed various individual difference variables that were used in the attrition bias analyses. Specifically, a) Mental health and b) Physical health were assessed using the second version of the Short Form 36 (SF-36) Health Assessment (Ware et al., 1993). In the SF-36 mental- and physical health is calculated on the basis of scores on eight health-related subdomains including: physical functioning, role participation with physical health problems (role-physical), bodily pain, general health, vitality, social functioning, role participation with emotional health problems (role-emotional), and mental health. In the current study, all of the eight health-related subdomains demonstrated high internal reliability across all four time points (Cronbach's α = .81-.93).

Symptoms of c) Depression, d) Anxiety, c) Somatization, and d) Hostility were assessed using the Danish version (Olsen et al., 2004) of the Symptom Checklist-90-Revised (SCL-90-R; Derogatis, 2000). The measurement of depression included 13 items while anxiety, somatization and hostility included 10, 12, and 6 items respectively. For each item, responses were given on a 5 point Likert scale with response options 0 = not at all to 4 = very much. Higher scores indicate more symptoms of depression, anxiety, somatization, and hostility. All four scales demonstrated high internal consistency (Cronbach's α = .78-.95) at all four data collection points.

Perceived stress. The Danish version of the Perceived Stress Scale (PSS; Eskildsen et al., 2015) was used to assess the degree to which participants experienced their lives as stressful. The PSS is a 10-item self-report instrument with a five-point Likert-type response scale (0 = never, 4 = very often). Scores range from 0-40 with higher scores indicating higher perceived stress. Total sum scores over 15 for men and 17 for women are considered indicative of high-stress levels (Cohen et al., 1983; Eskildsen et al., 2015; Nielsen et al., 2008). The PSS has been widely used in research and demonstrated good internal reliability at all measurement points in the current study (Cronbach's α = .90-.92).

User data. Intervention usage was determined by summing the number of started and completed modules of each participant over the 12 months study period.

Data Analyses

Data were analyzed and reported on an intention to treat (ITT) basis by including all randomized participants in the statistical analysis regardless of the received treatment (Gupta, 2011). To enable robustness of the longitudinal estimates, along with the assessment of attrition bias (please see the Participant section), all available data were used in the full information maximum likelihood (FIML) estimation approach to protect against any informative missing pattern (Little, 2013). In this method, missing values are not replaced or imputed, but the model is estimated with all available information and provided with population parameters that would most likely produce the estimates from the sample data analysed.

A linear mixed-effect regression modeling was employed using the lme4 package for R version 3.5.3. The exposure variables were measurement time points, group allocation and their interaction, which were all treated as categorical variables because actual measurement times differed very little from the planned schedule and thus did not vary between participants. Treatment effects were quantified as mean differences at 3, 6, and 12-months with Cohen's d effect sizes inferred from the model fit (i.e., the mean difference divided by the standard deviation on the considered outcome). Any effect of the intervention was assessed by a likelihood ratio test for no effect of group assignment at any time point while random intercept accounted for individual differences in initial stress levels. In the second step, the effects were controlled for gender, age, education, income, times divorced, number of children, duration of marriage, conflict degree, physical and mental health, depression, anxiety, somatization, and hostility levels in order to account for possible attrition bias.

To further qualify the effects of the intervention, composite stress scores at the 12-month follow-up for the intervention and control groups were compared with normed perceived stress means from a Danish national representative study by Nielsen et al. (2008) using t-tests. The study by Nielsen et al. (2008) is a Danish population study on characteristics of individuals with high levels of perceived stress in Denmark. The study comprises 10,022 participants (4,676 men and 5,346 women) from the fourth National Health Interview Survey (NHIS) conducted in 2005 in Denmark. The stress measure used in the Nielsen et al.'s (2008) study study corresponds to the measure used in the present study thereby facilitating a direct comparison of stress.

Results

The baseline (T1), average score on the self-perceived stress measure was 18.73 for men (SD = 7.18, median = 19.00, mode = 21.00, range = 0-40) and 19.87 for women (SD = 6.98, median = 20.00, mode = 21.00, range = 0-40). In total, 65% of men (sum score ≥ 15) and 58% of women (sum score ≥ 17) scored equal to or higher than the recommended cut-off value for high levels of perceived stress as suggested by Nielsen et al. (2008). There were no significant differences in self-perceived stress levels in the intervention and the control groups at baseline (b = 0.01, SE = 0.04, t = 0.25).

Pertaining to the study hypothesis, linear mixed effect modeling was employed to assess the treatment effect of the CAD intervention on self-perceived levels of stress. Overall and at each time point (i.e., at 3, 6, and 12 months post-baseline), the CAD intervention effect was found to be highly significant (p < .0001 (see Table 2 and Figure 2). Even after controlling for potential selective drop-out, at each time point the intervention group scored significantly lower on self-perceived stress than the control group (p < .0001) with the magnitude of these differences being large in size (Cohen's d = 1.40-2.21). Within-group analyses also revealed a significant (p < .0001) decline in self-perceived stress levels after 12 months indicating a time heals effect (see also the Introduction and Table 2).

Table 2. Results for the Study Outcome of Stress using Linear Mixed Effect Modeling 

Noteb = standardized regression coefficient; SE = standard error; Cohen's d = standardized measure of effect size; time effect = the control group; 1intervention group compared to the control group at baseline; 2within group comparisons, i.e., the control group compared to baseline at each time point (3, 6, 12 months); 3between group comparisons, i.e., the intervention group and the control group compared at each time point (3, 6, 12 months); 4adjusted (controlled) for the (measured) imbalances in drop-out (e.g., gender, age, education, income, times divorced, number of children, duration of marriage, conflict degree, physical and mental health, depression, anxiety, somatization and hostility levels).

*p < .05

**p < .01

***p < .001.

Note. Time point 1 = baseline; time point 2 = 3-month follow-up; time point 3 = 6-month follow-up; time point 4 = 12-month follow-up.

Figure 2. Self-perceived Stress Mean Score at each Time Point of Collection. 

A 3-way interaction between gender, group assignment, and treatment was included in the analyses to further assess the intervention effect. It was found to be non-significant (p < .05), indicating that the treatment effect of the CAD solution on self-perceived stress did not differ between men and women.

Pertaining to the study research question, Figure 3 provides contextualization of the intervention effect by comparing the average levels of perceived stress reported by the intervention group and the control group at the 12-month follow-up to Danish population based normed perceived stress data (Nielsen et al., 2008) using one-sample t-tests.

The perceived stress levels reported by participants in the intervention group did not significantly differ from the normed stress data of separated/divorced Danes from the background population at 12-month follow-up: men, t(85) = -1.01, p = .32; woman: t(140) = -0.61, p = .54 . However, compared to the general background population, women, but not men, in the intervention group scored higher on self-perceived stress at 12-month follow-up with the magnitude of this difference being small-medium in size: men, t(85) = .54, p = .59; women, t(140) = 2.32, p = .02, Cohen's d = 0.39; see also Figure 3.

In the control group, both men and women reported significantly higher stress levels than both the general Danish population, men, t(50) = 6.86, p < .001, Cohen's d = 1.94; women, t(137) = 9.77, p < .001, Cohen's d = 1.67, and separated/divorced Danes, men, t(50) = 5.91, p < .001, Cohen's d = 1.67; women, t(137) = 7.43, p < .001, Cohen's d = 1.27, with the magnitude of these differences being large in size (see Figure 3).

Figure 3. Comparisons at the 12-Month Follow-up of Self-perceived Stress Mean Scores of the Intervention and Control Groups with Danish National Normed Population Data. 

Further, we found that 61% of men (sum score ≥ 15) and 56% of women (sum score ≥ 17) in the control group scored equal to or higher than the recommended cut-off value indicative of high levels of self-perceived stress (Nielsen et al., 2008) while the corresponding numbers in the intervention group was 24% for men and 31% for women.

Discussion

Across gender and pertaining to the study hypothesis, we found that the digital intervention CAD significantly reduced self-perceived stress with the magnitude of the improvement effect being large in size and evident at both 6 and 12 months follow-ups. Moreover, pertaining to the study research question, we found that at 12-month follow-up, self-perceived stress levels for both men and women in the intervention group were not significantly different to the general background population of separated/divorced individuals whereas for the control group, stress levels were significantly elevated as compared to the general background population of separated/divorced individuals.

An important issue in the divorce literature is the question of whether divorce constitutes a crisis or chronic strain and what the post-divorce trajectories of stress are (Amato, 2000). The results of this RCT study suggest that perceived stress levels slowly decrease over the first 12 months post-divorce without intervention, similar to the findings reported elsewhere (e.g., Booth & Amato, 1991), suggesting a stress-reducing effect of time (i.e., a 'time heals effect'; Thuen, 2001). However, in this study at the 12-month follow-up, participants in the control group still reported significantly higher stress levels than normed population data, with 61% of men and 56% of women reporting stress levels equivalent to high levels of self-perceived stress (Nielsen et al., 2008). In contrast, our analysis demonstrated that the intervention group was characterized by a significant decline in perceived stress levels at all follow-up time points (3, 6, and 12 months) when compared to the control group. Further, that the intervention group's reported perceived stress levels at 12 months follow up did not differ from divorced/separated individuals in the background population and that only for women stress levels were slightly and significantly higher than those of the general population although approximately a quarter of both men and women still experienced stress levels indicative of high self-perceived stress. Overall, we find that these results suggest that in a stress perspective, divorce may both be understood as a crisis from which most divorcees recuperate with the right support and as chronic strain. This interpretation corroborates divorce studies suggesting that in the longer-term (i.e., 3+ years), most divorcees adapt quite well to divorce while approximately 20% of divorcees experience pronounced psychological problems and lower well-being even years after their divorce (see also Perrig-Chiello et al., 2015). In this connection, the study results also highlight the potential utility of online interventions to reduce stress or accelerate stress reduction among newly divorced individuals. As previous research has established the long-term detrimental effects of high/prolonged stress, the intervention-related reduction in stress, as observed in the current study, has the potential to substantially impact future well-being among divorced individuals and improve public health.

Consistent with other studies that find higher stress among women (Beam et al., 2017; Lee & Dik, 2017; Nielsen et al., 2008), gender was associated with higher baseline (i.e., within a week after legal divorce) stress levels, with women reporting higher stress levels than men. However, when assessing gender interaction in the linear mixed effect models, gender was not significantly associated with stress at any of the follow-ups nor with trajectories of change in stress over time. This suggests that while women report higher initial stress levels, their rate of stress reduction is not significantly different from those of their male counterparts.

The finding that the CAD intervention was effective in reducing perceived stress among recently divorced Danes could be due to several of its characteristics. First, members of the intervention group could access the intervention content on demand. That is, when and where it was convenient for them, which could have increased the usage (Dennis & Ebata, 2005). Moreover, participants could select to complete any of the 17 modules when they wished and therefore access information that was relevant to them at their moment of need. As divorce is not a homogeneous process and the needs of divorcing adults could be heterogeneous (e.g., Hilpert et al., 2018; Karney & Bradbury, 1995), allowing individuals to access content that they find relevant at a specific point in time may substantially contribute to stress reduction (e.g., Atkinson & Gold, 2002). Further, the content of the intervention targets well-known and studied challenges that adults undergoing divorce face, including communication with their former spouse, co-parenting strategies, understanding their own and their children's emotions and reactions to divorce. Moreover, the intervention provides clear guidance for attitudinal and behavioral change. Altogether, this may promote the thematic and practical utility of the intervention as well as increased self-efficacy, emotional support, and better coping abilities. As coping methods are integral to the stress response, fostering such abilities are vital for the reduction of stress (Allen et al., 2014; Budtz-Lilly et al., 2015; Cohen et al., 1997; Cohen et al., 1983).

When evaluating the study results, the following limitations should be considered. By being an RCT intervention study, there may be a selection effect by which those with higher stress levels could be overrepresented, seeking help to relieve their stress. Similarly, those with higher stress levels could also be underrepresented, finding it additionally stressful having to participate in an intervention study over 12 months at a likely stressful time of their life. Additionally, we were unable to determine if both partners in a prior marriage participated in the study, which may affect the independence of data in the study. Moreover, on average, the current study sample was found to be better educated than the general Danish population of divorcees, which may limit the generalization of results. Considering the high attrition rate observed in this study (though comparable to other studies; see also Cugelman et al., 2011; Eysenbach, 2005), which is always potentially problematic as a source of participation biases, we found little differences between those who completed all follow-ups and those who only completed the baseline questionnaire. To further minimize attrition bias, in the multivariate analyses we controlled for a range of socio-demographic, divorce-related, mental health and physical health indicators. Finally, this study did not investigate all plausible mediators and moderators of the intervention effects, for example, individual differences such as personality or divorce-related characteristics. As intervention effects in the area of divorce research may be related to individual differences and/or divorce characteristics (Amato, 2000; Dalton et al., 2003; Kołodziej-Zaleska & Przybyła-Basista, 2016; Malgaroli et al., 2017; Symoens et al., 2013), future studies should include mediation analysis and test plausible moderators to examine the intervention effects of CAD on perceived stress symptoms.

Conclusion

Using an RCT study design and mixed linear effects modeling, the study found that the CAD intervention was highly effective in reducing stress levels among recently divorced Danes. Further, that these intervention effects were maintained 12 months post juridical divorce. Finally, that the intervention effect brought stress levels in the intervention group down to national norms. The results may have important implications for the potential services offered to newly divorced individuals by demonstrating the utility of the CAD online intervention on stress among individuals transitioning from being married to divorced.

Acknowledgements

We wish to thank the Egmont Foundation for support with the development of the digital platform 'Cooperation After Divorce' and the Danish State Administration for help during the data collection process.

Appendix A

Description of the intervention

The CAD digital intervention consists of 17 digital learning modules and supporting functionality and contents, which are accessed online from a computer, mobile device or tablet. Each of the 17 digital learning modules, which are the core of the intervention, takes approximately 30-60 minutes to complete and users can freely choose which and how many learning modules they want to use and the time duration they want to spend engaging them.

The learning modules addresses challenges relevant for divorcees and are arranged into three main themes (A to C) presented in the flowchart below. The curriculum of each of the elements are described in Table A1.

Table A1. Curriculum of elements 

The overall objective of the solution is to provide a combination of knowledge and tools, which increase the likelihood that divorce related knowledge and divorce relevant strategies pertaining to each of the modules are translated into actual behavior. Accordingly, all of the learning modules includes both psychoeducation, exercises, questions, and/or dilemmas. Three core communication and interaction principles are applied throughout the intervention: 1) A minimum of text is used in lieu of 'rich media' such as video, animation, illustrations, pictures, and voice-overs; 2) User activation such that users are activated every 2-5 minutes with exercises, questions, and/or dilemmas, where they reflect and work with their own situation; 3) The language and difficulty level challenge the users instead of aiming for the lowest common denominator. In CAD the aim is to provide the user with an experience, knowledge and skills they cannot get just by Googling.

Appendix B

Logistic regression analysis of drop-out from baseline to 3-months

To determine if the attrition rate resulted in an attrition bias, multiple logistic regression analyses by group were performed to compare participants who completed only the baseline questionnaire to the rest of the sample. Predictors were sociodemographic variables (gender, age at survey, education, income), divorce-related characteristics (times divorced, marriage duration, number of children, conflict degree with a former spouse), and mental and physical health indicators (physical and mental health, stress, somatization, anxiety, and depression) (Table A2).

Table A2. Logistic regression analysis 

NoteOR = odds ratio; CI = confidence interval.

References

Allen, A., Kennedy, P., Cryan, J., Dinan, T., & Clarke, G. (2014). Biological and psychological markers of stress in humans: Focus on the Trier Social Stress Test. Neuroscience & Biobehavioral Reviews, 38, 94-124. https://doi.org/10.1016/j.neubiorev.2013.11.005 [ Links ]

Amato, P. (2000). The consequences of divorce for adults and children. Journal of Marriage and Family, 62(4), 1269-1287. https://doi.org/10.1111/j.1741-3737.2000.01269.x [ Links ]

Amato, P. (2014). The consequences of divorce for adults and children: An update. Društvena Istraživanja-asopis Za Opa Društvena Pitanja, 23(1), 5-24. https://doi.org/10.5559/di.23.1.01 [ Links ]

Apraiz, A., Ugarte, J., Aguado, V., & Martínez-Pampliega, A. (2015). Análisis coste-beneficio de una intervención post-divorcio [Cost-benefit analysis of a post-divorce intervention]. Boletín de Estudios Económicos, 70(214), 159-193. https://doi.org/10.1007/s11121-014-0527-6 [ Links ]

Atkinson, NL., & Gold, RS. (2002). The promise and challenge of E-health interventions. American Journal of Health Behavior, 26(6), 494-503. https://doi.org/10.5993/AJHB.26.6.10 [ Links ]

Beam, CR., Dinescu, D., Emery, R., & Turkheimer, E. (2017). A twin study on perceived stress, depressive symptoms, and marriage. Journal of Health and Social Behavior, 58(1), 37-53. https://doi.org/10.1177/0022146516688242 [ Links ]

Booth, A., & Amato, P. (1991). Divorce and psychological stress. Journal of Health and Social Behavior, 32(4), 396-407. https://doi.org/10.2307/2137106 [ Links ]

Boring, J., Sandler, I., Tein, J., Horan, J., Vélez, C., & Nezu, Arthur M. (2015). Children of divorce–coping with divorce: A randomized control trial of an online prevention program for youth experiencing parental divorce. Journal of Consulting and Clinical Psychology, 83(5), 999-1005. https://doi.org/10.1037/a0039567 [ Links ]

Bowers, JR., Mitchell, ET., Hardesty, JL., & Hughes, R. (2011). A review of online divorce education programs. Family Court Review, 49(4), 776-787. https://doi.org/10.1111/j.1744-1617.2011.01413.x [ Links ]

Bowers, JR., Ogolsky, BG., Hughes, R., & Kanter, JB. (2014). Coparenting through divorce or separation: A review of an online program. Journal of Divorce & Remarriage, 55(6), 464-484. https://doi.org/10.1080/10502556.2014.931760 [ Links ]

Brodbeck, J., Berger, T., & Znoj, H. (2017). An internet-based self-help intervention for older adults after marital bereavement, separation or divorce: Study protocol for a randomized controlled trial. Trials, 18(1), 21. https://doi.org/10.1186/s13063-016-1759-5 [ Links ]

Budtz-Lilly, A., Schröder, A., Rask, M., Fink, P., Vestergaard, M., & Rosendal, M. (2015). Bodily distress syndrome: A new diagnosis for functional disorders in primary care? BMC Family Practice, 16(180), 180. https://doi.org/10.1186/s12875-015-0393-8 [ Links ]

Centers for Disease Control and Prevention. (2016). Provisional number of marriages and marriage rate: United States, 2000-2016. https://www.cdc.gov/nchs/data/dvs/national_marriage_divorce_rates_00-16.pdfLinks ]

Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24(4), 385-396. https://doi.org/10.2307/2136404 [ Links ]

Cohen, S., Kessler, RC., & Gordon, LU. (1997). Measuring stress, a guide for health and social scientists. Oxford University Press. [ Links ]

Cugelman, B., Thelwall, M., & Dawes, P. (2011). Online interventions for social marketing health behavior change campaigns: A meta-analysis of psychological architectures and adherence factors. Journal of Medical Internet Research, 13(1), E17. https://doi.org/10.2196/jmir.1367 [ Links ]

Dalton, C., Carbon, J., & Olesen, N. (2003). High conflict divorce, violence, and abuse: Implications for custody and visitation decisions. Juvenile and Family Court Journal, 54(4), 11-33. https://doi.org/10.1111/j.1755-6988.2003.tb00084.x [ Links ]

Danese, A., & McEwen, B. (2012). Adverse childhood experiences, allostasis, allostatic load, and age-related disease. Physiology & Behavior, 106(1), 29-39. https://doi.org/10.1016/j.physbeh.2011.08.019 [ Links ]

Dennis, S., & Ebata, A. (2005). Family life education on the technological frontier. In SF. Duncan & HW. Goddard (Eds.), Outreach in family life: Principles and practices for effective family life outreach education (pp. 180-219). Sage. [ Links ]

Derogatis, LR. (2000). Symptom Checklist-90-Revised. In AJ. Rush, MM. First, & D. Blacker (Eds.), Handbook of psychiatric measures (pp. 81-84). American Psychiatric Association. [ Links ]

Dissing, A., Jørgensen, T., Gerds, T., Rod, N., & Lund, R. (2019). High perceived stress and social interaction behaviour among young adults. A study based on objective measures of face-to-face and smartphone interactions. PLoS ONE, 14(7). https://doi.org/10.1371/journal.pone.0218429 [ Links ]

Dohrenwend, BS., Askenasy, AR., Krasnoff, L., & Dohrenwend, BP. (1978). Exemplification of a method for scaling life events: The PERI life events scale. Journal of Health and Social Behavior, 19(2), 205-229. https://doi.org/10.2307/2136536 [ Links ]

Donkin, L., Christensen, H., Naismith, S., Neal, B., Hickie, I., & Glozier, N. (2011). A systematic review of the impact of adherence on the effectiveness of e-therapies. Journal of Medical Internet Research, 13(3), E52. https://doi.org/10.2196/jmir.1772 [ Links ]

Eskildsen, A., Dalgaard, VL., Nielsen, KJ., Andersen, JH., Zachariae, R., Olsen, LR., Jørgensen, A., & Christiansen, DH. (2015). Cross-cultural adaptation and validation of the Danish consensus version of the 10-item Perceived Stress Scale. Scandinavian Journal of Work, Environment & Health, 41(5), 486-490. https://doi.org/10.5271/sjweh.3510 [ Links ]

European Commission. (2015). Demography report. Publications Office of the European Union. http://ec.europa.eu/eurostat/documents/7330775/7339482/Demography+report+%E2%80%93+2015+edition/ce8144e3-8e9b-427d-b6a2-61ff42950d41Links ]

Eysenbach, G. (2005). The law of attrition. Journal of Medical Internet Research, 7(1), E11. https://doi.org/10.2196/jmir.7.1.e11 [ Links ]

Eysenbach, G., Webb, T., Botelho, R., Cugelman, B., Thelwall, M., & Dawes, P. (2011). Online interventions for social marketing health behavior change campaigns: A meta-analysis of psychological architectures and adherence factors. Journal of Medical Internet Research, 13(1), E17. https://doi.org/10.2196/jmir.1367 [ Links ]

Fink, P., & Rosendal, M. (Eds.). (2015). Functional disorders and medically unexplained symptoms. Assessment and treatment. Århus University Press in collaboration with The Research Clinic for Functional Disorders and Psychosomatics, Århus University Hospital. [ Links ]

Freeman, S., Schwab, C., & Jiang, Q. (2008). Quantifying stressors among Iowa farmers. Journal of Agricultural Safety and Health, 14(4), 431-9. https://doi.org/10.13031/2013.25280 [ Links ]

Geraghty, A., Torres, L., Leykin, Y., Pérez-Stable, E., & Muñoz, R. (2012). Understanding attrition from international internet health interventions: A step towards global eHealth. Health Promotion International, 28(3), 442-452. https://doi.org/10.1093/heapro/das029 [ Links ]

Greenberg, LR., Fidler, BJ., & Saini, MA. (Eds.). (2019). Evidence-informed interventions for court-involved families: Promoting healthy coping and development. Oxford University Press. [ Links ]

Gupta, SK. (2011). Intention-to-treat concept: A review. Perspectives in Clinical Research, 2(3), 109-112. https://doi.org/10.4103/2229-3485.83221 [ Links ]

Hald, GM. , Cipric, A., Øverup, CS., Štulhofer, A., Lange, T., Sander, S., Gad Kjeld, S., & Strizzi, JM. (in press.). RCT study of the effects of an online divorce platform on anxiety, depression, and somatization. Journal of Family Psychology. [ Links ]

Hald, GM., Strizzi, J., Cipric, A., & Sander, S. (2019). The Divorce Conflict Scale. Journal of Divorce and Remarriage, 61(2), 83-104. https://doi.org/10.1080/10502556.2019.1627150 [ Links ]

Hilpert, P., Xu, F., Milek, A., Atkins, DC., Bodenmann, G., & Bradbury, TN. (2018). Couples coping with stress: Between-person differences and within-person processes. Journal of Family Psychology, 32(3), 366-374. https://doi.org/10.1037/fam0000380 [ Links ]

Hobson, C., & Delunas, J. (2001). National norms and life-event frequencies for the Revised Social Readjustment Rating Scale. International Journal of Stress Management, 8(4), 299-314. https://doi.org/10.1023/A:1017565632657 [ Links ]

Karney, BR., & Bradbury, TN. (1995). The longitudinal course of marital quality and stability: A review of theory, method, and research. Psychological Bulletin, 118(1), 3-34. https://doi.org/10.1037/0033-2909.118.1.3 [ Links ]

Kessing, LV., Agerbo, E., & Mortensen, PB. (2003). Does the impact of major stressful life events on the risk of developing depression change throughout life? Psychological Medicine, 33(7), 1177-1184. https://doi.org/10.1017/S0033291703007852 [ Links ]

Klein Velderman, M., Pannebakker, FD., Van Vliet, W., & Reijneveld, SA. (2018). Prevention of divorce-related problems in Dutch 4- to 8-year-olds: Cultural adaptation and pilot study of the children of divorce intervention program. Research on Social Work Practice, 28(4), 415-427. https://doi.org/10.1177/1049731516644504 [ Links ]

Kołodziej-Zaleska, A., & Przybyła-Basista, H. (2016). Psychological well-being of individuals after divorce: The role of social support. Current Issues in Personality Psychology, 4(4), 206-216. https://doi.org/10.5114/cipp.2016.62940 [ Links ]

Lee, CS., & Dik, BJ. (2017). Associations among stress, gender, sources of social support, and health in emerging adults. Stress and Health, 33(4), 378-388. https://doi.org/10.1002/smi.2722 [ Links ]

Leopold, T. (2018). Gender differences in the consequences of divorce: A study of multiple outcomes. Demography, 55(3), 769-797. https://doi.org/10.1007/s13524-018-0667-6 [ Links ]

Lie, SS., Karlsen, B., Oord, ER., Graue, M., & Oftedal, B. (2017). Dropout from an eHealth intervention for adults with type 2 diabetes: A qualitative study. Journal of Medical Internet Research, 19(5), e187. https://doi.org/10.2196/jmir.7479 [ Links ]

Little, TD. (2013). Longitudinal structural equation modeling. Guilford Press. [ Links ]

Malgaroli, M., Galatzer-Levy, I., & Bonanno, G. (2017). Heterogeneity in trajectories of depression in response to divorce is associated with differential risk for mortality. Clinical Psychological Science, 5(5), 843-850. https://doi.org/10.1177/2167702617705951 [ Links ]

McIntosh, J., & Tan, E. (2017). Young children in divorce and separation: Pilot study of a mediation-based co-parenting intervention. Family Court Review, 55(3), 329-344. https://doi.org/10.1111/fcre.12291 [ Links ]

Nielsen, L., Curtis, T., Kristensen, TS., & Rod Nielsen, N. (2008). What characterizes persons with high levels of perceived stress in Denmark? A national representative study. Scandinavian Journal of Public Health, 36(4), 369-379. https://doi.org/10.1177/1403494807088456 [ Links ]

Nielsen, N., Davidsen, R., Hviid, A., & Wohlfahrt, J. (2014). Divorce and risk of hospital-diagnosed infectious diseases. Scandinavian Journal of Public Health, 42(7), 705-711. https://doi.org/10.1177/1403494814544398 [ Links ]

Olsen, LR., Mortensen, EL., & Bech, P. (2004). The SCL-90 and SCL-90R versions validated by item response models in a Danish community sample. Acta Psychiatrica Scandinavica, 110(3), 225-229. https://doi.org/10.1111/j.1600-0447.2004.00399.x [ Links ]

Pelleboer-Gunnink, HA., Van der Valk, IE., Branje, S. JT., Van Doorn, MD., & Dekovi, M. (2015). Effectiveness and moderators of the preventive intervention kids in divorce situations: A randomized controlled trial. Journal of Family Psychology, 29(5), 799-805. https://doi.org/10.1037/fam0000107 [ Links ]

Perrig-Chiello, P., Hutchison, S., & Morselli, D. (2015). Patterns of psychological adaptation to divorce after a long-term marriage. Journal of Social and Personal Relationships, 32(3), 386-405. https://doi.org/10.1177/0265407514533769 [ Links ]

Sander, S. & Hald, GM. (2020). Cooperation after divorce (CAD) – A digital divorce platform to reduce psychological and physiological adverse effects of divorce. Unpublished manuscript. [ Links ]

Sandler, I., Gunn, H., Mazza, G., Tein, J., Wolchik, S., Berkel, C., Jones, S., & Porter, M. (2018). Effects of a program to promote high quality parenting by divorced and separated fathers. Prevention Science, 19(4), 538-548. https://doi.org/10.1007/s11121-017-0841-x [ Links ]

Schramm, DG., & McCaulley, G. (2012). Divorce education for parents: A comparison of online and in-person delivery methods. Journal of Divorce & Remarriage, 53(8), 602-617. https://doi.org/10.1080/10502556.2012.721301 [ Links ]

Statistics Denmark. (2017). Denmark in figures 2017. Statistics Denmark. https://www.dst.dk/Site/Dst/Udgivelser/GetPubFile.aspx?id=21501&sid=denmark%20in%20figures%202017%20netLinks ]

Strohschein, L. (2005). Parental divorce and child mental health trajectories. Journal of Marriage and Family, 67(5), 1286-1300. https://doi.org/10.1111/j.1741-3737.2005.00217.x [ Links ]

Sutin, A., Costa, P., Wethington, E., & Eaton, W. (2010). Perceptions of stressful life events as turning points are associated with self-rated health and psychological distress. Anxiety, Stress, & Coping, 23(5), 479-492. https://doi.org/10.1080/10615800903552015 [ Links ]

Symoens, S., Bastaits, K., Mortelmans, D., & Bracke, P. (2013). Breaking up, breaking hearts? Characteristics of the divorce process and well-being after divorce. Journal of Divorce & Remarriage, 54(3), 177-196. https://doi.org/10.1080/10502556.2013.773792 [ Links ]

Thuen, F. (2001). Psychiatric symptoms and perceived need for psychiatric care after divorce. Journal of Divorce & Remarriage, 34(1–2), 61–76. https://doi.org/10.1300/J087v34n01_04 [ Links ]

Ware, JE., Snow, KK., Kosinski, M., & Gandek, B. (1993). SF-36 health survey (SF-36): Manual and interpretation guide. Quality Metric Incorporated. [ Links ]

Yárnoz, S., Plazaola, M., & Etxeberria, J. (2008). Adaptation to divorce: An attachment-based intervention with long-term divorced parents. Journal of Divorce & Remarriage, 49(3-4), 291-307. https://doi.org/10.1080/10502550802222246 [ Links ]

Funding: This work was supported by financial support from 'The Carlsberg Foundation Distinguished Associate Professor Fellowship' (the last author) under Grant No. CF16-0094.

Cite this article as: Cipric, A., Strizzi, J. M., Øverup, C. S., Lange, T., Štulhofer, A., Sander, S., Gad-Kjeld, S., & Hald, G. M. (2020). Cooperation after divorce: An RCT study of the effects ofa digital intervention platform on self-perceived stress. Psychosocial Intervention, 29(2), 113-123.

Received: November 16, 2019; Accepted: March 03, 2020; pub: February 28, 2020

Conflict of Interest

For due diligence, we would like to declare that the University of Copenhagen, Denmark, where the authors work, owns the digital intervention platform 'Cooperation after Divorce (CAD)' while two of the co-authors (Gert Martin Hald and Søren Sander) holds the commercial license and intellectual property rights to the platform through the Company 'Cooperation after Divorce' (SamarbejdeEfter Skilsmisse ApS).

Correspondence: anci@sund.ku.dk / anacipric.hr@gmail.com (A. Cipric).

Creative Commons License This is an Open Access article distributed under the terms of the Creative Commons Attribution-Noncommercial No Derivative License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium provided the original work is properly cited and the work is not changed in any way.