Skip Navigation


Health Promotion International Advance Access originally published online on January 21, 2008
Health Promotion International 2008 23(2):134-143; doi:10.1093/heapro/dam046
This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
23/2/134    most recent
dam046v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Kimber, B.
Right arrow Articles by Bremberg, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kimber, B.
Right arrow Articles by Bremberg, S.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?


© The Author (2008). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oxfordjournals.org

Social and emotional training in Swedish classrooms for the promotion of mental health: results from an effectiveness study in Sweden

Birgitta Kimber1,*, Rolf Sandell2 and Sven Bremberg1

1Department of Public Health Sciences, Division of Social Medicine, Karolinska Institute, SE-17177 Stockholm, Sweden 2Department of Behavioral Sciences, Linköping University, SE-581 83, Linköping, Sweden

* Corresponding author. E-mail: Birgitta.Kimber{at}ki.se


    SUMMARY
 TOP
 SUMMARY
 INTRODUCTION
 METHOD
 RESULTS
 Discussion
 FUNDING
 REFERENCES
 
Mental ill-health is a major problem worldwide. It includes depression, aggressive behavior, feeling down and alcohol and drug abuse. Since all children go to school, the school is an obvious arena for health interventions. A set of educational techniques named Social and Emotional Learning, based on the use by teachers of cognitive and behavioral methods, which teaches students self-control, social competence, empathy, motivation and self-awareness, has shown promising results in the USA. This paper reports on the application of similar techniques in Sweden (the Social and Emotional Training [SET] program). The study has a quasi-experimental longitudinal design, with two intervention and two control schools. A wide range of instruments, both Swedish and international, are employed. In this paper, results from the school years 1999–2000 (baseline) through to 2001–2002 are reported. Both the intervention and the data collection were performed by ordinary school staff in a routine school setting. Independent bi-annual ratings of teachers' performance were moderate to high, and teachers' perceptions of the program were generally, although by no means universally, high. However, their performance was poorer with regard to the collection of data. In terms of promotion, findings with regard to the impact of the program on mental health are generally favorable—in particular through the promotion of aspects of self-image, including well-being and the hindering of aggressiveness, bullying, attention-seeking and alcohol use. There was, however, no differential effect on social skills. It seems that SET has the potential to operate effectively as a health-promoting intervention during the school period, although its main impact may rather be to act as a brake on the deterioration in some aspects of mental health that is common during adolescence. Positively significant relationships were found on some but not all of the instrument scales, and effect sizes were medium.

Key words: mental health; school-based intervention; social and emotional learning


    INTRODUCTION
 TOP
 SUMMARY
 INTRODUCTION
 METHOD
 RESULTS
 Discussion
 FUNDING
 REFERENCES
 
Mental ill-health is a major problem worldwide. It includes depression, aggressive behavior, feeling down and alcohol and drug abuse. Among people aged 1–44, mental ill-health is the greatest problem in high-income countries. Specifically, internalizing problems, such as depression, are important, since they have been demonstrated to account for a larger proportion of mental ill-health than externalizing problems (Murray and Lopez, 1996Go).

Since all children go to school, the school is an obvious arena for mental-health promotion. A set of pedagogic techniques, Social and Emotional Learning (SEL), based on cognitive and behavioral methods, is available to teachers to train students to improve self-control, social competence, empathy, motivation and self-awareness, and has shown promising results (Spivack and Shure, 1974Go; Durlak and Wells, 1977; Durlak, 1997Go; Greenberg et al., 2001Go; Catalano et al., 2002Go; Durlak and Weissberg, 2005Go).

One example of such a program is Providing Alternative Thinking Strategies (PATHS), which has been evaluated by Greenberg and colleagues (Greenberg, 1996Go; Elias et al., 1997Go; Riggs et al., 2006Go). One-year improvements have been found on social problem-solving, emotional understanding, self-report of conduct problems, teacher ratings of adaptive behavior and cognitive abilities related to social planning and impulsiveness (Catalano et al., 2002Go).

The published literature seems to reveal four recurrent weaknesses of school-based intervention studies. First, they focus on a limited range of outcomes, especially on externalizing problems such as aggression and violence and alcohol and drug abuse. Internalizing problems, such as depression and anxiety, tend not to be so intensively explored. Second, few studies include a broad range of school grades. It has been claimed that ‘short-term preventive interventions produce time-limited benefits, at best, with at-risk groups whereas multi-year programs are more likely to foster enduring benefits’ (Greenberg et al., 2001Go, p. 32). Third, to our knowledge, all peer-reviewed studies published so far have been conducted in the USA. Fourth, most of the studies report on efficacy trials, undertaken with a research team in charge, rather than effectiveness trials conducted in a community setting (Greenberg, 2004Go; Marlowe, 2004Go).

This study of a Swedish SEL program (with acronym SET, for Social and Emotional Training) attempts to address all four of these relative shortcomings. First, it emphasizes internalizing mental-health aspects as well as externalizing ones. Second, being a multi-year program, it covers all grades of compulsory school (1–9). Third, it is conducted in a European country, namely Sweden. Fourth, the program has been implemented in a real-life community setting.

In this study, the effects of SET on internalizing and externalizing problems during the first 2 years of program implementation are analyzed.


    METHOD
 TOP
 SUMMARY
 INTRODUCTION
 METHOD
 RESULTS
 Discussion
 FUNDING
 REFERENCES
 
Design
The study has a quasi-experimental longitudinal design. The SET intervention, which is still ongoing, started in two schools in August 2000. For the study, two other schools not using SET served as controls. Baseline measurements were taken in May 2000 (t0) before the start of the intervention. Succeeding assessments were made in May 2001 (t1) and May 2002 (t2).

Population
In Sweden compulsory school encompasses grades 1–9; children begin school at age 7 and end at age 16. The study was carried out in Botkyrka Municipality, located in the Stockholm metropolitan area, where there are eight schools covering all grades (1–9). The study participants attended grades 1–7 in four of these schools in school year 1999–2000, and responded to questionnaires in May 2000 (t0), May 2001 (t1) and May 2002 (t2). Students attending grades 1–3 at t0 were named junior, while those attending grades 4–7 at t0 were called senior. Two of the eight schools in Botkyrka were chosen as intervention schools. For comparative purposes, a No-SET school of similar size serving a socio-economically similar population was selected for each SET school.

There were 110 classes in the two SET schools taken together; one had six classes per grade, the other five. Three classes at each of the first seven grades (1–7) within the two SET schools were then chosen on an organizational basis, i.e. from the same building or from among the particular classes for which a deputy head-teacher had responsibility, thus making 42 experimental classes in total. One class dropped out for administrative reasons, giving a final total of 41 experimental classes. The No-SET classes were chosen by the head-teachers of these schools, one for each grade (14 in total). The population was defined as those who responded to the questionnaire at t0. With regard to conventional absence of students (due to illness, truancy, etc.), the percentages ranged between 4 and 5.

The intervention
The SET program, designed by the first author of this paper (Kimber, 2001aGo; Kimber, 2001bGo), was delivered by regular class teachers during scheduled hours: to grades 1–5 twice a week, each session of 45 min, and to grades 6–9 in one 45-min session per week over the school year. The program is guided by detailed manuals for the teacher, one volume for each grade. It also includes a workbook for students of each grade. Altogether, the program consists of 399 concrete exercises, some of which are inspired by similar programs in the USA (e.g. Greenberg, 1996Go; Elias et al., 1997Go).

SET focuses on helping to develop the following five functions of the students: self-awareness, managing one's emotions, empathy, motivation and social competence. Typically, the functional components merge into one another and any one exercise may address several functions. The following themes recur in the tasks: social problem solution, handling strong emotions, appreciating similarities and differences, clarification of values, conflict management, interpretation of pictures and narratives, making more of what makes one feel good, resisting peer pressure and being able to say ‘No’, knowing what one is feeling, recognizing people and situations, cooperation, listening to and relaying messages, setting goals and working to attain them, giving and receiving positive feedback and stress management.

Teachers are instructed to use modeling and role-play in the exercises, and students must practice not only in but also outside school (including the home). Interaction between school and parents is emphasized.

Training and monitoring of the teachers
The first author trained the teachers in SET in the school year 1999–2000; they had an opportunity to try out the relevant exercises themselves, and test them in their classes. The teachers were supervised once a month during the school year 2000–2001 and offered voluntary supervision during 2001–2002. Independent ratings were performed of all the SET teachers bi-annually, and an interview survey of a random sample of teachers was conducted in 2003 after 2 years of implementation (Gadd, 2003Go).

Instruments
All the instruments employed are well-established and have documented reliability and validity.

I Think I Am (ITIA) is the Swedish self-rating instrument, ‘Jag tycker jag är’ (Ouvinen-Birgerstam, 1985Go), which has roots in American research (Coopersmith, 1967Go). It maps the young person's self-image and self-esteem, and has subscales for Body Image, Family Relations, Psychological Well-being, Relations with Others, and Talent/Abilities.

There are two versions of the instrument: ITIA-I for grades 1–3 and ITIA-II for grades 4–9. In ITIA-I, students answer ‘Yes’ or ‘No’ to 32 questions; in ITIA-II students respond to 72 statements on four-point scales, ‘Exactly like me’, ‘Almost like me’, ‘Very little like me’, ‘Not at all like me’. Examples are: ‘I have a nice face’, ‘I like myself’, ‘I am often sad’, ‘My parents trust me’. The items in ITIA-I are scored 1 or -1, in ITIA-II from 2 to -2. The scoring of half of the items was reversed so that higher scores always indicate more positive self-image or self-esteem.

Students in grades 4–9 also responded to a second questionnaire with the following components:

Youth Self-Report (Achenbach and Edelbrock, 1987Go), used here in an abbreviated Swedish version (Lindberg et al., 1999Go), measures mental-health symptoms and problems. Questionnaire items are rated on a three-step response scale ‘Not true’, ‘Somewhat or sometimes true’, ‘Very true or often true’. Using principal components factor analysis, with Oblimin rotation (Harman, 1976Go), of data on all respondents at t1, four factors with eigenvalues >2 were extracted, jointly accounting for 53% of the total variance. The four subscales were named Anxiety, e.g. feeling worthless or inferior and feeling unhappy (14 items); Aggressiveness, e.g. threatening to hurt people, destroying things that belong to others (nine items); Assertiveness, e.g. being stubborn, mood swings (five items); and, Attention-seeking, e.g. trying to attract a lot of attention, bragging (four items). The lower the score, the lesser the problem.

Mastery (Pearlin et al., 1981Go), used in Swedish translation, is a self-rating instrument measuring feelings of self-efficacy or hopelessness. Nine items are rated on four-step scales, with responses ranging from ‘Strongly agree’ to ‘Strongly disagree’. Examples include: ‘There is really no way I can solve the problems I have’, and ‘I have little control over the things that happen to me’. After reversed scoring of some items, higher scores indicate higher sense of self-efficacy.

The Social Skills Rating System (SSRS) (Gresham and Elliott, 1990Go) consists of 34 items for grades 4–9, all with four-point response scales: ‘Never’ (0), ‘Sometimes’ (1), ‘Often’ (2), ‘Very often’ (3). Scores were obtained on four subscales: assertion, cooperation, empathy and self-control, as defined in the manual. Higher scores indicate greater social skills.

Contentment in School refers to a single item, ‘How do you like it in school?’, from a questionnaire administered annually by the Swedish Council for Information on Alcohol and Other Drugs (CAN). See Hibell et al. (1997)Go. Contentment was rated on a five-step response scale, ranging from ‘Very bad’ to ‘Very good’. The higher the score, the greater the contentment.

Bullying is measured on a three-item self-report scale (being insulted; physically assaulted; ‘being sent to Coventry’), also from the CAN questionnaire. Responses are given on three-step scales, ranging from ‘No, seldom or never’ to ‘Yes, often’. Lower scores indicate fewer problems.

Drug use is measured on four CAN self-report scales, and refers to the use of tobacco (seven-step scale, from ‘Never’ to ‘Every day’), alcohol (nine-step scale from ‘Do not drink’ to ‘Every day’), volative substances (three-step scale, from ‘No’ to ‘Yes, several times’) and illegal narcotics (seven-step scale, from ‘Never’ to ‘More than 50 times’). These items were administered only in grades 7–9. The lower the score, the less is use on each item.

A summary account of the scales derived from the instruments, and their alpha reliabilities and re-test correlations (between t0 and t1 and between t1 and t2) at different grades, is given in Table 1.


View this table:
[in this window]
[in a new window]

 
Table 1: Instruments and scales used with reliabilities (Cronbach's alpha) and re-test correlations

 
Procedures
The questionnaires were distributed each May by deputy head teachers, and administered during school hours by regular class teachers. The questionnaires were then relayed back to the deputy head teachers and forwarded for data entry by an independent organization. For the statistical analyses only fully completed questionnaires were used. Since missing values were not randomly distributed, it was inappropriate to impute missing data.

Statistical analyses
Differences between the groups (SET and No SET) in their development from May 2001 (t1) to May 2002 (t2) on each scale or subscale were analyzed separately by running a repeated-measures ANCOVA (or MANCOVA). SET or No SET and year (t1 and t2) were the independent variables, and the scale (or subscale) of each instrument the dependent variable(s). The five ITIA subscales at t0 were used as covariates after standardizing each scale within each school level, i.e. separately for ITIA-I and ITIA-II. The GLM routine of SPSS, version 11, was used. Significance was set at 0.05.

Using Becker's (1988) approach, between-groups effect sizes were computed for each dependent variable from unadjusted (raw score) means and standard deviations (SD) at t1. Thus, a within-group d was computed for each SET group by dividing the t2 - t1 means difference by the t1 SD and then subtracting the within-group d in the No-SET group from that in the SET group. This gives a change effect size ({Delta}) parameter. Cohen's designations of effect size (small = 0.2, medium = 0.5, large = 0.8) were employed (Cohen, 1988Go).

Although a variety of multilevel analyses would have been appropriate, this would have been extremely complicated. Thus, no adjustments were made for intra-classroom or intra-school dependencies.


    RESULTS
 TOP
 SUMMARY
 INTRODUCTION
 METHOD
 RESULTS
 Discussion
 FUNDING
 REFERENCES
 
Participation and dropout
Participation by school level, SET/No-SET group and year are shown in Table 2. In the case of senior students, due to improved administrative routines, more cases were available for the YSR, Mastery, Contentment in School, Bullying and the SSRS than for ITIA-II


View this table:
[in this window]
[in a new window]

 
Table 2: Number of study respondents for each time of measurement by school level, SET/No-SET group and year

 
Using baseline (t0) scores for remainers and dropouts on the ITIA subscales (the only data available to us on dropouts at t1), we analyzed the effects of attrition from baseline May 2000 (t0) to May 2001 (t1), and also from baseline May 2000 (t0) to May 2002 (t2).

At junior level, the dropouts at t1 did not differ significantly from the remainers on any of the subscales, multivariate F (5; 423) = 1.45, p = 0.205, and there was no significant interaction between the SET/No-SET groups and remainers/dropouts, multivariate F (5; 423) = 2.10, p = 0.065. Again at t2, dropouts did not differ significantly from remainers on any of the subscales, multivariate F (5; 423) = 1.02, p = 0.408. Interaction between the SET/No-SET groups and remainers/dropouts, however, was multivariately significant, multivariate F (5; 423) = 2.48, p = 0.031. This reflects a single significant univariate interaction on the Relations with Others subscale, on which dropouts in the No-SET group, by contrast with those in the SET group, had significantly lower scores than remainers at baseline.

At senior level, the dropouts at t1 had significantly lower baseline scores than the remainers on all subscales except Body Image, multivariate F (5; 761) = 2.89, p = 0.014. The interaction was not significant, multivariate F (5; 423) = 0.54, p = 0.746. At t2 the dropouts had significantly lower baseline scores than the remainers on all subscales, multivariate F (5; 761) = 6.77, p = 0.000. Again, the interaction was not significant, multivariate F (5; 761) = 1.00, p = 0.416. However, there was a univariate interaction on the Psychological Well-being subscale, in that the remainers in the SET group had lower baseline scores than the remainers in the No-SET group, F (1; 765) = 3.91, p = 0.048.

We also analyzed the effects of attrition between t1 and t2 by comparing the scores of t2 dropouts and t2 remainers on a selection of outcome variables at t1. At t1 the t2 dropouts tended to have had significantly lower scores on the ITIA-I subscales than the students who remained in the study, multivariate F (5; 375) = 2.56, p = 0.027, whereas their scores on the ITIA-II subscales did not differ. Also, the dropouts at t2 differed from the remainers on the YSR subscales, multivariate F (4; 1097) = 4.69, p = 0.001, reflecting significantly higher t1 scores on Anxiety among the dropouts. They also had higher scores on the four drug-use scales, multivariate F (4; 357) = 2.77, p = 0.027. No significant t1 difference between dropouts and remainers was found for Contentment in School. Critically, on none of these scales or subscales was there any significant interaction between the SET/No-SET groups and the dropouts/remainers; for the ITIA-I subscales, F (5; 375) = 0.95, p = 0.446; for the ITIA-II subscales, F (5; 610) = 1.54, p = 0.176; for the YSR subscales, F (4; 1097) = 1.17, p = 0.321; and, for Contentment in School, F (1; 1086) = 3.13, p = 0.077.

We concluded that attrition, whether from baseline onwards or between t1 and t2, was unlikely to have biased the comparisons between the SET and No-SET groups in either direction.

Main findings
Junior students
The effect of SET was tested by a MANCOVA comparing the ITIA-I subscales for the SET and No-SET students at t1 and t2. Standardized ITIA-I subscale scores at t0 were used as covariates. The mean scores and between-groups {Delta}s are shown in Table 3. The multivariate probability (p = 0.058) approached significance, although the subscale differences were all non-significant.


View this table:
[in this window]
[in a new window]

 
Table 3: Junior sample (grades 1–3): raw score means (M) and standard deviations (SD) for ITIA-I by group (SET/No SET) and year; ps for F tests for group-by-year interaction following MANCOVA or ANCOVA, and between-groups effect sizes (Becker's {Delta})

 
Senior students
As is shown in Table 4, for ITIA-II, the multivariate SET effect was not significant, but significant effects were obtained for Body Image, Psychological Well-being and Relations with Others, although the possibility of differential missing data might partly explain this. The effect sizes ranged from small to large.


View this table:
[in this window]
[in a new window]

 
Table 4: Senior sample (grades 4–9): raw score means (M) and standard deviations (SD) for ITIA-II by group (SET/No SET) and year; ps for F tests for group-by-year interaction following MANCOVA or ANCOVA, and between-groups effect sizes (Becker's {Delta})

 
The group means and SD for the YSR, Mastery, SSRS, Contentment in School and Bullying scales are presented in Table 5. A significant multivariate effect was found for the YSR and also significant univariate effects for two of the subscales, Aggressiveness and Attention-seeking. Most effect sizes for these scales were in the small-to-medium range.


View this table:
[in this window]
[in a new window]

 
Table 5: Senior sample (grades 4–9): Raw score means (M) and standard deviations (SD) for YSR, Mastery, Social Skills, Adjustment and Bullying by group (SET/No SET) and year; ps for F tests for group-by-year interaction following MANCOVA or ANCOVA, and between-groups effect sizes (Becker's {Delta})

 
The SET effect on the Contentment in School scale was small and not significant. However, there was a significant positive effect on Bullying, with an effect size in the small-to-medium range. No significant effects were found for Mastery or for any of the SSRS subscales.

The abuse items were administered to senior students only (grades 7–9). The means and SD are presented in Table 6. Although the multivariate SET effect was non-significant, there was a significant positive effect for Alcohol and a close-to-significant effect for Narcotic Drugs.


View this table:
[in this window]
[in a new window]

 
Table 6: Senior sample (grades 7–9): Raw score means (M) and standard deviations (SD) for the abuse scales by group (SET/No SET) and year; ps for F tests for group-by-year interaction following MANCOVA or ANCOVA, and between-groups effect sizes (Becker's {Delta})

 

    Discussion
 TOP
 SUMMARY
 INTRODUCTION
 METHOD
 RESULTS
 Discussion
 FUNDING
 REFERENCES
 
Social and emotional training was found to have some favorable small-to-medium effects on mental health and health-related behaviors. Since the intervention was performed with ordinary school-staff in a routine school setting, we regard this as encouraging.

The dropout rate was high. Among the SET students, 48% of the senior-level students measured at baseline remained after 2 years of the intervention, and only 26% of the junior-level students. These figures compare somewhat unfavorably with American studies. For example, Catalano and colleagues (2002) report retention of 60–64% of seventh/eighth grade students for Project ALERT (a program addressing competencies, self-efficacy and prosocial norms) after 15 months; in the case of the PATHS project, for six- to eleven-year-olds, they state that ‘only about 30% of children received 2 years of intervention’ (Catalano et al., 2002Go, p. 35). For a drug-use program, it is reported that ‘[d]espite aggressive tracking efforts, there was a loss of 17.5% of the students between baseline and the first follow-up (for both cohorts combined)’ (Scheier et al., 2001Go, p. 98), an additional 10% of the students.

There are several reasons for this, some specific to the intervention and evaluation discussed here. Inclusion in the panel required a student to be present in class precisely at the time the questionnaire was administered for 3 years in a row. As well as temporary absence, there is high general turnover of students between schools and classes. Among junior students, for example, roughly one-third per year will disappear as a matter of course as they advance from junior to senior level. Further, in the case of the senior students, there was a major educational reorganization in the municipality that strongly affected school and class structures between 2000–2001 (t1) and 2001–2002 (t2).

There were also administrative difficulties. Although independent ratings of teachers' performance were moderate to high, and teachers' perceptions of SET were generally, although by no means universally, favorable (Gadd, 2003Go), their performance on data collection was poorer. Personnel turnover—of head/deputy head teachers, administrators and teachers—was a particular problem.

Finally, there is a statistical aspect. Since only fully completed questionnaires were considered, because the non-random distribution of the missing data made imputation unsuitable, the number of cases for analysis was reduced.

Nevertheless, our extensive analyses of dropout, from baseline onwards and between t1 and t2, indicate that attrition was unlikely to have biased the comparisons between the SET and No-SET groups in either direction.

Considering effects as a whole, there were positive impacts—albeit not always statistically significant—on 4 out of 5 of the scales for the juniors (the exception being Body Image), and 18 out of 20 for the seniors (the exceptions being Mastery and Cooperation). The binomial probability of such relative frequencies under the null hypothesis that SET has no effect is p = 0.000. For the junior sample, there was a large effect size for Psychological Well-being, with a statistical tendency (p = 0.074). For the senior sample, there were statistically significant medium effect sizes for Body Image, Relations with Others, Psychological Well-being, Aggressiveness, Attention-seeking and Bullying. These results are roughly in line with those reported by Durlak and Weissberg (2005)Go in their meta-analysis of positive youth development programs.

Surprisingly, given the program's focus on social as well as emotional aspects, there was virtually no recorded differential impact on the social skills scales (Assertion, Cooperation, Empathy and Self-control). This remains to be understood; SET may be ineffective, or the instrument may lack sensitivity, despite its proven reliability and validity (Gresham and Elliott, 1990Go).

SET also appears to have had no favorable impact on Mastery, defined as the extent to which one regards one's life chances as being under personal control. If we construe hopelessness and lack of self-efficacy as internalizing problems, like YSR Anxiety, it appears that the program has had stronger effects on externalizing problems.

The typical result pattern was not so much that the SET students improved, but that the No-SET students deteriorated with regard to the aspects of mental health considered here. The pattern, which is in line with much previous research (e.g. Moffit, 1993Go; Sampson and Laub, 2003Go) is evident on virtually all the scales, albeit non-significant in some cases. The SET program seems to give young people tools to handle the ‘real challenges and the need to cope with change’ during ‘the teenage transitional period’ (Rutter, 2007Go), and thereby has a dampening effect.

The study has a number of strengths. It is a longitudinal rather than a cross-sectional study. It covers all school grades (with the same students being assessed at different ages), which is a major advantage in assessing an intervention of this kind. All cognitive-behavioral techniques require repetition. For example, learning problem-solving is unlikely to be achieved ‘in one go’; it demands practice and exercise over time.

A further strength of the study is that it is European. What works in the USA may not necessarily work in Europe, although what is effective in Sweden may not be so in other European countries.

In a number of research fields, there is a growing literature on the distinction between efficacy and effectiveness. The merit of an effectiveness study lies in its external validity; what is efficacious under controlled conditions may not be effective in a real-life setting (Greenberg, 2004Go). Since the intervention was carried out with ordinary school staff in a routine school setting, we were encouraged by its results.

Yet, the study design does not allow us positively to conclude that the SET program is the real causal factor. We cannot exclude the possibility that the extra attention associated with implementation in the SET schools may have acted to strengthen morale among teachers and students, or that there may have been a corresponding demoralizing effect in the No-SET schools (Cook and Campbell, 1979Go). However, since the No-SET schools all ran projects of some kind to promote a good school atmosphere, we do not attach great importance to the attention argument.

There are further aspects to investigate. Background factors may be of importance to outcome, and SET may be more effective with certain students than others. Also, there is a need to investigate implementation factors to see whether teaching style alone will have the same effect as SET teaching, and whether teachers are better at teaching skills to handle externalizing rather than internalizing problems. We await the results of long-term follow-up to see whether the discernible effects so far become stronger the longer students are exposed to the program (Greenberg et al., 2001Go). This may especially apply to internalizing problems.


    FUNDING
 TOP
 SUMMARY
 INTRODUCTION
 METHOD
 RESULTS
 Discussion
 FUNDING
 REFERENCES
 
Funding for the research was provided through grant 2001–1072 from the Swedish Council for Social Research (SFR) and grant 2003–2785 from the Swedish Council for Working Life and Social Research (FAS).


    REFERENCES
 TOP
 SUMMARY
 INTRODUCTION
 METHOD
 RESULTS
 Discussion
 FUNDING
 REFERENCES
 
Achenbach T. M., Edelbrock C. Manual for the youth self-report and profile (1987) Burlington, VT, USA: Department of Psychiatry, University of Vermont.

Becker J. Synthesizing standardized mean-change measures. British Journal of Mathematical and Statistical Psychology (1988) 41:257–278.

Catalano R. F., Berglund M. L., Ryan J. A. M., Lonczak H. S., Hawkins J. D. Positive Youth Development in the United States: Research findings on Evaluations of Positive Youth Development programs, University of Washington. Prevention and Treatment (2002) 5. Article 15 (APA).

Cohen J. Statistical Power Analysis for the Behavioral Sciences (1988) Lawrence Erlbaum Associates.

Cook T. D., Campbell D.T. Quasi-experimentation. Design and Analysis Issues for Field Settings (1979) Chicago: Rand-McNally.

Coopersmith S. The Antecedents of Self-Esteem (1967) San Francisco, WE, USA: Freedman and Co.

Durlak J. A. Successful Prevention Programs for Children and Adolescents (1997) New York, USA: Plenum Press.

Durlak J. A., Weissberg R. P. Meta-analysis of 665 School, Family and Community PYD Interventions (2005) www.casel.org.

Durlak J. A., Wells A. M. Primary prevention mental health programs for children and adolescents: a meta-analytic review. American Journal of Community Psychology (1997) 25:115–152.[CrossRef][Web of Science][Medline]

Elias M. J., Zins J. E., Weissberg R. P., Frey K. S., Greenberg M. T., Haynes N. M., et al. Promoting Social and Emotional Learning. Guidelines for Educators (1997) Alexandria, VA, USA: Association for Supervision and Curriculum Development.

Gadd A. Uppfattningar om värdet av att undervisa i ett socio-emotionellt tränings program (2003) Linköpings universitet, Institutionen för Beteendevetenskap, Psykologprogrammet.

Greenberg M. T. The PATHS Project: Preventive intervention for children: Final report to NIMH (1996) Seattle: Department of Psychology.

Greenberg M. T. Current and future challenges in school-based prevention: the researcher perspective. Prevention Science (2004) 5:5–13.[CrossRef][Web of Science][Medline]

Greenberg M. T., Domitrovich C. E., Bumbarger B. The prevention of mental disorders in school-aged children: current state of the field. Prevention and Treatment (2001) 4. Article 1.

Gresham S. M., Elliott S. N. Social Skills Rating System Manual (1990) Circle Pines, MN, USA: American Guidance Service.

Harman H. H. Modern Factor Analysis (1976) Chicago: The University of Chicago Press.

Hibell B., Anderson B., Bjarnason T., Kokkevi A., Morgan M., Narusk A. The 1995 ESPAD Report. Alcohol and Other Drug Use Among Students in 26 European Countries (1997) Stockholm: The Swedish Council for Information on Alcohol and Other Drugs.

Kimber B. Livsviktigt, SET, Student Book (2001) a Stockholm: Ekelunds förlag.

Kimber B. Livsviktigt, SET, Teacher Manual (2001) b Stockholm: Ekelunds förlag.

Lindberg L., Larsson N., Bremberg S. Ungdomars psykiska hälsa. Utvärdering av ett mätinstrument. Stockholm, Centrum för Barn- och Ungdomshälsa. Rapport från samhällsmedicin (1999) 1992(2). (CBU).

Marlowe D. B. Drug Court Efficacy vs. Effectiveness. Join Together to advance effective alcohol and drug policy, prevention, and treatment (2004) www.jointogether.org.

Moffit T. E. Adolescence-limited and life-course-persistent antisocial behavior. A developmental taxonomy. Psychological Review (1993) 100:674–701.[CrossRef][Web of Science][Medline]

Murray C. J. L., Lopez A. D. Global Burden of Disease (1996) Harvard: Harvard University Press.

Ouvinen-Birgerstam P. Jag tycker jag är (1985) Stockholm: Psykologiförlaget.

Pearlin L. I., Liebman M. A., Menaghan E. G., Mullan J. T. The stress process. Journal of Health and Social Behavior (1981) 22:337–356.[CrossRef][Web of Science][Medline]

Riggs N. R., Greenberg M. T., Kusché C. A., Pentz M. A. The mediational role of neurocognition in the behavioral outcomes of a social-emotional prevention program in elementary school students: effects of the PATHS curriculum. Prevention Science (2006) 7:91–102.[CrossRef][Web of Science][Medline]

Rutter M. Psychopathological development across adolescence. Journal of Youth Adolescence (2007) 36:101–110.[CrossRef][Web of Science]

Sampson R. J., Laub J. H. Life-course desisters? Trajectories of crime among delinquent boys followed to age 70. Criminology (2003) 41:555–593.[CrossRef][Web of Science]

Scheier L. M., Botvin G. J., Griffin K.W. Preventive intervention effects on developmental progression in drug use: structural equation modeling analyses using longitudinal data. Prevention Science (2001) 2:1–13.[CrossRef][Medline]

Spivack G., Shure M. Social Adjustment of Young Children: A Cognitive Approach to Solving Real-life Problems (1974) San Francisco: Jossey Bass.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?



This Article
Right arrow Abstract Freely available
Right arrow FREE Full Text (PDF) Freely available
Right arrow All Versions of this Article:
23/2/134    most recent
dam046v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Disclaimer
Google Scholar
Right arrow Articles by Kimber, B.
Right arrow Articles by Bremberg, S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kimber, B.
Right arrow Articles by Bremberg, S.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?