Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Sep 1.
Published in final edited form as: J Sch Health. 2019 Jul 17;89(9):759–780. doi: 10.1111/josh.12814

A critical review of anti-bullying programs in North American elementary schools

Jared R Rawlings 1, Sarah A Stoddard 2
PMCID: PMC6684463  NIHMSID: NIHMS1035253  PMID: 31315161

Abstract

BACKGROUND:

Bullying behavior is a concern among school-aged youth and anti-bullying programs have been implemented in schools throughout North America. Most anti-bullying programs are delivered to adolescent youth because antisocial-aggressive behaviors are typically associated with this developmental stage. This paper is a review of empirically evaluated school-based bullying prevention and intervention programs in North American elementary schools.

METHODS:

We conducted a systematic, critical review of bullying prevention programming. Data were analyzed to determine the study method, intervention components, measurement of bullying, aggression, or peer victimization, outcomes measured, and results.

RESULTS:

Our review resulted in the identification of 10 interventions aimed at youth in grades K-6 enrolled in North American elementary schools. Effective intervention strategies targeted a variety of bullying behaviors using diverse mechanisms and included a school – and community-wide approach. Direct outcomes of the reviewed evaluations were centered on bullying, aggression, and victimization. Indirect outcomes of review evaluations included strategies for bystanders, school achievement, perceived school safety, and knowledge or attitudes about bullying.

CONCLUSIONS:

Recommendations for promising practices in effective bullying intervention programming are offered. The review concludes with suggestions for supporting school health staff and in-service teachers drawn from the body of research, and offers direction for future study.

Keywords: bullying, anti-bullying programs, aggression, intervention, evaluation, prevention, elementary school


Bullying behavior is a risk factor for many adolescent youth in North America.1–3 According to the US Centers for Disease Control and Prevention (CDC), “… nearly 30% of American adolescents reported at least moderate bullying experiences as the bully, victim, or both.”4 Moreover, bullying has been defined as a sub-category of aggression2 depicted as intentional, repetitive, and imposing a power imbalance2,3,5 between students who bully and students who are victimized. The CDC also includes “… any unwanted aggressive behavior(s) by another youth or group of youths who are not siblings or current dating partners.”6 Bullying behaviors can be classified as direct and overt or indirect and covert.3,5,10–12 Direct/overt aggression includes physical and verbal aggression.3,13 Physical aggression is defined as shoving, hitting, punching, kicking, and pushing.2,14,15 Verbal aggression includes harmful taunting and teasing.2 Whereas, indirect/covert forms of aggression (psychological, relational, and reputational aggression) include exclusion, ridicule, and name calling with a specific goal of manipulating social networks.1,3,11,12 Indirect/covert forms of aggression have been documented to have more long-term harms on individuals who are targeted.16 Indirect/covert forms of aggression are most prevalent in North American educational settings and researchers overwhelmingly agree that these are more difficult to address.9,16 Despite the prevalence of indirect/covert forms of aggression in North American education settings, these forms of aggression have not been as prevalent in elementary schools. Thus, direct and overt forms of aggression are more likely observed in North American elementary schools.

Long-term outcomes of bullying perpetration increase the likelihood of experiencing depression, delinquency, and criminality as adults, as well as intimate partner violence perpetration and possible unemployment.16 These deleterious long-term effects are alarming for school health researchers, and rightly so. Theories associated with bullying intervention programs indicate that peer victimization typically begins during preadolescence, peaks during adolescence, and then diminishes through adulthood,4 which suggests that taking preventative action prior to the advent and acceleration of peer victimization can have a significant effect in reducing bullying behaviors. Evaluations of bullying prevention programs and meta-analytic reviews of program evaluations17–19 have contributed a wealth of knowledge about youth aggression and over the past ten years, educational researchers have emphasized a more social-ecological approach to understanding bullying.3,7–9 Although anti-bullying programs have largely been delivered to adolescent populations, a growing number of preventative interventions have been advanced for use with children in elementary schools. Yet, little is known about the effectiveness of school-based programs for elementary school children.20 Thus, in this paper, we present a review of empirically evaluated school-based bullying prevention and intervention programs in North American elementary schools.

METHODS

This section describes elements of the critical and systematic literature review process, including the method for selecting and categorizing papers included in this review. We conducted a key word search in 8 health, psychology and educational electronic bibliographic databases: PsycINFO, EMBASE, Educational Resources Information Center, the Physical Education Index, MEDLINE (January 1, 1966 – February 13, 2013), JAMA, Dissertation Abstracts, and the SAGE full-text collection. The following keyword terms were selected to capture papers for review: bullying, elementary school, intervention, prevention, physical aggression, and verbal aggression. After screening approximately 1000 titles and abstracts, 46 papers were identified for review on the following initial inclusion criteria:

  • Intervention or prevention programs were school-based.

  • Participants were elementary school aged (ie, grade levels K – 6).

  • Outcome variables clearly measured bullying or aggression toward peers, including physical or verbal aggression in a school setting.

  • The evaluation was conducted in North America.

As the goal of our review was to identify evaluated school-based intervention programs to reduce bullying in elementary schools in North America, papers were immediately excluded if they did not include an evaluation of an intervention or prevention program intended to address bullying or the programs were not conducted in an elementary school. We chose to focus on the evaluation of intervention or prevention programs used in elementary schools to address bullying, as we identified a clear need to critically examine evaluated bullying intervention programs focused on elementary schools. Papers were also excluded if they exclusively describe the details of a program or components of program evaluation (eg, study method, intervention components, etc.) were either incomplete or not reported. In addition, we reviewed references used in the primary sources to identify papers that were not discovered during the initial search.

Nineteen papers met the initial review criteria and were analyzed to determine the study method, intervention components, measurement of bullying, aggression, or peer victimization, outcomes measured, and results. We focused on these components as they are important to critiquing the effectiveness of bullying intervention and prevention. Our review resulted in the identification of 10 intervention programs aimed at youth in grades K-6 enrolled in North American elementary schools. Direct outcomes of the reviewed evaluations were centered on bullying, aggression, and victimization. Indirect outcomes of reviewed evaluations included strategies for bystanders, school achievement, perceived school safety, and knowledge or attitudes about bullying. Duplicate publications or articles that reported identical interventions and outcomes measured over the same time period on the same population were excluded.

RESULTS

Our findings are presented in Tables 1–6 and are organized into 3 categories: (1) universal school-based only interventions; (2) universal school-based intervention with community-wide components; and (3) targeted interventions. These 3 categories emerged as a way of classifying the delivery method of the intervention program. The identified interventions are listed alphabetically, and chronologically for interventions with multiple evaluation studies. Descriptive Tables (1, 3, 5) describe the interventions identified through the review protocol.

Table 1.

Descriptions of Universal School-based Interventions for Bullying in Elementary Schools

Intervention (Evaluation Citation) Description Grade(s) Intervention Length Delivery/Components Targeted Behavior Intervention Focus Theory/Conceptual Framework
I. Bully Busters & Bullying Proofing your School (Orpinas, Horne, & Straniszewski, 2003) 20-hr. inservice staff professional development; School environment/student code of conduct: BEE Character Program; Peace-Able Place Program for conflict resolution. 1st; 5th 8-9 months In-service staff professional development; School-wide Physical Aggression; Verbal Aggression Bully; Victim; Bully-Victim; School climate NR
II. Bully Proofing your School (Hallford, Borntrager, & Davis, 2006) 45-min weekly, teacher delivered lessons; handouts& homework; sexual harassment lesson was adapted for appropriateness 4th – 5th 11 weeks Curriculum-based Bullying Bully; Bystanders; Victim; Bully-Victim; School-climate NR
(Toner, 2010) 5 lessons taught sequentially with follow-up activities; handouts; classroom posters 6th 12 weeks Curriculum-based; In-service staff professional development Bullying; Verbal Aggression Bully; Victim; Bully-Victim; School climate NR
III. Dare to Care: Bully Proofing your School (Beran, Tutty, & Steinrath, 2004) 3 Components: Teacher training; discipline policy; and curriculum; variety of activities: school assemblies, support groups, live theatre, and workshops. No standardized set of procedures. 4th – 6th 12 weeks Curriculum-based; Individual & Group counseling; In-service staff professional development; Policy development School-wide Physical Aggression; Psychological Aggression; Relational Aggression; Verbal Aggression Bully; Victim; Bully-Victim; School climate Garrity, 2000
IV. Expect Respect (Meraviglia, Becker, Rosenbluth, Sanchez, & Robertson, 2003) weekly lessons for students; 3 staff training sessions for all school administrators and teachers; Develop a campus anti-bullying policy; Parent education through info. sessions and newsletters. 5th grade 12 weeks Curriculum-based; Parent education; Policy development; In-service staff professional development; School-wide Bullying Bully; Victim; Bully-Victim; School climate Olweus
V. Gentle Warrior Program (Twemlow, Biggs, Nelson, Vernberg, Fonagy, & Twemlow, 2008) 9 (45 min) sessions during years 1 & 2 and 3 (45 min) sessions during year 3– Martial arts training; Role-play common bullying situations 3rd – 5th grade 3 years Curriculum-based; School-wide Bullying; Physical Aggression; Relational Aggression Bully; Bystanders; Victim; Bully-Victim; School climate Creating a Peaceful School Learning Environment (CAPSLE)
VI. Olweus Bullying Prevention Program (Finn, 2008) 2 day-long training sessions for all classroom teachers (continued staff meetings); Classroom discussion about anti-bullying behavior; Develop a campus anti-bullying policy; Parent education through info. sessions and newsletters to the community 3rd-5th grade 3 years Community-based; Curriculum-based; Individual; Policy development; In-service staff professional development; School-wide Bullying Bully; Victim; Bully-Victim; School climate Olweus
VII. Positive Action (Li, Washburn, Dubois, Vuchinich, Ji, Brechling, Day, Beets, Acock, Berbaum, Synder, & Flay, 2011) Classroom curriculum with over 140 (15 min) lessons per grade to be taught 4 days per week; Initial and ongoing staff training (4 hr and 2 hr, respectively); Teacher consult with intervention coordinator; family classes offered 3rd – 5th grade 3 years Curriculum-based; In-service staff professional development; Parent education; School-wide Physical Aggression; Relational Aggression School Climate Theory of Triadic Influence; Multiple behavior Theories (Ajzen, 1991; Bandura; 1986; Hawkins & Weis, 1985)
VIII. Steps to Respect (Frey, Hirschstein, Edstrom, & Snell, 2009) 10 weeks of biweekly basic lessons and 8-10 literature based lessons; Initial staff training and campus policy development; individual coaching for perpetrators and victims 3rd – 6th grade 12 weeks Curriculum-based; Individual; In-service staff professional development; Policy development; School-wide Bullying Bully; Victim; Bully-Victim; School climate Social-Ecological Theory
(Low, Frey, & Brockman, 2010) 10 weeks to develop skill and rule clarification and 2 weeks of literature based lessons (emphasized empathy); 2 days of staff development and campus policy development 3rd-6th grade 12 weeks Curriculum-based (classroom level); In-service staff professional development; Policy development; School-wide Bullying; Relational Aggression Bully; Victim; Bully-Victim; School climate Social Ecological & Cognitive-Behavioral Theories (Frey et al., 2009).
(Low, Smith, Brown, Fernandez, Hanson, & Haggerty, 2011) See Low et al., 2010 Curriculum-based (classroom level); In-service staff professional development; Policy development; School-wide Bullying Bully; Victim; Bully-Victim; School climate Theory of Change (socio-environmental-oriented)
IX. Youth Matters (Jenson & Dietrich, 2007) 10-session module during 4 semesters (English & Spanish translations available) 4th grade 2 years Curriculum-based; School-wide Relational Aggression; Verbal Aggression Bully; Victim; Bully-Victim; School climate Social Development Model (Catalano, & Hawkins), 1996)

Table 6.

Evaluation Design & Outcomes for Targeted Bullying Interventions

Intervention: Evaluation Citation Sample Size Sample Description Study Design1 and Method of Group Assignment Measures Analyses Direct Outcomes2/Results Indirect Outcomes3/Results
I. Bully Busters (Browning, 2004) N = 36 (18E, 18C) Age: range = 24-59 99% White, 1% AA Pre- posttest/delayed posttest
RCT (teacher SS #)

1 rural school in East Tennessee, KY
TISK-E (Newman, Carlson, & Horne, 2005) α = .79-.92 ANCOVA NR Program effectively trains educators to acknowledge bullying, respond to it, and intervenes to provide more hopeful outcomes for victims
II. PEGS (Newgent, Behrand, Lounsbery, Higgins, & Lo, 2010) N = 23 students Age: 35% in 3rd Grade, 22.6% in 4th Grade, 41.9% in 5th Grade 74.2% White, 22.6% AA, 3.2% Hispanic 61.3% boys 19.4% identified having a disability (learning, behavioral, emotional).

Clinical Sampling into 3 groups
Pre – posttest/follow-up test

1 school geographic region was unknown
Social Skills Rating Scale – Teacher Form (Greshman & Elliot, 1990) α = .78-.94

Peer Relationship Measure – Teacher Report (Newgent, 2008) α = .80-.86

Peer Relationship Measure-Self Report (Newgent, 2008) α = .66-.87

Modified Rosenberg’s Self-Esteem Inventory (Eimprich, Perren, & Hornung, 2005)

α = .47-.70
Assessed 3 times; one-way ANOVA

t tests pairwise difference
Group 1: SD in self-control from pre-test to posttest and pre-test to follow-up test
Improved performance in social situations & greater sense of belonging

Group 2: SD in social skills from pre-test to posttest and pre-test to follow-up test (teacher reported, not pairwise comparisons)

Group 3: SD in improvement of assertion from posttest to follow-up

Students without clinically significant problems benefitted from the PEGS program
NR

Notes:

1

QED = quasi-experimental research design; RCT = randomized control trial; NR = not reported; AA = African American; NA = Native American; AI = American Indian; E = experimental; C = Control; F-RL = Free-reduced lunch; SR = self-reported; NSD = no statistical difference; SD = statistical difference; ESL = English [as a] secondary language;

2

Direct outcomes refers to targeted behaviors to include bully behaviors, aggression, or peer victimization;

3

Indirect outcomes refers to suggested strategies for bystanders, changes in school achievement, perceived school safety, and/or knowledge or attitudes about bullying.

Table 3.

Descriptions of Universal School-based Intervention with Community-wide Components for Bullying in Elementary Schools

Intervention (Evaluation Citation) Description Grade(s) Intervention Length Delivery/Components Targeted Behavior Intervention Focus Theory/Conceptual Framework
I. WITS (Leadbeater, Hoglund, & Wood, 2003) Literacy focused curriculum for Grades K-3 through early childhood storybooks; Activities include role-playing; drawing and creative writing; 2 hr staff training for program implementation; Police liaison visit to classrooms and deputizing ceremony 1st – 2nd 2 year Curriculum-based; Community-wide; School-wide Physical Aggression; Relational Aggression Bully; Victim; Bully-Victim; School climate NR
(Wood, Coyle, Hoglund, & Leadbeater, 2007) See Leadbeater et al., 2003 1st – 2nd 2 year Curriculum-based; Community-wide; School-wide Physical Aggression; Relational Aggression Bully; Victim; Bully-Victim NR
(Leadbeater & Sukhawathanakul, 2011) See Leadbeater et al., 2003; Additionally a training video is made available for teachers and community visitors; Teachers sent newsletters Implementation fidelity measured & reported 1st – 3rd 18 months Curriculum-based; Community-wide; Parent education; School-wide Physical Aggression; Relational Aggression Bully; Victim; Bully-Victim; School climate; Peer Victimization NR
(Giesbrecht, Leadbeater, & MacDonald, 2011) See Leadbeater et al., 2011 See Leadbeater et al., 2011 See Leadbeater et al., 2011 Curriculum-based; Community-wide; Parent education; School-wide Physical Aggression; Relational Aggression Bully; Victim; Bully-Victim; School climate; Peer Victimization NR
(Hoglund, Hosan, & Leadbeater, 2012) See Leadbeater et al., 2011 1st – 6th See Leadbeater et al., 2011 Curriculum-based; Community-wide; School-wide Physical Aggression; Relational Aggression Peer Victimization NR

Table 5.

Descriptions of Targeted Interventions for Bullying in Elementary Schools

Intervention (Evaluation Citation) Description Grade(s) Intervention Length Delivery/Components Targeted Behavior Intervention Focus Theory/ Conceptual Framework
I. Bully Busters (Browning, 2004) 8 learning modules (4-6 activities per module) – weekly segments (20-30 mins); 3 options for implementation: single teacher in a classroom; school’s curriculum; teacher/faculty approach; Modules delivered in 3 sessions. K – 5th 3 days School-wide; Teacher targeted; Emotional Aggression; Physical Aggression; Psychological Aggression; Relational Aggression Bully; Victim; Bully/Victim NR
II. PEGS (Newgent, Behrand, Lounsbery, Higgins, & Lo, 2010) Teacher referral system to identify children for intervention; Program based on 6 psychosocial education components: 1) improving social skills; 2) building and increasing self-esteem; 3) developing problem-solving skills; 4) assertiveness training; 5) enhancing stress/coping skills; 6) prevention of mental health problems/problem behaviors. Students divided into 3 groups based on pre-assessment scores; session co-facilitated by graduate students
6 (30 min) sessions over 6 weeks
3rd – 5th 2 weeks Individual and Group Counseling Bullying Bully; Victim; Bully/Victim NR

Table 1 reports programming with a universal school-based only delivery system of the intervention. Although single or multiple levels of delivery within the school setting maybe included in a program, these programs are intended for delivery within the school building, only. Table 3 reports programming that pair a universal school-based program with a community-wide intervention component. Additionally, a call for community involvement makes these programs unique compared the programs listed in Table 1. Table 5 displays programming that targets specific individuals or groups for delivery of the intervention.

Program Evaluation Tables (Tables 2, 4, 6) describe the evaluations and outcomes of the intervention programs including sample description, study design, analytic method, and outcomes of the evaluation. We do not report statistical results and effect sizes, rather we designate whether there were no significant difference (NSD) or significant difference (SD) for each program condition (E = experimental; C = control). Outcomes are described as reported by the intervention evaluation researcher(s).

Table 2.

Evaluation Design and Outcomes for Universal School-based Bullying Interventions

Intervention (Evaluation Citation) Sample Size Sample Description Study Design1 and Method of Group Assignment Measures Analyses Direct Outcomes2/Results Indirect Outcomes3/Results
I. Bully Busters & Bullying Proofing your School (Orpinas, Horne, & Straniszewski, 2003) Pre-test N = 541; Post-test N = 510 Mean age: 7 (1st Grade); 11 (5th Grade) 57% AA; 33% Caucasian - 57% participated in F-RL; average class size = 22 Pre – posttest (1 year) 1 School; 24 classrooms Intervention group only Aggression Scale (Orpinas & Frankowski, 2001) α = .79

Victimization Scale (Orpinas & Frankowski, 2001) α = .72
ANOVA K-2: 40% decrease in aggression; 19% decrease in victimization
Grades 3-5: No significant changes in aggression; Intervention effects of SR
Victimization: 23% decrease in victimization
NR
II. Bully Proofing your School (Hallford, Borntrager, & Davis, 2006) Pre-test N = 98; Post-test N = 67 Age: 9-12 years old
AA 86.9%, 8.2% White, 3.3% Hispanic, 1.6% NA;
66% participated in F-RL; average class size: 19.6; 38 boys
Pre – posttest (5 month) 1 School; 5 classrooms (grades 4-5) (mid-sized, urban city)
Intervention group only
Hallford Questionnaire α = .72 ANCOVA

independent sample t-tests; pairwise t-tests
Frequency of Bullying:
NSD for independent sample t-tests
ANCOVA no significant effects for the covariate, grade, sex

Attitudes toward bullying:
SD by sex (girls reported higher anti-bullying attitudes than boys
SD by grade (4th graders reported greater perceived power than 5th graders)

Evaluation of Program:
NSD found for sex
SD found for grade
Overall increase in anti-bullying attitudes and perceived power

5th grade students rated the program less positively than 4th grader students
(Toner, 2010) N = 149 (58E, 91C) Age: 6 grade
E: 50% White, 34% AA, 7% Hispanic, 9% Asian
C: 82% White, 7% AA, 2% Hispanic, 8% Asian
50% boys and 96% attendance rate in both schools
QED: (not randomly assigned between subject variables)
Pre – posttest

2×2 mixed factorial design with 1 between subjects IV (E & C schools) and 1 within-subjects IV (pretest to posttest)

2 suburban schools (1 E school – 1 C school) in New Jersey
Peer Interaction in Primary School (PIPS) (Tarshis & Huffman, 2007)
α = .90

Colorado School Climate Survey (Plog, Epstein, & Porter, 2004)
α = .81
RQ: 1 2-way repeated measure mixed factorial ANOVA E school: decrease in victimization (NSD)

C school: SD bullying between pre – posttest

E school: NSD bullying between pre - posttest
E & C schools report increase in school climate (NSD between time and group)

Absenteeism in E school at posttest was slightly higher (4%) compared to C school (2%).

C school were more likely to miss school because of fear (11%) when compared with E school (4%)
III. Dare to Care: Bully Proofing your School (Beran, Tutty, & Steinrath, 2004) N = 197 Age: Grades 4-6
Schools selected to match student characteristics (majority were Caucasian and middle class) 77 boys

School policies prohibit student demographic data collection
Pre – posttest

4 schools (Catholic – comparison school & 2-year program school; public school – 3-month & 1-year program school) in Calgary, Canada

Pre-test (Time 1 - March)
Posttest (Time 2 – 3 months – June)
Posttest (Time3 – 1-year – June)
Posttest (Time 4 – 2-years from Time 2 – June)
Colorado School Climate Survey (Garrity et al., 2000)
α = .81

Provictim Scale-Short Version (Rigby & Slee, 1991).
α = .78
ANOVA with Bonferonni procedure paired sample t tests

MANOVA

Tukey’s post hoc test
ANOVA:
3-month students reported witnessing less bullying and did not change their attitudes towards victims

MANOVA:
NSD among 3 program school on 4/5 variables
Students in the 2-year program reported significantly more positive attitudes toward victims than students in the 30-month program school (Tukey’s test)
IV. Expect Respect (Meraviglia, Becker, Rosenbluth, Sanchez, & Robertson, 2003) N = 740 (Student)

N = 671 (Staff-fall)

N = 451 (Staff-spring)
Student:
Age: Grade 5
16% AA, 25% Hispanic, 59% White/AI/Asian; 31.5% participated in F-RL Staff: 90% women (pre-posttest); 72% teachers (pre-test), 83% (posttest)
11% AA, 21% Hispanic, 65% White, 3.3% Other
Pre – posttest

RCT: school-matched pair

12 schools (6E, 6C) – geographic region unknown
Researcher-designed No alpha reported Chi-square student to staff responses Incidence of bullying at school:
SD between student E (45% every day) and C schools (14% everyday)
SD between staff E (58%) and C (31%) schools

NSD in identifying bullying behaviors.
Students and staff report most frequent bullying occurs outside of the classroom.

NSD with increased knowledge about bullying
V. Gentle Warrior Program (Twemlow, Biggs, Nelson, Vernberg, Fonagy, & Twemlow, 2008) N = 254 Age: Grades 3-5
(3rd N = 98, 4th N = 78, 5th N = 78)
59.8% White, 22.4% AA, 6.5% Hispanic, 1.2% NA
147 boys
61% identified as low-income
RCT: 3-year cluster

3 schools in a large Midwest city (pop. 250,000)
Victimization of Others (VO) scale of the Bully-Victim Questionnaire (Dill, Vernberg, Fonagy, Twemlow, & Gamm, 2004)
α = .94

Victimization of Self (VS) scale of the Bully-Victim Questionnaire (Dill, Vernberg, Fonagy, Twemlow, & Gamm, 2004)
α = .92

Agression is Legitimate (AL) (Dill, Vernberg, Fonagy, Twemlow, & Gamm, 2004)
α = .88
ANOVA Hierarchical Multiple Regression Boys in the treatment group reported lower frequency of aggression and greater frequency of helpful bystanding over time

NSD were found for girls
AA reported greater aggression compared to other

Post hoc Sheffé tests (p < .05) indicated that helpful bystander behavior was greatest among 3rd graders and least among 5th graders
VI. Olweus Bullying Prevention Program (Finn, 2008) N = 821 (E1 – 208; E2 – 229; C1 – 225; C2 – 158) Age: Grade 3-5
78.6% White, 6.3% Hispanic, 3.3% AA, 11.7% AI, Alaskan, Asian or Pacific Islander
3.4% participated in F-RL

1-year follow-up
N = 801 (E1 – 208; E2 – 234; C1 – 209; C2 – 150)
Pre – post

4 suburban schools (2E, 2C) in the Hudson Valley Region (NY)
Olweus Bully/Victim Questionnaire
Bergen Questionnaire

Individual, α = .80
School-wide, α = .90


ANOVA

MANOVA
Girls reported victimization reduced significantly

Girls were more likely to exclude than engage in physical aggression

Post hoc pairwise comparison revealed that boys were also more like to exclude than engage in physical aggression

Post hoc pairwise comparison revealed that girls were more likely to spread rumors than engage in physical aggression
Positive correlation (r = .30) perceiving adults as putting a stop towards bullying with perceiving students as putting a stop towards bullying
VII. Positive Action (Li, Washburn, Dubois, Vuchinich, Ji, Brechling, Day, Beets, Acock, Berbaum, Synder, & Flay, 2011) N = 510
new students were added and followed
Age: Grades 3-5
46% AA, 27% Hispanic, 7% White; 3% Asian, 17% mixed
49% girls
RCT: matched school

14 schools (7E, 7C-split) in Chicago Public Schools
Aggression scale (Orpinas & Frankowski, 2001)
α = .81

Frequency of Delinquent Behavior Scale (Dunford & Elliot, 1984)
α = .76
Multilevel regression
multilevel Poisson models
Program schools report a 41 % reduction in bullying NSD in reported rates problem behaviors between E and C schools
VIII. Steps to Respect (Frey, Hirschstein, Edstrom, & Snell, 2009) N = 399 (176E, 196 C) Age: Grades 3-5
8.6% AA, 14.5% Asian American, 5.5% Hispanic, 1.4% NA, 70% European American
49.4% girls
ESL 11.5%
Longitudinal Pre- posttest School matched within district

Students randomly selected at pretest for observation

6 schools from 2 districts in the Pacific Northwest
Peer-Preferred Social Behavior subscale of Walker McConnell Scale of Social Competence and School Adjustment elementary version (Walker & McConnell, 1995)
α = .85-.89

School Experience Survey (Frey et al., 2005)
α = .86-.88
3-level mixed hierarchical models nested time point (fixed effect, Level 1) within individual student (random effect, Level 2) Consistent reductions in problem behavior were reported

Reductions strengthened with a 2nd year of implementation
Changes observed in destructive bystander behavior were so substantial that the behavior almost disappeared.
(Low, Frey, & Brockman, 2010) N = 1126 (610E, 516C)
Age: Grades 3-6
9% AA, 12.7% Asian, 7% Hispanic, 1.3% NA, 70% European American
50.7% boys NSD in ESL

6 month follow-up N = 544

N = 12 Grade 3-4/N = 10 Grade 5-6 randomly selected to be observed on playground

N = 73 (36E, 36C) teachers
84.9% female
Pre – post

RCT: Individual and school

6 suburban schools from 2 districts
School Experience Survey (Frey et al., 2005)
α = .76-.80

Beliefs Endorsing Retaliation
α = .86-.88
Hierarchical mixed models:
Individual students (level 1) nested within classrooms (level 2)
Standardized mean differences
Retention analyses
Variations between classrooms are more closely linked to victimization than variations between schools



Retention rates (92.4%) did not differ by group

E students show SD (declines) to C students
Approximately 234 fewer instances of gossip after 1-year of implementation
Over the school year, girls were more likely than boys to be involved as gossips and as targets of gossip

Gossip varied by classroom, targeting did not vary by classroom.

Where a peer group might discourage direct aggression it might invite covert aggression
(Low, Smith, Brown, Fernandez, Hanson, & Haggerty, 2011) N = 2, 940 (Student)

N = 128 (Teachers)

N = 1,920 (Staff)
Age: Grades 3-5
46% White, 39% Hispanic, 6% AA
51% boys
Average school size: 479 (range = 77-749)
Substantial variation in F-RL between schools (mean = 39.7%)

1-year follow-up
Pre – posttest

RCT: school matched pair (matched within county by ordinally ranked school size, number of FT teachers, change in enrollment, % of students eligible for F-RL, students race and ethnicity, ESL)

33 schools throughout 4 counties in central-northern California (25% rural, 10% small towns, 50% suburban, 15% mid-sized cities)
Bullying Prevention Initiative Student Survey (Custi, 2008)
α = .61-.86

School Environment Survey (Custi, 2008)
α = .80-.95
Mixed-model analysis of covariance (ANCOVA) Significant covariate effects were found across all student outcomes

School-level variation remained statistically significant for all outcomes

Boys are more likely to exhibit bullying behaviors and less social competency compared to girls
Teachers reported that older students were significantly more likely to exhibit bullying behaviors and display less social competency, academic competency, and academic achievement compared to younger students
IX. Youth Matters (Jenson & Dietrich, 2007) N = 1164 (702E, 462C) Age: Grade 4
E – 65% Latino, 13% AA, 14% AI/Asian/Mixed, 8% Caucasian
49% female

C – 51% Latino, 17% AA, 21% AI/Asian/Mixed, 11% Caucasian
53% female

2-year follow-up N = 1126 in 132 classrooms within 28 schools
RCT: school (stratified by geographic region in the city and risk criteria and then randomly assigned to either the control or experimental condition)

28 urban schools (14E, 14C) in Denver, CO

N = 39 E classrooms/N = 27 C classrooms
Revised Olweus B/V Questionnaire (Olweus, 1996)
α = .81

Bullying of Other Students (Solberg & Olweus, 2003)
α = .80
multilevel linear growth model Limited evidence of positive impact.

Small improvements were observed among students in the experimental condition on a measure of bully victimization in a continuous outcome growth model

Self-reported bully victimization among students in the E condition decreased at a higher rate compared to C condition (significantly lower by the end of the study)
NR

Note.

1

QED = quasi-experimental research design; RCT = randomized control trial; NR = not reported; AA = African American; NA = Native American; AI = American Indian; E = experimental; C = Control; F-RL = Free-reduced lunch; SR = self-reported; NSD = no statistical difference; SD = statistical difference; ESL = English [as a] secondary language;

2

Direct outcomes refers to targeted behaviors to include bully behaviors, aggression, or peer victimization;

3

Indirect outcomes refers to suggested strategies for bystanders, changes in school achievement, perceived school safety, and/or knowledge or attitudes about bullying.

Table 4.

Evaluation Design and Outcomes for Universal School-based Bullying Interventions with Community-wide Components

Intervention: Evaluation Citation Sample Size Sample Description Study Design and Method of Group Assignment Measures Analyses Direct Outcomes2/Results Indirect Outcomes3/Results
I. WITS (Leadbeater, Hoglund, & Wood, 2003) N = 432

9 month follow-up N = 423
2-year follow-up N = 397
Age: mean 6 years and 3 mon.
73% Canadian and European, 9% East Asian, 7% Aboriginal, 4% East Indian, 5% Other, 2% unreported; 51% boys
47% mothers completed some college/28% bachelors or graduate degree
32% of children’s households less than $30,000/65% 2-parent household
31% reported no lifetime moves/28% 3 or more lifetime moves
RCT:

17 urban schools (12E, 5C) from Western Canada

44 total classrooms
Social Experiences Questionnaire (Crick & Grotpeter, 1996) α = .72-.76

Early School Behavior Rating Scale (Caldwell & Pianta, 1991) α = .84-.90
Aggression types were assessed separately in repeated measures general linear models There are individual, classroom, school-level factors that predict increases in relational and physical victimization and that these can be effected by a prevention program.

Girls showed greater increases in relational victimization compared with boys

Classroom levels of relational aggression decreased significantly in the program schools compared with the control schools

Physical victimization decreased more in the low poverty program schools
NR
(Wood, Coyle, Hoglund, & Leadbeater, 2007) N = 409 (209E, 119C)

9 month follow-up N = 400
2-year follow-up N = 374
Age: mean 6 years and 3 mon.
73% Canadian and European, 9% East Asian, 7% Aboriginal, 4% East Indian, 5% Other, 2% unreported; 49% girls
47% mothers completed some college/28% bachelors or graduate degree
NSD between program and control school demographics
Pre- post-test

11 schools (5E, 6C) in Canada

41 total classrooms
See Leadbeater et al., 2003) Hierarchical multiple regression Increase in classroom levels of social competence show a decrease in relational and physical victimization in program schools

Higher level of school poverty predicted increases in physical victimization over time.

Peer victimization can be reduced in high-poverty schools through universal, multi-setting programs.
NR
(Leadbeater & Sukhawathanakul, 2011) N = 830

9 month follow-up N = 737 (422E, 315C)
2-year follow-up N = 732 (418E, 315C)
Age: 6 years and 9 mon.
48% mothers & 44% fathers education past HS; 21% mothers & 15% fathers bachelor’s degree
49.8% boys
13% lived in less than $30,000
QED:

11 schools (6E, 5C) in Western Canada

67 classrooms
Performance Standards: Social Responsibility Framework (BC Ministry of Education, 2001)

α = .93
Multi-level models

Level 1: within child change over time

Level 2: between-child differences in sex and family income

Level 3: between-school differences in program participation
Program participation was associated with rapid decline in physical and relational victimization compared with control schools.

Rates of physical and relational victimization declined 20% (T1), 18% (T2), and a further 11% (T3) – longer duration is important for reducing victimization
NR
(Giesbrecht, Leadbeater, & MacDonald, 2011) See Leadbeater et al., 2003 See Leadbeater et al., 2003 See Leadbeater et al., 2003 Multi-level equations (Levels 1-3) to characterize the longitudinal trajectories of victimization Average decline of 11% in physical and 7% in relational victimization for each additional year from baseline

Average child exhibited a 24% decline in physical and 46% decline in relational victimization by end of Gr. 3
Higher levels of emotional dysregulation on any occasion are associated with higher levels of victimization
(Hoglund, Hosan, & Leadbeater, 2012) N = 432

9 month follow-up N = 423
2-year follow-up N = 397
3-year follow-up N = 385
5-year follow-up N = 203
6-year follow-up N = 238
Age: mean 6 years and 3 mon.
73% Canadian and European, 9% East Asian, 7% Aboriginal, 4% East Indian, 5% Other, 2% unreported;
51% boys
Mother’s education ranged from 8th grade – University graduate degree
QED Longitudinal

11 schools (5E, 6C) in Western Canada
See Leadbeater et al., 2003 Attrition analyses






Psychometric and descriptive data

Multi-level growth models

Cohen’s d
Children lost to follow-up showed significantly more relational victimization and aggression, but less social competence than children retained.

Internal consistencies were moderate to high for all constructs across waves.

Average rates of peer victimization and help seeking decreased linearly and then accelerated significantly over time.

When children endorsed more help-seeking strategies, they tended to report fewer episodes of both physical and relational victimization.
Minimal attrition across Waves 1-4, but was significant over Waves 5 & 6 (45-60%)

Note.

1

QED = quasi-experimental research design; RCT = randomized control trial; NR = not reported; AA = African American; NA = Native American; AI = American Indian; E = experimental; C = Control; F-RL = Free-reduced lunch; SR = self-reported; NSD = no statistical difference; SD = statistical difference; ESL = English [as a] secondary language;

2

Direct outcomes refers to targeted behaviors to include bully behaviors, aggression, or peer victimization;

3

Indirect outcomes refers to suggested strategies for bystanders, changes in school achievement, perceived school safety, and/or knowledge or attitudes about bullying.

Our review resulted in the overall identification of 10 programs aimed at youth in grades K-6 enrolled in North American elementary schools. Effective intervention strategies targeted a variety of bullying behaviors using diverse mechanisms and included a school – and community-wide approach. The programs also varied in the age/ages at which the intervention took place with the most common being reported at targeting students in grade 3. Across some programs, results were demonstrated in both the short and long term.

Universal School-based Interventions

As Tables 1 and 2 show, 12 evaluations were found to address bullying behavior within a school-based delivery.

Bully Proofing Your School.

The Bully Proofing Your School (BPYS) was designed as an 11-week, teacher-delivered, fourth and fifth grade intervention.15 Lessons were delivered weekly and included handouts with short homework assignments for students with a focus on preventing bullying behaviors, increasing assertiveness of victims, and broadening a sense of responsibility to include bystanders. Participants (N = 98) completed pre- and post-intervention assessments which included self- and peer-nominations of bullying behavior, frequency of physical, verbal, and relational aggression, attitudes toward bullying behaviors and student program evaluation. The researchers reported that not having an immediate posttest along with little ethnic diversity of the sample were limitations of the study.

Whereas BPYS alone has been used to target specific grades within an elementary school, variations of this program have been used in a school-wide approach.21 This program was expanded to develop a school climate intervention as part of a larger research-based comprehensive approach with a cultural focus to address school bullying behavior from a positive, pro-social perspective. This curricular approach was utilized; however, additional in-service staff professional development was included within the design of the experiment. Using a quasi-experimental design, sixth grade participants (N = 149) from 2 schools (one experimental and one control) were selected for this study. Pre-post intervention assessments (Peer Interaction in Primary School; Colorado School Climate Survey) revealed a noticeable drop in reported victimization in the experimental group, however the decline was not statistically significant. Additionally, bullying behaviors decreased significantly from pre- to posttest in the control group, but it did not significantly differ from pretest to posttest in the experimental group. Additional findings are reported in Table 2. Although each school had similar population according to demographics and attendance rates; critical review of the demographic data revealed that ethnicity varied between the experimental and control schools which could have impacted their results. This intervention was unique as it used multiple delivery points of the intervention, a staff development component, and a prepared curriculum for students. Outcomes suggested this program to be effective in increasing a positive school climate and increasing anti-bullying attitudes.15,21

Expect Respect and Olweus Bullying Prevention Program.

The Expect Respect and Olweus Bullying Prevention Program (OBPP) are based on the Olweus conceptual framework designed to improve peer relationships and make schools safer, more positive places for students to learn and develop.22,23 The Olweus intervention program is a school-based curriculum that also includes school-wide and community activities. Using a randomized control design,22 3rd – 5th grade youth (N = 821; 78.6% white) from 4 elementary schools (2 intervention schools, 2 control schools) revealed no significant reductions in rates of reported bullying behavior in the intervention group. Moreover, the investigator found significant sex differences between types of bullying behaviors (excluding physical aggression) with girls more likely to report engaging in social aggression and boys are more likely to report perpetrating physical aggression.

Aligning with Olweus’ research,23 Expect Respect is a multi-level intervention program to educate students, parents, and school staff about bullying perpetration and sexual harassment behaviors. Moreover, this program establishes expectations for respectful and health behaviors in student relationships by emphasizing effective strategies for responding to inappropriate behaviors. Using a randomized control design, 5th grade students (N = 740; 59% white) from 12 schools (6 experimental/6 control; randomized by school matched pair, matched on sex, socioeconomic, ethnicity, and school population) were assessed on their knowledge and attitude of bullying. Staff members also completed a similar questionnaire. The investigators report that 15% of control students and 19% of intervention students knew what bullying behaviors were at posttest and what constitutes inappropriate behaviors among students. A statistically significant difference was detected with the identification of bullying behavior between the intervention and control groups at posttest (χ2(2) = 7.00, p < .05, N = 723). Moreover, 45% of intervention students reporting seeing bullying almost every day and 14% of control reported seeing bullying almost every day. There were also significant differences between staff in the intervention and control schools at posttest (χ2(2) = −2.174, p < .05, N = 1094); 58% of intervention staff identified bullying behavior while only 31% of control staff identified bullying. This revealed a phenomenon of increased reporting of bullying behaviors; however, increased reporting may illuminate misperceptions of prevalence. While students and staff expressed differing attitudes about how adults should respond to inappropriate behaviors, the multi-level intervention program did improve student participants’ abilities to identify bully behaviors. Olweus and Expect Respect share similar delivery strategies including staff development training, prepared curriculum, school-wide approach, and a policy development component. Additionally, the Expect Respect program offers a parent education component as a delivery strategy. Yet, neither program was effective in reducing bullying behaviors in these evaluations.

Gentle Warrior.

The Gentle Warrior (GW) program takes a unique angle on reducing bullying behaviors (including physical and relational aggression) by using a martial arts approach for creating a positive school climate.24 Utilizing the Creating a Peaceful School Learning Environment educational theory, this program was designed to modify the social dynamic surrounding bully-victim interactions by cultivating a mutual respect for others and building a sense of responsibility among students and adults to stop bullying behaviors. A sample of diverse youth (N = 254; (59.8% white, 22.4% African-American, 6.5% Hispanic, 1.2% Native American; 50% female) in grades 3–5 from 3 elementary schools were randomly selected from a city (250,000 population). This program was dosed over 3 years as a part of longitudinal, cluster-randomized control trial. Gentle Warrior was effective in lowering the frequency of physical aggression for boys over the 3-year timeframe; however, helpful bystander behavior diminished as the sample aged.24 Their results offer preliminary support for the use of martial arts-based interventions to address bullying prevention in schools for boys, by teaching empathy, self-control, and peaceful strategies to resolve conflicts may be a useful component in future intervention programs.24

Positive Action.

Positive Action is grounded in 2 theoretical frameworks.25 This intervention requires stringent curricular delivery with 4 lessons per week. This intervention program is the only program to address school climate as the primary goal of the intervention with the goal to reduce physical and relational aggression. This evaluation included a diverse sample of students (N = 510) in grades 3–5 from 14 elementary schools (7 intervention/7 control) and a 3-year, quasi-experimental pre- posttest design. The researchers concluded PA is an effective intervention, as it reduced physical bullying perpetration by 41% in program schools.

Steps to Respect.

Our review includes 3 evaluations for Steps to Respect.26–28 This program was designed to decrease school bullying by increasing adult monitoring and intervention in bullying events; improve systematic supports for socially responsible behavior; change student normative beliefs that support bullying; and address student social-emotional skills that counter bullying and support social competence. In addition to the multi-level program, which coordinates curriculum-based lessons, staff training, and campus policy development, the program staff provided individual coaching for perpetrators and victims of bullying identified during playground observation.26 Participants (N = 624) in grades 3–5 from 6 elementary schools (3 intervention/3 control) participated in the study. Schools were matched for size, ethnic breakdown, and percentage of students receiving free and reduced lunch. The evaluation included multiple posttests at 6-, 12-, and 18-month intervals. Additionally, a subset of students (164 intervention/196 control) were randomly selected at pretest for playground observation. The evaluation revealed significant changes in observed destructive bystander behavior. Over the 2-year period, bystander support for bullying behavior was reduced. Moreover, reductions in problem behaviors were strengthened with a second year of implementation of the intervention program.26

The Steps to Respect program has been studied as a means of reducing relational aggression on school playgrounds.27 Participants (N = 544) in grades 3–6 from 6 elementary schools in 2 suburban districts were matched for district size, ethnic breakdown, and percent of students receiving free or reduced-price lunch. These researchers chose a data subset (N = 12 grade 3–4; N = 10 grade 5–6), which were randomly selected for observation on the playground. Pretest observations for 610 students in the intervention schools were collected; however, only 544 students completed the posttest observation. Teachers (36 intervention/36 control) were selected to participate and had no prior experience with Steps to Respect. Previous studies found no difference in sex; however, these data revealed over the school year, girls were more likely than boys to be involved as gossips and as targets of gossip. The researchers reported that rates of relational aggression increased with chronological age and playground victimization declined when intervention students received individual support from teachers. Peer connectedness was not a protective factor with reducing victimization in the control group. Lastly, where a peer group might discourage direct aggression it might invite covert aggression.

Steps to Respect has also been evaluated using a randomized trial with a focus on students’ attitudes toward positive/negative behaviors related to bullying and how teachers intervene.28 Participants (N = 2940) in grades 3–5 from 33 elementary schools in 4 counties participated in the evaluation (17 intervention/16 control). Schools were matched based on school size, number of full-time teachers, change in student enrollment from 2006–2007, percentage of students eligible for free and reduced lunch, students’ race and ethnicity. Students were assessed prior to the intervention at the start of the 2008–2009 school year and again post-intervention at end of the school year. In addition, school staff completed a questionnaire focused on assessing their knowledge of bullying behaviors (N = 920). After completion of the intervention, the researchers found that girls reported more “appropriate” reactions to bullying behaviors, while boys reported more bullying behaviors and less indicators of social competency. Teachers reported that older students were significantly more likely to exhibit bullying behaviors and display less social competency, academic competency, and academic achievement compared to younger students. Grounded in social-ecological theory, StR was found to be effective in reducing bullying behaviors.26,27,28

Youth Matters.

Youth Matters promotes healthy development of young people by encouraging positive relationships and safe norms throughout the school community with the goal of reducing verbal and relational aggression.29 The program consists of 4 10-session curricular modules and the development of classroom or school-wide projects that demonstrate the adverse consequences of bullying behaviors and aggression to students. Participants (N = 1126) in 4th and 5th grade 66 classrooms (39 intervention classrooms/27 control classrooms) from 28 elementary schools were randomly selected to participate in the evaluation. The intervention classrooms received one 10-session curricular module during each of the 4 semesters over 2 academic years. Students were assessed for verbal and relational aggression in the fall and spring semesters during both academic years. Self-reported bully victimization among students attending intervention schools decreased at a higher rate compared to students in control group schools, and by the end of the study, found that bully victimization was significantly lower among the intervention students relative to the control. This outcome is encouraging because the curriculum modules tested in the study focus of teaching students social and emotional skills needed to cope with bullying incidents. Despite this intervention program being grounded in a social development model, the evaluation of Youth Matters provided limited evidence of positive long-term impact.29

Universal School-based Interventions with Community-wide Components

Tables 3 and 4 show 5 evaluations of the Walk away, Ignore, Talk it out, Seek help (WITS) program, which include delivery points at the school and in the community.14,30,31,32,33 The program actions are not intended as social skills children should try in isolation, but are intended to create a common language that connects victimized children with adults who can help them. WITS program evaluators chose to implement common delivery strategies including a parent education delivery strategy.14,32 Specific details about each evaluation may be found in Table 4. Students were assessed during the fall and spring semesters and one year post-intervention. Across all 5 trials, the researchers report a decline in physical and relational aggression among elementary school students.14,31 Outcomes of this prevention program included individual-, classroom-, and school-level factors that contribute to relational and physical victimization. These researchers also found that significant decreases in classroom levels of relational and physical aggression for the program schools compared with the control schools. In a later evaluation of this program, an average decline of 11% in physical and 7% in relational victimization for each additional year of program implementation in the intervention schools.14 Additionally, school-wide and family use of program-specific language opened lines of communication about victimization, which may help to enhance both child skills and school and family norms with respect to peer victimization and bullying behaviors.32 Based on the evaluations of WITS, programs using a school-wide approach to enhance social competence may be an effective strategy for reducing bullying behaviors.

Targeted Interventions

As Tables 5 and 6 show, 2 programs have been evaluated as targeted interventions.

Bully Busters.

The Bully Busters program posits to increase awareness of problem solving skills that result in more prosocial behaviors and building emotional intelligence as a mechanism to reduce/prevent bullying behaviors.34,35 The program trains teachers on the following components: (1) increasing the awareness of bullying; (2) preventing bullying in your classroom; (3) building personal power; (4) recognizing the bully; (5) recognizing the victim; (6) recommendations and interventions for bullying behaviors; (7) recommendations and interventions for helping victims; and (8) relaxation and coping skills. After this professional development intervention, teachers were to incorporate the above components into their classroom culture. Elementary school teachers (N = 36; 18 intervention/18 control) in the intervention groups received training on the 8 program modules through 3 half-day sessions.34 Teachers were assessed pre- and immediately post training and again at 6 weeks post-training. Twelve of the 18 teachers who received the intervention reported increasing their use of intervention strategies from “less than once of month” to “weekly.” After a 2-month follow-up posttest, Bully Busters was effective in training educators to acknowledge and report bullying behaviors.34

Psychosocial Educational Groups for Students.

The Psychosocial Educational Groups for Students (PEGS) program is designed to help elementary school students with social skills, problem behaviors, bullying, and self-esteem. The program utilizes a teacher referral system to identify students already demonstrating aggression and requiring an individual or group intervention strategy35 and consists of 6, half-hour group sessions over the course of 6 weeks. This program was evaluated on a clinical sample of students (N = 31) in grades 3 through 5. The researchers found an improvement in assertiveness from posttest to follow-up t(9) = −3.37, p = .01 amongst student subjects. PEGS was reported as effective with regards to increasing performance in social situations and social skills.35 Additionally, students without prior bullying behavior benefitted from this program.

DISCUSSION

This review of literature identified 19 evaluations of 10 intervention programs being implemented in North American elementary schools to reduce bullying behaviors. These programs represent great diversity in terms of their delivery strategies, targeted behaviors, and conceptual frameworks. While such range makes it difficult to draw specific conclusions about the methods and components most likely to produce significant reductions in bullying behavior, the results are consistent with developing views regarding bullying behavior and peer victimization. Theories associated with bullying intervention programs indicate that peer victimization typically peaks during adolescence, taking preventative action prior to the beginning of adolescence can have a significant effect in reducing bullying behaviors.4

Theories and Conceptual Frameworks

Our review highlighted inconsistencies in reporting theoretical and conceptual frameworks in bullying intervention programs. Ten of the 19 papers did not report a theoretical or conceptual framework. If a theoretical framework is not in place, choosing a scale for measuring bullying behavior, selecting intervention strategies, and evaluating for change in bullying behavior becomes problematic.28 A theoretical grounding aids in advising program development and evaluation.9 As reported in the Program Evaluation Tables, the intervention programs which had the most effect on elementary school students were grounded in a social-ecological theoretical framework. All levels of the ecological system interact and influence each other over time. Most effective intervention programs with elementary schools account for these influences and address each influence with a strategy for intervention. For stakeholders in school health, this conclusion should inform the design of future prevention investigations. Future empirical research examining anti-bullying programming would benefit from consistent reporting of treatment fidelity for program implementation. Specifically, information about intervention program delivery and alignment to the prescribed program dosing frequency and magnitude should be reported.

Methodological Challenges

Inconsistencies in systematic program evaluation challenges the field of school health, especially with anti-bullying programming.9,28 As a field, developing a common definition of bullying between researchers is a challenge, and is linked to issues in measuring bullying behavior. As evidenced in the Descriptive Tables, several curriculum-based, school-wide delivery strategies have been reported as effective. Yet, differences in the measurement of bullying challenges our ability to compare program effectiveness across prevention and intervention programs. Moreover, bullying awareness has developed misperceptions about its definition. Clear classifications of antisocial-aggressive behaviors have been established by past research and rather than listing bullying as the targeted behavior to be addressed by the intervention, we would recommend a specific listing of aggressive behaviors the intervention intends to modify. By reporting specific types of aggression in program evaluations, the results are focused on measurable behaviors. Future school health researchers will then be able to execute an investigation that builds on previous science to assist in constructing national, longitudinal trends of physical and verbal aggression in elementary schools.

Two types of indirect/covert aggression mentioned in the bullying literature are reputational aggression and psychological or social aggression.3,12 Relational aggression is the only documented form of bullying/victimization that may be classified as either direct/overt or indirect/covert depending on the perpetrator’s intent and involves manipulating relationships.10,12 Although indirect/covert forms of aggression are rare in elementary schools, program evaluations in our review have attempted to measure relational aggression. It is unclear how researchers were operationalizing the definition of relational aggression; however, it is clear that relational aggression was considered by the researchers to be a form of direct/overt aggression. Acknowledging that relational aggression can be considered either a direct or an indirect form of aggression, future school health researchers will need to define how the term is being operationalized for the purposes of each investigation. Additionally, since indirect/covert forms of relational aggression are difficult to measure as they can go unseen by adults, uniform training for observers should be implemented and paired with student self-reports.

Empirical evaluations of anti-bullying programming need to include a long-term implementation and delivery system for effectiveness. A common component of bullying prevention programs is to increase participants’ awareness of bullying and recognize bullying behaviors.5,9 Evaluations including an immediate posttest appeared to be less effective at reducing bullying behaviors as compared to evaluations with a single follow-up posttests. This may initially be reported as an increase in rates of bullying at an initial posttest resulting in evaluations suggesting a program to be less effective. Programs utilizing a longitudinal design, allowing for multiple follow-up posttests, have shown significant decreases in targeted behaviors including physical and relational aggression.14,30–33 Multiple follow-up posttests to evaluate program effectiveness are recommended.

A randomized control trial (RCT) design is considered the gold standard for evaluating program effectiveness, and is ideal for school health researchers.28 Yet, there are many challenges with attempting to conduct a RCT evaluate an anti-bullying program’s effectiveness in a school setting. Specifically, evaluation of school-based interventions present “… unique analytic and design considerations compared to clinical trials that randomize individuals to condition.”28(p. 279) Two concerns with the randomized control trials in this review include: (1) vague discussion of analytic model; and (2) insufficient power to detect intervention effects.34 Studies that do not address the clustered nature of the data encounter problems with statistical inference, incorrect degrees of freedom, and biased standard errors. Program effectiveness research designs, which account for clustering the population, provide results that are most generalizable and may help guide future researchers corroborate past findings. A way to counteract the challenges with designing an RCT within a school building would be to focus on strict guidelines for dosing (total amount of intervention received) and high treatment fidelity with implementing anti-bullying programming.

Self-report surveys are a common method of data-collection.15,22,28 Whereas this is a common and important method of collecting information on student bullying behaviors, there has been insufficient attention to the reliability and validity of these self-report measures.36 Student self-report surveys are dependent on the student’s memory for events and ability to understand survey questions. Yet, with elementary school children, student and teacher reports sometimes do not capture observed bullying behavior.26 We would recommend involving 3 mechanisms for measurement: (1) student self-reports; (2) teacher reports; and (3) direct observation. The PEGS program shows much promise in reducing bullying behaviors as it was a targeted program and did not rely on self-reports alone from children to identify chronic bullies.35

Standardized Reporting Procedures

Deficiencies in specification of intervention components, evaluation design (eg, statistical power, unit of randomization), statistical analyses (eg, multi-level vs. single level), program implementation monitoring, choice and measurement of outcomes (eg bullying behaviors, attitudes, and school climate) or selection of informants have contributed to limitations in rigorous evaluation within the field of bullying research. Throughout the review, there are inconsistencies with reporting information collected from the evaluations. Understanding that submission guidelines may be a limitation, procedures for reporting sample description, study design, and analytic method need to be standardized by editorial review committees. Unit of randomization,24 geographic region,23,35 targeted behavior,35 or demographic information should be noted as part of the study description. The US is not a homogeneous society and details in sample description should be rigorous. Historically, cultures change in time. As time goes on and researchers begin to more accurately capture their sample, stakeholders in school health and bullying prevention will be able to connect the historical findings of evaluations to their current population in need of an anti-bullying intervention.

Conclusions

Little is still known about bullying/victimization in schools. Although other continents have shown progress with isolating and eradicating bullying behaviors,2 transferring those same intervention programs to North America has not shown as promising of outcomes. Additionally, there has been a lack of systematically reviewed evaluation programs, which has provided stakeholders with limited resources for making decisions.

Virtually all of the evaluations of interventions dosed to elementary schools in this review were universal programs. One purpose of universal programs is to deliver an intervention school-wide, throughout the same grade, or classroom-level. Typically, our review revealed that school climate is a centering tenet of universal programs. The PEGS program, which was the only [student] targeted program in the review, showed much promise with the effectiveness of the intervention.35 The purpose of this program was not to change school climate, rather to target those individuals demonstrating varied levels of bullying behavior. Yet, the long-term effects of the PEGS program have not been reported. Universal programs are effective at creating a culture of allies to victims of bullying and we believe should be combined with a targeted program, such as the PEGS program to maximize effectiveness. We encourage school health administrators and researchers to consider targeted intervention programs for use within schools.

Much research has been focused on bullying behaviors in secondary school and most studies agree that bullying behavior reaches the apex in grades 7 and 8.37 Although little is still known about bullying in elementary schools, there is a strong body of research to support that intervening at this stage of development will diffuse the advent of bully behavior, types of aggression, and/or peer victimization. In the past 20 years, researchers have made progress in the area of school bullying research. A way to advance future bullying research in elementary schools is supporting program evaluations.

IMPLICATIONS FOR SCHOOL HEALTH

Bullying behavior is a public health concern for youth and by extension, a concern for school health researchers. Our review showed evidence that effective bullying prevention programs include intervention components that target individual, peer, family, school, and community. Corroborating our review22,23,26 empirical evidence identifies a need to include individual, peer, family, school, and community efforts in anti-bullying initiatives to influence reductions in bullying behavior.9 After examining these evaluations, the intervention and prevention of bullying in elementary schools may be best achieved by delivering the program to one or more of these influences (ie individual, peer, family, school, and community).

School officials and health researchers must collaborate to design and curate programming to address multiple ecological influences. Although the realities of schools’ social, political, and economic status vary greatly between schools, we recommend that school health researchers continue to research anti-bullying programming. Specifically, researchers should identify and evaluate programs that pair a universal school-wide program with an individual component for chronic perpetrators and/or victims. If programs are not readily available, one option is to combine 2 programs through a randomized clinical trial to see the impact of schools with only a universal school-wide program when compared to schools with both the universal program and individual component. Incorporating a peer nomination instrument when dosing a questionnaire to the school population, which identifies chronic perpetrators and victims, will be able to determine youth who need additional education and support.

The programs identified within our review seem to be the most effective at decreasing bullying behavior, physical, verbal, or relational aggression, and/or peer victimization. Programming modules that appear within these empirical evaluations include: teacher professional development and support for high fidelity program implementation; school-wide anti-bullying policy writing; curriculum-based lessons for classroom or school-wide delivery; and individual intervention strategies partnered with family and community education components. Thus, school health researchers designing prevention science should incorporate multiple targeted delivery points for dosing an anti-bullying program. We suggest including curriculum-based lessons for classroom or school-wide delivery and individual intervention strategies partnered with family and community education components and theorize this combination will result in a significant reduction in bullying behavior.

We encourage building- and district-level school health personnel to structure intervention programs for successful implementation. The importance of building support for teachers and staff implementing anti-bullying program has proven to be a promising practice of intervention program implementation. This support comprises: additional time for teacher preparation of curriculum-based lessons; dedicated meetings on improving school climate; policy development; and creating a space for teachers and staff to consult an intervention specialist when needed. Strategies for creating support structures that may to implementation fidelity include:

  • large and small group teacher training for ensuring accurate dosing of curriculum-based lessons;

  • release time for teachers to meet and prepare lessons;

  • collaborative meetings between education and school health stakeholders to develop a vision for a school’s education climate;

  • focus group interviews with school and community stakeholders in developing school policies related to bullying prevention; and

  • hiring a school health researcher to consult during the school personnel training and implementation stage of the empirical evaluation.

In conclusion, we also recommend similar training of building support staff members for effective intervention programming. Staff members interact with youth and may benefit from training explicating the expectations for identifying and reporting bullying behaviors.

ACKNOWLEDGEMENTS

Dr. Stoddard is supported by a Mentored Scientist Career Development Award from the National Institute of Drug Abuse (K01DA034765).

Contributor Information

Jared R. Rawlings, School of Music, The University of Utah, Salt Lake City, UT 84112.

Sarah A. Stoddard, Department of Health Behavior and Health Education, School of Public Health, University of Michigan, 3726 SPH 1, 1415 Washington Heights, Ann Arbor, MI 48109.

REFERENCES

  • 1.Monks CP, Coyne I. Bullying in Different Contexts. Cambridge, UK: Cambridge University Press; 2011. [Google Scholar]
  • 2.Smith PK, Cowie H, Olafsson RF, Liefooghe APD. Definitions of bullying: a comparison of terms used, and age and gender differences, in a fourteen-country international comparison. Child Dev 2002;73:1119–1133. [DOI] [PubMed] [Google Scholar]
  • 3.Swearer SM, Espelage DL, Napolitano SA. Bullying Prevention & Intervention: Realistic Strategies for Schools. New York, NY: Guliford Press, 2009. [Google Scholar]
  • 4.Hamburger ME, Basile KC, Vivolo AM. Measuring Bullying, Victimization, Perpetration, and Bystander Experiences: A Compendium of Assessment Tools. Atlanta, GA: Centers for Disease Control and Prevention; 2011. [Google Scholar]
  • 5.Mishna F Bullying: A Guide to Research, Intervention, and Prevention. New York, NY: Oxford University Press; 2012. [Google Scholar]
  • 6.Gladden RM, Vivolo-Kantor AM, Hamburger ME, Lumpkin CD. Bullying Surveillance among Youths: Uniform Definitions for Public Health and Recommended Data Elements, Version 1.0. Atlanta, GA: US Centers for Disease Control and Prevention; 2013. [Google Scholar]
  • 7.Espelage DL, Swearer SM. Research on school bullying and victimization: what have we learned and where do we go from here? In Swearer SM and Espelage DL, ed. Bullying Prevention and Intervention: Integrating Research and Evaluation Findings. Vol 32 3rd ed. Special Issue. School Psych Rev; 2003:365–383. [Google Scholar]
  • 8.Espelage DL, Horne A. School violence and bullying prevention: from research-based explanations to empirically based solutions In Brown S, Lent R, eds. Handbook of Counseling Psychology. 4th ed. Hoboken, NJ: Wiley; 2007:588–606. [Google Scholar]
  • 9.Swearer SM, Espelage DL, Vaillancourt T, Hymel S. What can be done about school bullying?: linking research to educational practice. Educ Res 2010;39:38–47.. [Google Scholar]
  • 10.Crick NR, Grotpeter JK. Relational aggression, gender, and social-psychological adjustment. Child Dev 1995;66:710. [DOI] [PubMed] [Google Scholar]
  • 11.Currie DH, Kelly DM, Pomerantz S. ‘The power to squash people’: understanding girls’ relational aggression. Br J Sociol Educ 2007;28:23–37. [Google Scholar]
  • 12.Owens L, Shute R, Slee P. Guess what I just heard!?: indirect aggression among teenage girls in Australia. Aggress Behav 2000;26:67–83. [Google Scholar]
  • 13.Craig W, Pepler D, Blais J. Responding to bullying: what works? Sch Psychol Int 2007;28:465–477. [Google Scholar]
  • 14.Giesbrecht GF, Leadbeater BJ, Macdonald SWS. Child and context characteristics in trajectories of physical and relational victimization among early elementary school children. Dev Psychopathol 2011;23:239–252. [DOI] [PubMed] [Google Scholar]
  • 15.Hallford A, Borntrager C, Davis JL. Evaluation of a bullying prevention program. J Res Child Educ 2006;21:91–101. [Google Scholar]
  • 16.Ttofi MM, Farrington DP. Risk and protective factors, longitudinal research, and bullying prevention. New Dir Youth Dev 2012;133:85–98. [DOI] [PubMed] [Google Scholar]
  • 17.Cook CR, Williams KR, Guerra NG, Kim TE, Sadek S. Predictors of bullying and victimization in childhood and adolescence: a meta-analytic investigation. Sch Psychol Q 2010;25:65–83. [Google Scholar]
  • 18.Merrell KW, Gueldner BA, Ross SW, Isava DM. How effective are school bullying intervention programs? a meta-analysis of intervention research. Sch Psychol Q 2008;23:26–42. [Google Scholar]
  • 19.Vreeman RC, Carroll AE. A systematic review of school-based interventions to prevent bullying. Arch Pediatr Adolesc Med 2007;161:78. [DOI] [PubMed] [Google Scholar]
  • 20.Samples FL. Evaluating curriculum-based intervention programs: an examination of preschool, primary, and elementary school intervention programs In Sanders CE, Phye GD, eds. Bullying: Implications for the Classroom. San Diego, CA: Elsevier Academic Press; 2004:203–227. [Google Scholar]
  • 21.Toner BK. The implementation of the bully prevention program: Bully Proofing Your School and its effect on bullying and school climate on sixth grade suburban students. 2010. [Google Scholar]
  • 22.Finn KOK. An evaluation of the Olweus Bullying Prevention Program. 2008. [Google Scholar]
  • 23.Meraviglia MG, Becker H, Rosenbluth B, Sanchez E, Robertson T. The Expect Respect Project: creating a positive elementary school climate. J Interpers Violence. 2003;18:1347–1360. [DOI] [PubMed] [Google Scholar]
  • 24.Twemlow SW, Biggs BK, Nelson TD, Vernberg EM, Fonagy P, Twemlow SW. Effects of participation in a martial arts-based antibullying program in elementary schools. Psychol Sch 2008;45(10):947–959. [Google Scholar]
  • 25.Li K-K, Washburn I, DuBois DL, et al. Effects of the positive action programme on problem behaviours in elementary school students: a matched-pair randomised control trial in Chicago. Psychol Health. 2011;26:187–204. [DOI] [PubMed] [Google Scholar]
  • 26.Frey KS, Hirschstein MK, Edstrom LV, Snell JL. Observed reductions in school bullying, nonbullying aggression, and destructive bystander behavior: a longitudinal evaluation. J Educ Psychol 2009;101:466–481. [Google Scholar]
  • 27.Low S, Frey K, Brockman C. Gossip on the playground: changes associated with universal intervention, retaliation beliefs, and supportive friends. School Psych Rev 2010;39:536–551. [Google Scholar]
  • 28.Low S, Smith B, Brown E, Fernandez F, Hanson K, Taggerty K. Design and analysis of a randomized control trial of steps to respect In: Espelage D, Swearer S, eds. Bullying in North American Schools. 2nd ed. New York, NY: Routledge; 2011:278–290. [Google Scholar]
  • 29.Jenson JM, Dieterich WA. Effects of a skills-based prevention program on bullying and bully victimization among elementary school children. Prev Sci 2007;8:285–296. [DOI] [PubMed] [Google Scholar]
  • 30.Hoglund W, Hosan N, Leadbeater B. Using your WITS: a 6-year follow-up of a peer victimization prevention program. School Psych Rev 2012;41:193–214. [Google Scholar]
  • 31.Leadbeater B, Hoglund W, Woods T. Changing contexts? the effects of a primary prevention program on classroom levels of peer relational and physical victimization. J Community Psychol 2003;31:397–418. [Google Scholar]
  • 32.Leadbeater B, Sukhawathanakul P. Multicomponent programs for reducing peer victimization in early elementary school: a longitudinal evaluation of the WITS primary program. J Community Psychol 2011;39:606–620. [Google Scholar]
  • 33.Wood T, Coyle K, Hoglund W, Leadbeater B. Changing the contexts of peer victimization: The effects of an elementary school prevention program on classroom levels of peer victimization In Elias M, Zins J, Maher C, eds. Handbook of Prevention and Intervention in Peer Harassment, Victimization, and Bullying. New York, NY: Hawthorn Press; 2011. [Google Scholar]
  • 34.Browning C Increasing elementary teachers’ awareness and skill acquisition related to the bully/peer abuse problem: Is “Bully Busters” in-service training effective? [Unpublished doctoral dissertation]. Oxford, MI: University of Mississippi; 2004. [Google Scholar]
  • 35.Newgent RA, Behrend BA, Lounsbery KL, Higgins KK, Lo W. Psychosocial educational groups for students (PEGS): an evaluation of the treatment effectiveness of a school-based behavioral intervention program. Counseling Outcome Research and Evaluation. 2010;1:80–94. [Google Scholar]
  • 36.Griffin RS, Gross AM. Childhood bullying: Current empirical findings and future directions for research. Aggress Violent Behav 2004;9:379–400. [Google Scholar]
  • 37.Espelage DL, Basile KC, Hamburger ME. Bullying perpetration and subsequent sexual violence perpetration among middle school students. J Adolesc Health. 2012;50:60–65. [DOI] [PubMed] [Google Scholar]

RESOURCES