Treatment integrity is a core component of data-based decision making (Detrich, 2013). The usual approach is to consider student data when making decisions about an intervention; however, if there are no data about how well the intervention was implemented, then meaningful judgments cannot be made about effectiveness.
This special issue of Strategies is devoted to highlighting this knowledge base and corresponding practices. In this issue you will find an in-depth case study of a school district engaged in systemic improvement, using the principles and practices of what Dr. Jackson calls the Pedagogy of Confidence®.
Destination: Equity. (2015). Strategies, 17(1) . Retrieved from https://www.aasa.org/uploadedFiles/Resources/Other_Resources/STRATEGIES-SEPT-15-FINAL.pdf
This book is compiled from the proceedings of the sixth summit entitled “Performance Feedback: Using Data to Improve Educator Performance.” The 2011 summit topic was selected to help answer the following question: What basic practice has the potential for the greatest impact on changing the behavior of students, teachers, and school administrative personnel?
States, J., Keyworth, R. & Detrich, R. (2013). Introduction: Proceedings from the Wing Institute’s Sixth Annual Summit on Evidence-Based Education: Performance Feedback: Using Data to Improve Educator Performance. In Education at the Crossroads: The State of Teacher Preparation (Vol. 3, pp. ix-xii). Oakland, CA: The Wing Institute.
This article describes a school district administrator's research on optimal coaching experiences for classroom teachers. This research was done with the intent of gaining a better understanding of how coaching affects student learning.
Akhavan, N. (2015). Coaching side by side: One-on-one collaboration creates caring, connected
teachers. Journal of Staff Development, 36,34-37.
This chapter describes a process, collaborative problem solving, that can guide decision making and intervention planning for improving academic and behavior outcomes for students. The primary focus is on the two basic components of the term collaborative problem solving.
Allen, S. J., & Graden, J. L. (2002). Best Practices in Collaborative Problem Solving for Intervention Design.
This literature review aims to provide district leaders with an understanding of the research and best evidence regarding the components of effective principal talent management systems.
American Institutes for Research & George W. Bush Institute’s. (2016). Principal Talent Management According to the Evidence: A Review of the Literature. Retrieved from http://gwbcenter.imgix.net/Resources/gwbi-principal-talent-management-lit-review.pdf
The purposes of this article are to describe (a) the context in which PBS and FBA are needed and (b) definitions and features of PBS and FBA.
applying positive behavior support
This study evaluated the effects of performance feedback to increase the implementation of skills taught during in-service training.
Auld, R. G., Belfiore, P. J., & Scheeler, M. C. (2010). Increasing Pre-service Teachers’ Use of Differential Reinforcement: Effects of Performance Feedback on Consequences for Student Behavior. Journal of Behavioral Education, 19(2), 169-183.
This article explores factors influencing the sustained use of Peer Assisted Learning Strategies (PALS) in math in one elementary school.
Baker, S., Gersten, R., Dimino, J. A., & Griffiths, R. (2004). The sustained use of research-based instructional practice: A case study of peer-assisted learning strategies in mathematics. Remedial and Special Education, 25(1), 5-24.
This study evaulates the effects of performance feedback as part of proffessional development across three studies.
Barton, E. E., Pribble, L., & Chen, C.-I. (2013). The Use of E-Mail to Deliver Performance-Based Feedback to Early Childhood Practitioners. Journal of Early Intervention, 35(3), 270-297.
The purpose of this research was to examine the effect of teaching of learning strategies on academic achievement of students. The meta-analysis model was adopted to examine the effectiveness of teaching of learning strategies on academic achievement. According to moderator analyses, it was found that there was no significant difference between effect sizes of the studies in terms of sample size, publication type, course type, implementation duration, instructional level, school setting, and socioeconomic status
Bas, G., & Beyhan, Ö. (2019). Revisiting the Effect of Teaching of Learning Strategies on Academic Achievement: A Meta-Analysis of the Findings. International Journal of Research in Education and Science, 5(1), 70-87.
The purpose of this study was to examine the effects of an early intervention strategy, First Step to Success, involving (a) teacher-directed and (b) a combination of teacher- and parent-directed strategies on the behaviors of elementary school children at risk for antisocial behavior.
Beard, K. Y., & Sugai, G. (2004). First Step to Success: An early intervention for elementary children at risk for antisocial behavior. Behavioral Disorders, 29(4), 396-409.
The book presents many examples of Questioning the Author (QtA) in action as children engage with narrative and expository texts to construct meaning.
Beck, I. L., & McKeown, M. G., Hamilton, R. L., & Kugan, L. (1997). Questioning the Author: An approach for enhancing student engagement with text.Newark, DE: International Reading Association.
This book delivers teaching practice highlights and some strategies introduced in schools to give educators, evaluators, and researchers comprehensive evidence found on the best instructional strategies schools could use to improve student outcomes significantly.
Bennett, B., Rolheiser, C., & Normore, A. H. (2003). Beyond monet: The artful science of instructional integration. Alberta Journal of Educational Research, 49(4), 383.
One of the primary goals of implementation science is to insure that programs are implemented with integrity. This paper presents an integrated model of implementation that emphasizes treatment integrity.
Berkel, C., Mauricio, A. M., Schoenfelder, E., Sandler, I. N., & Collier-Meek, M. (2011). Putting the pieces together: An Integrated Model of program implementation. Prevention Science, 12, 23-33.
This paper discuss ClasWide Peer Tutoring as an effective strategy for Student with Emotional and Behavioral Disorder
Bowman-Perrott, L. (2009). Classwide peer tutoring: An effective strategy for students with emotional and behavioral disorders. Intervention in School and Clinic, 44(5), 259-267.
This book provides practitioners with a complete guide to implementing response to intervention (RTI) in schools.
Brown-Chidsey, R., & Steege, M. W. (2011). Response to intervention: Principles and strategies for effective practice. Guilford Press.
This book provides practitioners with a complete guide to implementing response to intervention (RTI) in schools.
Brown-Chidsey, R., & Steege, M. W. (2011). Response to intervention: Principles and strategies for effective practice. Guilford Press.
This study examines the importance of implementation integrity for problem-solving teams (PST) and response-to-intervention models.
Burns, M. K., Peters, R., & Noell, G. H. (2008). Using performance feedback to enhance implementation fidelity of the problem-solving team process. Journal of School Psychology, 46(5), 537-550.
This review assesses the effectiveness of school-based curricula, finance, management, and teacher’s decision-making. This report has implications for the impact of charter schools, as the primary intervention in this model is local control. The report finds limited evidence of the effectiveness of these reforms, especially from low-income countries.
Carr-Hill, R., Rolleston, C., Pherali, T., & Schendel, R. (2014). The effects of school-based decision making on educational outcomes in low-and middle-income contexts: A systematic review.
Incidental teaching is often a component of early childhood intervention programs. This study evaluated the use of grahical feedback to increase the use of incidental teaching.
Casey, A. M., & McWilliam, R. A. (2008). Graphical Feedback to Increase Teachers’ Use of Incidental Teaching. Journal of Early Intervention, 30(3), 251-268.
One of the challenges for increasing treatment integrity is finding effective methods for doing so. This study evaluated the use of checklist-based training to increase treatment integrity.
Casey, A. M., & McWilliam, R. A. (2011). The impact of checklist-based training on teachers’ use of the zone defense schedule. Journal of Applied Behavior Analysis, 44(2), 397-401.
The report provides recommendations and strategies for managing chronic absenteeism at all levels of education leadership, from state agencies through individual schools. It also has an interactive web site where the reader can drill down on specific data at all levels of the education system. www.attendanceworks.org
Chang, Hedy N., Bauer, Lauren and Vaughan Byrnes, Data Matters: Using Chronic Absence to Accelerate Action for Student Success, Attendance Works and Everyone Graduates Center, September 2018.
This study evaluated the impact of performance feedback on how well problem-solving teams implemeted a structured decision-making protocal. Teams performed better when feedback was provided.
Codding, R. S., & Smyth, C. A. (2008). Using Performance Feedback To Decrease Classroom Transition Time And Examine Collateral Effects On Academic Engagement. Journal of Educational & Psychological Consultation, 18(4), 325-345.
This study investigated the effects of performance feedback to increase treatment integrity.
Codding, R. S., Feinberg, A. B., & Dunn, E. K. (2005). Effects of Immediate Performance Feedback on Implementation of Behavior Support Plans. Journal of Applied Behavior Analysis, 38(2), 205-219.
This study evaluated the effects of performance feedback in increasing treatment integrity. It also evaluated the possible reactivitiy effects of being observed.
Codding, R. S., Livanis, A., Pace, G. M., & Vaca, L. (2008). Using Performance Feedback to Improve Treatment Integrity of Classwide Behavior Plans: An Investigation of Observer Reactivity. Journal of Applied Behavior Analysis, 41(3), 417-422.
This study examines obstacles encountered by 33 educators along with suggested interventions to overcome impediments to effective delivery of classroom management interventions or behavior support plans. Having the right classroom management plan isn’t enough if you can’t deliver the strategies to the students in the classroom.
Collier‐Meek, M. A., Sanetti, L. M., & Boyle, A. M. (2019). Barriers to implementing classroom management and behavior support plans: An exploratory investigation. Psychology in the Schools, 56(1), 5-17.
This study evaluated the effects of video modeling on staff implementation of a problem solving intervention.
Collins, S., Higbee, T. S., & Salzberg, C. L. (2009). The effects of video modeling on staff implementation of a problem-solving intervention with adults with developmental disabilities. Journal of applied behavior analysis, 42(4), 849-854.
This study evaluated the effects of allowing teachers to “test drive” interventions and then select the intervention they most preferred. The result was an increase in treatment integrity.
Dart, E. H., Cook, C. R., Collins, T. A., Gresham, F. M., & Chenier, J. S. (2012). Test Driving Interventions to Increase Treatment Integrity and Student Outcomes. School Psychology Review, 41(4), 467-481.
To produce better outcomes for students two things are necessary: (1) effective, scientifically supported interventions (2) those interventions implemented with high integrity. Typically, much greater attention has been given to identifying effective practices. This review focuses on features of high quality implementation.
Detrich, R. (2014). Treatment integrity: Fundamental to education reform. Journal of Cognitive Education and Psychology, 13(2), 258-271.
Reform efforts tend to come and go very quickly in education. This paper makes the argument that the sustainability of programs is closely related to how well those programs are implemented.
Detrich, R., Keyworth, R. & States, J. (2010). Treatment Integrity: A Fundamental Unit of Sustainable Educational Programs. Journal of Evidence-Based Practices for Schools, 11(1), 4-29.
The usual approach to determining if an intervention is effective for a student is to review student outcome data; however, this is only part of the task. Student data can only be understood if we know something about how well the intervention was implemented. Student data without treatment integrity data are largely meaningless because without knowing how well an intervention has been implemented, no judgments can be made about the effectiveness of the intervention. Poor outcomes can be a function of an ineffective intervention or poor implementation of the intervention. Without treatment integrity data, there is a risk that an intervention will be judged as ineffective when, in fact, the quality of implementation was so inadequate that it would be unreasonable to expect positive outcomes.
Detrich, R., States, J. & Keyworth, R. (2017). Treatment Integrity in the Problem Solving Process. Oakland, Ca. The Wing Institute.
This study comared the effects of goal setting about student performance and feedback about student performance with daily written feedback about student performance, feedback about accuracy of implementation, and cancelling meetings if integrity criterion was met.
DiGennaro, F. D., Martens, B. K., & Kleinmann, A. E. (2007). A comparison of performance feedback procedures on teachers' treatment implementation integrity and students' inappropriate behavior in special education classrooms. Journal of Applied Behavior Analysis, 40(3), 447-461.
This study evaluated the impact of allowing teachers to miss coaching meetings if their treatment integrity scores met or exceeded criterion.
DiGennaro, F. D., Martens, B. K., & McIntyre, L. L. (2005). Increasing Treatment Integrity Through Negative Reinforcement: Effects on Teacher and Student Behavior. School Psychology Review, 34(2), 220-231.
This study evaluated the effects of video modeling on how well teachers implemented interventions. There was an increase in integrity but it remained variable. More stable patterns of implementation were observed when teachers were given feedback about their peroformance.
Digennaro-Reed, F. D., Codding, R., Catania, C. N., & Maguire, H. (2010). Effects of video modeling on treatment integrity of behavioral interventions. Journal of Applied Behavior Analysis, 43(2), 291-295.
This study evaluated the impact of public feedback in RtI team meetings on the quality of implementation. Feedback improved poor implementation and maintained high level implementation.
Duhon, G. J., Mesmer, E. M., Gregerson, L., & Witt, J. C. (2009). Effects of public feedback during RTI team meetings on teacher implementation integrity and student academic performance. Journal of School Psychology, 47(1), 19-37.
The authors conducted a study of teachers' perceptions of the potential costs and benefits of involvement in school decision making. The teachers interviewed rated the potential costs of decision making involvement as low and the potential benefits as high. Nevertheless, many were hesitant to become involved because they saw little possibility that their involvement would actually make a difference.
Duke, D. L., Showers, B. K., & Imber, M. (1980). Teachers and shared decision making: The costs and benefits of involvement. Educational Administration Quarterly, 16(1), 93-106.
This book presents a wide variety of exemplary programs addressing behavioral and social problems, school failure, drug use, injuries, child abuse, physical health, and other critical issues.
Durlak, J. A. (1997). Successful prevention programs for children and adolescents. Springer Science & Business Media.
This section includes tools and resources that can help school leaders, teachers, and other stakeholders be more strategic in their decision-making about planning, implementing, and evaluating evidence-based interventions to improve the conditions for learning and facilitate positive student outcomes.
Elliott, S. N., Witt, J. C., & Kratochwill, T. R. (1991). Selecting, implementing, and evaluating classroom interventions. Interventions for achievement and behavior problems, 99-135.
The purpose of this article is to present a conceptual framework for advancing mental health science and practice for vulnerable children that is in accord with the Surgeon General’s priorities for change.
Fantuzzo, J., McWayne, C., & Bulotsky, R. (2003). Forging strategic partnerships to advance mental health science and practice for vulnerable children. School Psychology Review, 32(1), 17-37.
This is a comprehensive literature review of the topic of Implementation examining all stages beginning with adoption and ending with sustainability.
Fixsen, D. L., Naoom, S. F., Blase, K. A., & Friedman, R. M. (2005). Implementation research: A synthesis of the literature.
This paper describes the scaling up and dissemination of a partent training program in Norway while maintaining fidelity of implementation.
Forgatch, M. S., & DeGarmo, D. S. (2011). Sustaining fidelity following the nationwide PMTO implementation in Norway. Prevention Science, 12(3), 235-246. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3153633
The authors assessed the contribution of self-regulated learning strategies (SRL), when combined with problem-solving transfer instruction (L. S. Fuchs et al., 2003), on 3rd-graders' mathematical problem solving. SRL incorporated goal setting and self-evaluation.
Fuchs, L. S., Fuchs, D., Prentice, K., Burch, M., Hamlett, C. L., Owen, R., & Schroeter, K. (2003). Enhancing third-grade student'mathematical problem solving with self-regulated learning strategies. Journal of educational psychology, 95(2), 306.
Garbacz, L., Brown, D., Spee, G., Polo, A., & Budd, K. (2014). Establishing Treatment Fidelity in Evidence-Based Parent Training Programs for Externalizing Disorders in Children and Adolescents. Clinical Child & Family Psychology Review, 17(3).
This article aimed to present frameworks and practices coaches can use with classroom teachers to facilitate the implementation of evidence-based interventions in schools.
Garbacz, S. A., Lannie, A. L., Jeffrey-Pearsall, J. L., & Truckenmiller, A. J. (2015). Strategies for effective classroom coaching. Preventing School Failure: Alternative Education for Children and Youth, 59(4), 263-273.
This book was written to disseminate measurably superior instructional strategies to those
interested in advancing sound, pedagogically effective, field-tested educational practices
Gardner III, R. E., Sainato, D. M., Cooper, J. O., Heron, T. E., Heward, W. L., Eshleman, J. W., & Grossi, T. A. (1994). Behavior analysis in education: Focus on measurably superior instruction. In The chapters in this volume are revised from papers presented at the conference" Behavior Analysis in Education: Focus on Measurably Superior Instruction," sponsored by the Faculty in Applied Behavior Analysis, Ohio State U, Sep 1992.. Thomson Brooks/Cole Publishing Co.
To help states and districts make informed decisions about the PD they implement to improve reading instruction, the U.S. Department of Education commissioned the Early Reading PD Interventions Study to examine the impact of two research-based PD interventions for reading instruction: (1) a content-focused teacher institute series that began in the summer and continued through much of the school year (treatment A) and (2) the same institute series plus in-school coaching (treatment B).
Garet, M. S., Cronen, S., Eaton, M., Kurki, A., Ludwig, M., Jones, W., ... Zhu, P. (2008). The impact of two professional development interventions on early reading instruction and achievement. NCEE 2008-4030. Washington, DC: National Center for Education Evaluation and Regional Assistance.
The Rand Corporation just released its report evaluating the impact of the Principal Pipeline Initiative (PPI),a project supported by the Wallace Foundation to create and implement a strategic process for school leadership talent management. This report documents what the PPI districts were able to accomplish, describing the implementation of the PPI and its effects on student achievement, other school outcomes, and principal retention.
Gates, Susan M., Matthew D. Baird, Benjamin K. Master, and Emilio R. Chavez-Herrerias, Principal Pipelines: A Feasible, Affordable, and Effective Way for Districts to Improve Schools, Santa Monica, Calif.: RAND Corporation, RR-2666-WF, 2019.
This study examined general education teachers’ implementation of a peer tutoring intervention for five elementary students referred for consultation and intervention due to academic concerns. Treatment integrity was assessed via permanent products produced by the intervention.
Gilbertson, D., Witt, J. C., Singletary, L. L., & VanDerHeyden, A. (2007). Supporting teacher use of interventions: Effects of response dependent performance feedback on teacher implementation of a math intervention. Journal of Behavioral Education, 16(4), 311-326.
This paper provides students with an opportunity to improve their reading comprehension and text-based discussion skills. The activity, which can be used with intermediate and advanced learners, is ideal for English language learners in content classes and is particularly useful for building foundational knowledge of a new topic.
Giovacchini, M. (2017). Timed Partner Reading and Text Discussion. In English Teaching Forum (Vol. 55, No. 1, pp. 36-39). US Department of State. Bureau of Educational and Cultural Affairs, Office of English Language Programs, SA-5, 2200 C Street NW 4th Floor, Washington, DC 20037.
In this article, we examine assessment and accountability in the context of a prevention-oriented assessment and intervention system designed to assess early reading progress formatively.
Good III, R. H., Simmons, D. C., & Kame'enui, E. J. (2001). The importance and decision-making utility of a continuum of fluency-based indicators of foundational reading skills for third-grade high-stakes outcomes. Scientific studies of reading, 5(3), 257-288.
Organizations house many individuals. Many of them are responsible implementing the same practice. If organizations are to meet their goal it is important for the organization have systems for assuring high levels of treatment integrity.
Gottfredson, D. C. (1993). Strategies for Improving Treatment Integrity in Organizational Consultation. Journal of Educational & Psychological Consultation, 4(3), 275.
In this review, the authors identify and describe 34 universal and targeted interventions that have demonstrated positive outcomes under rigorous evaluation.
Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (2001). The prevention of mental disorders in school-aged children: Current state of the field. Prevention & treatment, 4(1), 1a.
Describes the effects of internal school staff providing feedback to teachers as a means of increasing treatment integrity. It was necessary to have someone provide feedback to internal staff about how well they implemented the plan to provide feedback to teachers. Makes the case that treatment integrity is requires multi-tier systems of support if interventions are to be implemented effectively.
Hagermoser, S., Lisa M., Fallon, L. M., & Collier-Meek, M. A. (2013). Increasing Teacher Treatment Integrity Through Performance Feedback Provided By School Personnel. Psychology in the Schools, 50(2), 134-150.
This study examines adoption and implementation of the US Department of Education's new policy, the `Principles of Effectiveness', from a diffusion of innovations theoretical framework. In this report, we evaluate adoption in relation to Principle 3: the requirement to select research-based programs.
Hallfors, D., & Godette, D. (2002). Will the “principles of effectiveness” improve prevention practice? Early findings from a diffusion study. Health Education Research, 17(4), 461–470.
The authors evaluated four methods for increasing the practicality of functional communication training (FCT) by decreasing the frequency of reinforcement for alternative behavior.
Hanley, G. P., Iwata, B. A., & Thompson, R. H. (2001). Reinforcement schedule thinning following treatment with functional communication training. Journal of Applied Behavior Analysis, 34(1), 17-38.
This paper will explain Round Tables, a practical, engaging alternative to the traditional classroom presentation. Round Tables are small groups of students, with each student given a specific speaking role to perform.
Harms, E., & Myers, C. (2013). Empowering students through speaking round tables. Language Education in Asia, 4(1), 39-59.
This article aimed to review the literature and examine and compare the effects of choral and individual responding. Results indicate a generally positive relationship between using choral responding versus individual responding on student variables such as active student responding, on-task behavior, and correct responses.
Haydon, T., Marsicano, R., & Scott, T. M. (2013). A comparison of choral and individual responding: A review of the literature. Preventing School Failure: Alternative Education for Children and Youth, 57(4), 181-188.
ASR [active student response] can be defined as an observable response made to an instructional antecedent / [compare ASR] to other measures of instructional time and student engagement / 3 benefits of increasing the frequency of ASR during instruction are discussed.
Heward, W. L. (1994). Three" low-tech" strategies for increasing the frequency of active student response during group instruction.
There are numerous practical strategies for increasing active student response during group instruction. One of these strategies, Choral Responding, is the subject of this article.
Heward, W. L., Courson, F. H., & Narayan, J. S. (1989). Using choral responding to increase active student response. Teaching Exceptional Children, 21(3), 72-75.
This article discusses the current focus on using teacher observation instruments as part of new teacher evaluation systems being considered and implemented by states and districts.
Hill, H., & Grossman, P. (2013). Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems. Harvard Educational Review, 83(2), 371-384.
Used a direct observation-based approach to identify behavioral conditions in sending (i.e., special education) and in receiving (i.e., regular education) classrooms and to identify targets for intervention that might facilitate mainstreaming of behavior-disordered (BD) children.
Hoier, T. S., McConnell, S., & Pallay, A. G. (1987). Observational assessment for planning and evaluating educational transitions: An initial analysis of template matching. Behavioral Assessment.
This study aimed to examine active instruction and engagement across elementary, middle, and high schools using a large database of direct classroom observations.
Hollo, A., & Hirn, R. G. (2015). Teacher and student behaviors in the contexts of grade-level and instructional grouping. Preventing School Failure: Alternative Education for Children and Youth, 59(1), 30-39.
The purposes of this manuscript are to propose core features that may apply to any practice or set of practices that proposes to be evidence-based in relation to School-wide Positive Behavior Support (SWPBS).
Horner, R. H., Sugai, G., & Anderson, C. M. (2010). Examining the evidence base for school-wide positive behavior support. Focus on Exceptional Children, 42(8), 1.
“Contextual fit” is based on the premise that the match between an intervention and local context affects both the quality of intervention implementation and whether the intervention actually produces the desired outcomes for children and families.
Horner, R., Blitz, C., & Ross, S. (2014). The importance of contextual fit when implementing evidence-based interventions. Washington, DC: U.S. Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation. https://aspe.hhs.gov/system/files/pdf/77066/ib_Contextual.pdf
Through several postsecondary surveys, NCES collects information about where and how the aid is distributed and whether it had an impact on student outcomes. This brochure describes the NCES postsecondary survey.
IPEDS presents NCES postsecondary survey. (2018). National Center for Education Statistic, 2017136. Retrieved from https://nces.ed.gov/pubs2017/2017136.pdf
This paper describes “how” to effectively implement lasting school improvement initiatives that maximize leadership, develop talent, amplify instructional transformation, and shift the culture.
Jackson, K., R., Fixsen, D., and Ward, C. (2018). Four Domains for Rapid School Improvement: An Implementation Framework. The Center on School Turnaround.
This piece describes the widely held perception among education leaders that we already know how to help teachers improve, and that we could achieve our goal of great teaching in far more classrooms if we just applied what we know more widely.
Jacob, A., & McGovern, K. (2015). The mirage: Confronting the hard truth about our quest for teacher development. Brooklyn, NY: TNTP. https://tntp.org/assets/documents/TNTP-Mirage_2015.pdf.
This study examines the impact of The Whole School Restorative Justice Program (WSRJ). WSRJ utilizes a multi-tiered strategy. Tier 1 is regular classroom circles, Tier 2 is repair harm/conflict circles, and Tier 3 includes mediation, family group conferencing, and welcome/re-entry circles to initiate successful re-integration of students being released from juvenile detention centers.The key findings of this report show decreased problem behavior, improved school climate, and improved student achievement.
Jain, S., Bassey, H., Brown, M. A., & Kalra, P. (2014). Restorative justice in Oakland schools. Implementation and impact: An effective strategy to reduce racially disproportionate discipline, suspensions, and improve academic outcomes. Retrieved from http://www.rjtica.org/wp-content/uploads/2015/04/OUSD-RJ-Report-full.pdf
This study examined the effects of performance feedback on treatment integrity.
Jones, K. M., Wickstrom, K. F., & Friman, P. C. (1997). The effects of observational feedback on treatment integrity in school-based behavioral consultation. School Psychology Quarterly, 12(4).
The authors proposed a preliminary FI theory (FIT) and tested it with moderator analyses. The central assumption of FIT is that FIs change the locus of attention among 3 general and hierarchically organized levels of control: task learning, task motivation, and meta-tasks (including self-related) processes.
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological bulletin, 119(2), 254.
This book examines the use of video recording to to improve teacher performance. The book shows how every classroom can easily benefit from setting up a camera and hitting “record”.
Knight, J. (2013). Focus on teaching: Using video for high-impact instruction. (Pages 8-14). Thousand Oaks, CA: Corwin.
The purpose of this article is to provide teachers with several suggestions for creating and using guided notes to enhance other effective teaching methods, support students’ studying, and promote higher order thinking.
Konrad, M., Joseph, L. M., & Itoi, M. (2011). Using guided notes to enhance instruction for all students. Intervention in school and clinic, 46(3), 131-140.
Dear Colleagues Letter: Resource Comparability is a letter written by United States Department of Education. This letter was meant to call people attention to disparities that persist in access to educational resources, and to help address those disparities and comply with the legal obligation to provide students with equal access to these resources without regard to race, color, or national origin (This letter addresses legal obligations under Title VI of the Civil Rights Act of 1964, Title VI). This letter builds on the prior work shared by the U.S. Department of Education on this critical topic.
Lhamon, C. E. (2014). Dear colleague letter: Resource comparability. Washington, DC: US Department of Education, Office for Civil Rights. Retrieved from http://www2. ed. gov/about/offices/list/ocr/letters/colleague-resourcecomp-201410. pdf.
Using a randomized control trial in 11 Chinese primary schools, we studied the effects of pay-for-grades programs on academic cheating. We randomly assigned 82 classrooms into treatment or control conditions, and used a statistical algorithm to determine the occurrence of cheating.
Li, T., & Zhou, Y. (2019). Do Pay-for-Grades Programs Encourage Student Academic Cheating? Evidence from a Randomized Experiment. Frontiers of Education in China, 14(1), 117-137.
This article elaborate on a topic "What to expect in Common Core immediate political future". Here, they discuss four key challenges that CCSS will face between now and the end of the year. Common Core is now several years into implementation. Supporters have had a difficult time persuading skeptics that any positive results have occurred. The best evidence has been mixed on that question. The political challenges that Common Core faces the remainder of this year may determine whether it survives.
Loveless, T. (2016). Common Core’s Major Political Challenges for the Remainder of 2016. Brookings Institute. Retrieved from https://www.brookings.edu/blog/brown-center-chalkboard/2016/03/30/common-cores-major-political-challenges-for-the-remainder-of-2016/
This study evaluated the effects of an intensive training progam for paraeducators responsible for implementing a group contingency intervention for classroom behavior.
Maggin, D. M., Fallon, L. M., Hagermoser, S., Lisa M., & Ruberto, L. M. (2012). Training Paraeducators to Implement a Group Contingency Protocol: Direct and Collateral Effects. Behavioral Disorders, 38(1), 18-37.
In this special issue, this Journal introduce a fourth peer teaching model, Classwide Student Tutoring Teams. This journal also provide a comprehensive analysis of common and divergent programmatic components across all four models and discuss the implications of this analysis for researchers and practitioners alike.
Maheady, L., Mallette, B., & Harper, G. F. (2006). Four classwide peer tutoring models: Similarities, differences, and implications for research and practice. Reading & Writing Quarterly, 22(1), 65-89.
The effects of a cloze procedure developed from transfer feature theory of processing in reading on immediate and delayed recall of good and poor readers were studied
Mcgee, L. M. (1981). Effects of the Cloze Procedure on Good and Poor Readers' Comprehension. Journal of Reading Behavior, 13(2), 145-156.
Should U.S. students be doing more math practice and drilling in their classrooms? That’s the suggestion from last week’s most emailed New York Times op-ed. The op-ed’s author argued that more practice and drilling could help narrow math achievement gaps. These gaps occur in the U.S. by the primary grades.
Morgan, P. L. (2018). Should U.S. students do more math practice and drilling? Psychology Today.Retrieved from https://www.psychologytoday.com/us/blog/children-who-struggle/201808/should-us-students-do-more-math-practice-and-drilling
This meta-analysis reports on the overall effectiveness of video analysis when used with special educators, as well as on moderator analyses related to participant and instructional characteristics.
Morin, K. L., Ganz, J. B., Vannest, K. J., Haas, A. N., Nagro, S. A., Peltier, C. J., … & Ura, S. K. (2019). A systematic review of single-case research on video analysis as professional development for special educators. The Journal of Special Education, 53(1), 3-14.
This study evaluated the effects of performance feedback on the implementation of a classroom intervention.
Mortenson, B. P., & Witt, J. C. (1998). The use of weekly performance feedback to increase teacher implementation of a prereferral academic intervention. School Psychology Review, 613-627.
This study compared the effects of discussing issues of implementation challenges and performance feedback on increasing the integrity of implementation. Performance feedback was more effective than discussion in increasing integrity.
Noell, G. H., & Witt, J. C. (2000). Increasing intervention implementation in general education following consultation: A comparison of two follow-up strategies. Journal of Applied Behavior Analysis, 33(3), 271.
This study contributes to the data-base on the use of performance feedback to increase treatment integrity.
Noell, G. H., Duhon, G. J., Gatti, S. L., & Connell, J. E. (2002). Consultation, Follow-up, and Implementation of Behavior Management Interventions in General Education. School Psychology Review, 31(2), 217.
This study evaluated the impact of training on treatment integrity. After finding that positive effects lasted 2-4 days, performance feedback was used to increase treatment integrity.
Noell, G. H., Witt, J. C., Gilbertson, D. N., Ranier, D. D., & Freeland, J. T. (1997). Increasing teacher intervention implementation in general education settings through consultation and performance feedback. School Psychology Quarterly, 12(1).
This study evaluated three approaches to behavioral consultation and their impact on treatment integrity. Performance feedback was associated with superior treatment implementation and child behavioral outcomes.
Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., . . . Duhon, G. J. (2005). Treatment Implementation Following Behavioral Consultation in Schools: A Comparison of Three Follow-up Strategies. School Psychology Review, 34(1), 87-106.
This paper enters debate about how U.S. schools might address long-standing disparities in educational and economic opportunities while improving the educational outcomes for all students. with a vision and an argument for realizing that vision, based on lessons learned from 60 years of education research and reform efforts. The central points covered draw on a much more extensive treatment of these issues published in 2015. The aim is to spark fruitful discussion among educators, policymakers, and researchers.
O'Day, J. A., & Smith, M. S. (2016). Equality and Quality in US Education: Systemic Problems, Systemic Solutions. Policy Brief. Education Policy Center at American Institutes for Research.
This paper reviews a range of evidence-based strategies for application by teachers to reduce disruptive and challenging behaviours in their classrooms.
Parsonson, B. S. (2012). Evidence-Based Classroom Behaviour Management Strategies. Kairaranga, 13(1), 16-23.
This study evaluated the effects of a pyramidal training model to improve teachers’ implementation of functional analysis components. An expert trained a group of teachers who then trained another group of teachers. All teachers improved their ability to conduct functional analyses.
Pence, S., St., P., Claire, & Giles, A. (2014). Teacher Acquisition of Functional Analysis Methods Using Pyramidal Training. Journal of Behavioral Education, 23(1), 132-149.
This study evaluated the effects of performance feedback to pre-service teachers to increase their rates of positive and negative communication with students.
Rathel, J. M., Drasgow, E., & Christle, C. C. (2008). Effects of Supervisor Performance Feedback on Increasing Preservice Teachers’ Positive Communication Behaviors With Students With Emotional and Behavioral Disorders. Journal of Emotional & Behavioral Disorders, 16(2), 67-77.
The terms cloze procedure and cohesion are associated with reading development. Specifically, doze applies to the testing and teaching of reading while cohesion applies to a description of how the way in which reading material is written can affect reading development.
Raymond, P. (1988). Cloze procedure in the teaching of reading. TESL Canada Journal, 6(1), 91–97.
This study evaluted the impact of coaching on the implementation of an intervention. Coaching with higher rates of performance feedback resulted in the highest level of treatment integrity.
Reinke, W., Stormont, M., Herman, K., & Newcomer, L. (2014). Using Coaching to Support Teacher Implementation of Classroom-based Interventions. Journal of Behavioral Education, 23(1), 150-167.
It is proposed in this paper that interventions are most likely to be implemented when they draw from existing practices in a classroom.
Riley-Tillman, T. C., & Chafouleas, S. M. (2003). Using Interventions That Exist in the Natural Environment to Increase Treatment Integrity and Social Influence in Consultation. Journal of Educational & Psychological Consultation, 14(2), 139-156.
This study evaluated the impact of performance feedback as a means of increasing treatment integrity for teachers implementing First Steps to Success.
Rodriguez, B. J., Loman, S. L., & Horner, R. H. (2009). A preliminary analysis of the effects of coaching feedback on teacher implementation fidelity of First Step to Success. Behavior analysis in practice, 2(2), 11-21.
This book looks at how new ideas spread via communication channels over time. Such innovations are initially perceived as uncertain and even risky. To overcome this uncertainty, most people seek out others like themselves who have already adopted the new idea. Thus the diffusion process typically takes months or years. But there are exceptions: use of the Internet in the 1990s, for example, may have spread more rapidly than any other innovation in the history of humankind.
Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York, NY: Free Press.
This paper describes a multi-tier system of supports for teachers as they implement an intervention.
Sanetti, L. M. H., & Collier-Meek, M. A.-. (2015). Data-Driven Delivery of Implementation Supports in a Multi-Tiered Framework: A Pilot Study. Psychology in the Schools, 52(8). 815-828
This study evaluated the Treatment Integiry Planning Protocol as a means for increasing treatment integrity.
Sanetti, L. M. H., & Kratochwill, T. R. (2009). Treatment Integrity Assessment in the Schools: An Evaluation of the Treatment Integrity Planning Protocol. School Psychology Quarterly, 24(1), 24-35.
This paper describes treatment integrity assessment and intervention for practicing school psychologists.
Sanetti, L. M. H., & Kratochwill, T. R. (2011). An Evaluation of the Treatment Integrity Planning Protocol and Two Schedules of Treatment Integrity Self-Report: Impact on Implementation and Report Accuracy. Journal of Educational & Psychological Consultation, 21(4), 284-308.
This study evaluated four methods for teachers self reporting how well they implemented an intervention.
Sanetti, L. M. H., Chafouleas, S. M., O’Keeffe, B. V., & Kilgus, S. P. (2013). Treatment Integrity Assessment of a Daily Report Card Intervention: A Preliminary Evaluation of Two Methods and Frequencies. Canadian Journal of School Psychology, 28(3), 261-276.
This study evaluates the efficacy of the Implementation Planning Protocol as a means for increasing treatment integrity.
Sanetti, L. M. H., Collier-Meek, M. A., Long, A. C. J., Byron, J., & Kratochwill, T. R. (2015). Increasing teacher treatment integrity of behavior support plans through consultation and implementation planning. Journal of School Psychology, 53(3), 209-229.
This paper evaluated the impact of Implementation Planning on teacher level of treatment integrity.
Sanetti, L. M. H., Collier-Meek, M. A., Long, A. C. J., Kim, J., & Kratochwill, T. R. (2014). Using implementation planning to increase teachers' adherence and quality to behavior support plans. Psychology in the Schools, 51(8), 879-895.
This study evaluated the relative benefits of verbal feedback and verbal plus grahic feedback as a means for increasing treatment integrity. The verbal plus graphic feedback was more effective than verbal feedback alone.
Sanetti, L. M. H., Luiselli, J. K., & Handler, M. W. (2007). Effects of Verbal and Graphic Performance Feedback on Behavior Support Plan Implementation in a Public Elementary School. Behavior Modification, 31(4), 454-465.
This study utilized a “bug in the ear” device to provide immediate feedback on implementation of specific teaching practices.
Scheeler, M. C., Congdon, M., & Stansbery, S. (2010). Providing Immediate Feedback to Co-Teachers Through Bug-in-Ear Technology: An Effective Method of Peer Coaching in Inclusion Classrooms. Teacher Education & Special Education, 33(1).
This paper describes the use of wireless technology to give feedback to students in a teacher prep program about their integrity of implementation.
Scheeler, M. C., McAfee, J. K., & Ruhl, K. L. (2006). Effects of Corrective Feedback Delivered via Wireless Technology on Preservice Teacher Performance and Student Behavior. Teacher Education & Special Education, 29(1).
This project consisted of a meta-analysis of U.S. research published from 1980 to 2004 on the effect of specific science teaching strategies on student achievement. T
Schroeder, C. M., Scott, T. P., Tolson, H., Huang, T. Y., & Lee, Y. H. (2007). A meta‐analysis of national research: Effects of teaching strategies on student achievement in science in the United States. Journal of Research in Science Teaching: The Official Journal of the National Association for Research in Science Teaching, 44(10), 1436-1460.
The purpose of this article was to describe the developmental effects of one elementary physical education teacher's proactive teaching of prosocial behavior. An ABA (B) design coupled with a control group comparison across six matched urban physical education classes was used to assess the teaching strategy.
Sharpe, T., Crider, K., Vyhlidal, T., & Brown, M. (1996). Description and effects of prosocial instruction in an elementary physical education setting. Education & Treatment of Children, 19(4), 435.
In this strategy guide, you will learn how to organize students and classroom topics to encourage a high degree of classroom participation and assist students in developing a conceptual understanding of a topic through the use of the Think-Pair-Share technique.
Simon, C. A. (2019). National Council of Teachers of English. Using the think-pair-share technique. Retrieved from http://www.readwritethink.org/professional-development/strategy-guides/using-think-pair-share-30626.html
This article reviews research on the achievement outcomes of three types of approaches to
improving elementary mathematics: mathematics curricula, computer-assisted instruction
(CAI), and instructional process programs.
Slavin, R. E., & Lake, C. (2008). Effective programs in elementary mathematics: A best-evidence synthesis. Review of educational research, 78(3), 427-515.
In this grounded theory study, 19 teachers were interviewed and then, in constant comparative fashion, the interview data were analyzed. The theoretical model that emerged from the data describes novice teachers' tendencies to select and implement differing strategies related to the severity of student behavior.
Smart, J. B., & Igo, L. B. (2010). A grounded theory of behavior management strategy selection, implementation, and perceived effectiveness reported by first-year elementary teachers. The Elementary School Journal, 110(4), 567-584.
This study is a meta-analysis of studies using performance feedback to improve treatment integrity. The overall result was that performance feedback had moderate effects on integrity.
Solomon, B., Klein, S. A., & Politylo, B. C. (2012). The Effect of Performance Feedback on Teachers’ Treatment Integrity: A Meta-Analysis of the Single-Case Literature. School Psychology Review, 41(2), 160-175.
This is a systematic review of the effects of coaching teachers to implement social behavior interventions.
Stormont, M., Reinke, W. M., Newcomer, L., Marchese, D., & Lewis, C. (2015). Coaching Teachers’ Use of Social Behavior Interventions to Improve Children’s Outcomes: A Review of the Literature. Journal of Positive Behavior Interventions, 17(2).
This meta-analysis examines the impact of team-based learning strategies on achievement and student engagement. The study finds that team-based strategies were found to have a positive impact on grades, test performance, and engagement.
Swanson, E., McCulley, L. V., Osman, D. J., Scammacca Lewis, N., & Solis, M. (2017). The effect of team-based learning on content knowledge: A meta-analysis. Active Learning in Higher Education, 1469787417731201.
This book target regular and special education teachers who implement PBS in their classrooms. The book also serves as an essential resources for preservice teachers who are developing their classroom management skills. it focuses on practical strategies to prevent and reduce behavioral problems and enhance student learning.
Tincani, M. (2011). Preventing challenging behavior in your classroom: Positive behavior support and effective classroom management. Sourcebooks, Inc..
Student engagement is critical to academic success. High-Active Student Response (ASR) teaching techniques are an effective way to improve student engagement and are an important component of evidence-based practice. . This report provides techniques and strategies to enhance engagement through ASR. Key terms are appended.
Tincani, M., & Twyman, J. S. (2016). Enhancing Engagement through Active Student Response. Center on Innovations in Learning, Temple University.
Sixty children with severe reading disabilities were randomly assigned to two instructional
programs that incorporated principles of effective instruction but differed in depth and extent
of instruction in phonemic awareness and phonemic decoding skills
Torgesen, J. K., Alexander, A. W., Wagner, R. K., Rashotte, C. A., Voeller, K. K., & Conway, T. (2001). Intensive remedial instruction for children with severe reading disabilities: Immediate and long-term outcomes from two instructional approaches. Journal of learning disabilities, 34(1), 33-58.
This experiment evaluated the effects of requiring overt answer construction in computer-based programmed instruction using an alternating treatments design.
Tudor, R. M. (1995). Isolating the effects of active responding in computer‐based instruction. Journal of Applied Behavior Analysis, 28(3), 343-344.
A group experimental design compared passive reading, covert responding to frame blanks, and actively typing answers to blanks with and without immediate confirmation of correctness. Results strongly supported the effectiveness of requiring the student to supply fragments of a terminal repertoire while working through a program.
Tudor, R. M., & Bostow, D. E. (1991). Computer‐programmed instruction: The relation of required interaction to practical application. Journal of Applied Behavior Analysis, 24(2), 361-368.
This article show different approach that researcher took to answer questions on social gradient in education between the countries. Comparing some of these results highlights weak service delivery in many developing countries. Even where resources may be similar, social gradients are steep in some, indicating much worse educational outcomes for the poor. And public resources are often extremely poorly converted into learning. The differential ability of schools and school systems to convert resources into learning outcomes remains a major impediment to improving educational outcomes, and indeed life chances, for the poor.
Van Der Berg, S. (2015). How does the rich-poor learning gap vary across countries?. Brookings Institution. Retrieved from https://www.brookings.edu/blog/future-development/2015/03/09/how-does-the-rich-poor-learning-gap-vary-across-countries/
The purpose of this study was to examine the effects of implementation of a systematic
response to intervention (RTI) model on the identification and evaluation of children for
VanDerHeyden, A. M., Witt, J. C., & Gilbertson, D. (2007). A multi-year evaluation of the effects of a response to intervention (RTI) model on identification of children for special education. Journal of School Psychology, 45(2), 225-256.
In a randomized control study, Head Start teachers were assigned to either an intervention group that received intensive, ongoing professional development (PD) or to a comparison group that received the “business as usual” PD provided by Head Start. The PD intervention provided teachers with conceptual knowledge and instructional strategies that support young children’s development of vocabulary, alpha- bet knowledge, and phonological sensitivity.
Wasik, B. A., & Hindman, A. H. (2011). Improving vocabulary and pre-literacy skills of at-risk preschoolers through teacher professional development. Journal of Educational Psychology, 103(2), 455.
Developed by the Office of Special Education and Rehabilitative Services (OSERS), this report presents current weaknesses in the education of students with learning problems (those having difficulties learning for any of a variety of reasons) and suggested strategies for correcting those weaknesses.
Will, M. C. (1986). Educating children with learning problems: A shared responsibility. Exceptional children, 52(5), 411-415.
On the one hand, it seems obvious that practice is important. After all, "practice makes perfect." On the other hand, it seems just as obvious that practicing the same material again and again would be boring for students. How much practice is the right amount?
Willingham, D. T. (2004). Ask the Cognitive Scientist Practice Makes Perfect, But Only If You Practice Beyond the Point of Perfection. American Educator, 28(1), 31-33.
This article describes a systematic process for finding and resolving problems with classroom-based behavioral interventions in schools.
Witt, J. C., VanDerHeyden, A. M., & Gilbertson, D. (2004). Troubleshooting behavioral interventions: A systematic process for finding and eliminating problems. School Psychology Review, 33, 363-383.
This study employed a meta-analysis method to combine the results of experimental studies on the effect of teaching learning strategies on students’ academic achievement. This study indicated that the learning strategies had 26.8% positive effect on students’ academic achievement.
YILDIRIM, I., CIRAK-KURT, S., & SEN, S. (2019). The Effect of Teaching” Learning Strategies” on Academic Achievement: A Meta-Analysis Study. Eurasian Journal of Educational Research (EJER), (79).
This study evaluated the effects of graphed feedback alone compared to the effects of graphed feedback plus verbal feedback. The combined graphed and verbal resulted in slightly better performance.
Zoder-Martell, K., Dufrene, B., Sterling, H., Tingstrom, D., Blaze, J., Duncan, N., & Harpole, L.-. (2013). Effects of Verbal and Graphed Feedback on Treatment Integrity. Journal of Applied School Psychology, 29(4).