Categories for Decision Making

What is implementation fidelity and why is it important to student success?

November 16, 2020

Fidelity of implementation is a critical but often neglected component of any new system, practice, or intervention in educational research and practice. Fidelity is a multidimensional construct focused on providing evidence of adherence, quality, dosage, differentiation, and responsiveness following implementation. Unfortunately, fidelity has not always been prioritized, although evidence suggests that is changing, at least in published research. Further, although there are myriad methods for measuring fidelity, psychometric evaluations of fidelity tools have been limited, except in the SWPBIS literature. Calls for a science of fidelity have been made (Gresham, 2017) and are beginning to be answered. Overall, there appears to be more research focused exclusively on fidelity, including measurement approaches, psychometric evaluations, and relation to outcomes. As this research expands, we hope that the broad use and integration of fidelity in practice follows. We believe that the days of neglecting fidelity are behind us in education and see fidelity playing a central role in education moving forward. Through reliable and valid measurement of fidelity, scalable evidence-based practices can be developed and proliferated, positively impacting students’ academic and behavioral outcomes. 

Citation: Gage, N., MacSuga-Gage, A., and Detrich, R. (2020). Fidelity of Implementation in Educational Research and Practice. Oakland, CA: The Wing Institute. https://www.winginstitute.org/systems-program-fidelity

Link: https://www.winginstitute.org/systems-program-fidelity

 


 

What is the cost of coaching teachers?

November 12, 2020

Assessing the Cost of Instructional Coaching. Each year school systems spend approximately $15 million per school year, $230 per student, and $3,390 per teacher, totaling 2.9% of the operating budget, to provide a variety of professional development opportunities from workshops to coaching to whole-school development (Cleaver, 2020). Research suggests coaching is one of the most effective methods for increasing the effectiveness of professional development. 

Over the past twenty years, the popularity of school-based instructional coaching has grown. But one obstacle to the wide-spread use of coaching is the cost of delivering the service. This paper examines the resources needed for coaching and offers a framework for measuring these costs. The author finds coaching costs range from $3,260 to $5,220 per teacher. These are substantial expenses. Given limited education budgets, policymakers need to conduct cost/benefit analyses that compare traditional professional development methods such as workshops. This study lays the groundwork for cost-effectiveness studies by presenting a framework for measuring costs and reporting costs of a specific program.  

Another valuable resource for determining a return on investment for education interventions is Stewart Yeh’s 2007 study, The cost-effectiveness of five policies for improving student achievement. Yeh offers a framework for utilizing a practice effect size and costs of the practice to determine what method is best suited given a school’s current budget. Incorporating cost-benefit analyses into schools’ decision-making process is essential if educators make the most informed decisions impacting student outcomes. 

Citation: Knight, D. S. (2012). Assessing the cost of instructional coaching. Journal of Education Finance, 52-80.

Yeh, S. S. (2007). The cost-effectiveness of five policies for improving student achievement. American Journal of Evaluation28(4), 416-436.

Linkhttps://www.researchgate.net/profile/David_Knight28/publication/236780276_Assessing_the_Cost_of_Instructional_Coaching/links/57fbca5008ae6ce92eb2afe3/Assessing-the-Cost-of-Instructional-Coaching.pdf

https://journals.sagepub.com/doi/abs/10.1177/1098214007307928

 


 

What is corrective feedback?

October 27, 2020

Corrective Feedback Overview. orrective feedback is a form of performance feedback used to improve student achievement. Teachers provide feedback to students to reinforce expectations and to correct student errors during lessons. Feedback is often noted as the single most powerful tool available for improving student performance, and more than seven meta-analyses conducted since 1980 support this claim. Classroom teachers use corrective feedback as a teaching technique every day. The feedback may be as simple as giving praise, returning assignments the next day, immediately correcting student misconceptions, or as a component of active student responding. Other effective strategies rely on peer review or self-assessment to increase feedback. For the best results, feedback must meet these four conditions: (1) It is objective, reliable, measureable, and specific; (2) it provides information about what was done well, what needs improvement, and how to improve; (3) it is delivered frequently and immediately following performance; and (4) it is about performance rather than personal characteristics.

Citation: Guinness, K., Detrich, R., Keyworth, R. & States, J. (2020). Overview of Corrective Feedback. Oakland, CA: The Wing Institute. https://www.winginstitute.org/instructional-delivery-feedback

Link: https://www.winginstitute.org/instructional-delivery-feedback

 


 

What practices are critical for creating a school-wide behavior management system?

October 14, 2020

Sustaining and Scaling Positive Behavioral Interventions and Supports: Implementation Drivers, Outcomes, and Considerations. Positive behavior interventions and supports (PBIS) is a system-wide conduct management approach designed to increase student behavior consistency in schools. PBIS was introduced with the reauthorization of the Individuals with Disabilities Education Act in 1997. This paper examines the 25-year history of the PBIS implementation experience, including the core features of PBIS as a multi-tiered framework and the process and outcomes for implementing PBIS across over 26,000 schools. The authors summarize the national outcome data of PBIS implementation, and they propose future directions and considerations, improving scaling up services and sustainability of school-wide behavior management strategies.

Citation: Sugai, G., & Horner, R. H. (2020). Sustaining and scaling positive behavioral interventions and supports: Implementation drivers, outcomes, and considerations. Exceptional Children86(2), 120-136.

Link: https://journals.sagepub.com/doi/abs/10.1177/0014402919855331

 


 

What are effects of principals on critical outcomes?

September 24, 2020

The Effect of Principal Behaviors on Student, Teacher, and School Outcomes: A Systematic Review and Meta-Analysis of the Empirical Literature. School principals are commonly associated with improving teaching and learning conditions in schools, but what does the research tell us about the leadership strategies principals should focus on to boost student and teacher outcomes. This study offers four chief findings. First, there is evidence for the relationship between principal behaviors and student achievement. Secondly, there is evidence to support the school principal’s impact on teacher job satisfaction and effectiveness. Thirdly, research supports the role principals play in improving teacher instructional practices. Finally, principals are essential to sustaining the overall organizational health of the school. The study also concludes that more research is needed to establish a cause and effect relationship lacking in the current research base.

Citation: Liebowitz, D. D., & Porter, L. (2019). The effect of principal behaviors on student, teacher, and school outcomes: A systematic review and meta-analysis of the empirical literature. Review of Educational Research89(5), 785-827.

Link: https://aefpweb.org/sites/default/files/webform/44/Liebowitz_Porter_2019_AEFP.pdf

 


 

How important is a well structured environment in managing a classroom? (Wing Institute Original Paper)

August 31, 2020

Structured Environment Overview. An effective classroom behavior management program involves both proactive strategies to prevent challenging behavior, and reactive strategies to respond to challenging behavior when it occurs. One type of proactive strategy is attending to the physical environment of the classroom, including how desk arrangement, visual displays, and classroom noise can affect student behavior. Modifying characteristics of the physical environment is a primary intervention in a multitiered system of support (MTSS). This overview summarizes research on the effects of the physical classroom environment on student behavior.

Citation: Guinness, K., Detrich, R., Keyworth, R. & States, J. (2020). Overview of Structured Environment. Oakland, CA: The Wing Institute. https://www.winginstitute.org/classroom-structured-environments.

Link: https://www.winginstitute.org/classroom-structured-environments

 


 

How should principals prepare for the new school year?

August 14, 2020

Returning to School Toolkit for Principals. This toolkit is designed to help structure principal’s thinking about the return to school, in whatever form that takes. The toolkits is structured to point and direct administrators to where to find help. The guidelines offer context for the use of the tools and tip sheets, and suggestions for actions you might consider. 

The Returning to School: A Toolkit for Principals is organized around four sections: 

  • Change
  • Communication
  • Collaboration 
  • Care 

These sections of the Toolkit for Principals are not meant to be sequential; one is not more important than the others. Scan the four sections and consider how they might support your preparation for a successful return to school, and your transition to schooling in this new reality.

This publication is one of eight in a series of resources Return to School from the National Comprehensive Center. 

  • Guide to After-Action Reviews 
  • Better Together: A Coordinated Response for Principals and District Leaders 
  • Mitigating Harm for Vulnerable Populations 
  • Rapid Response: Informational Resources on Improving Social and Emotional Learning and Outcomes 
  • Scenario Planning 
  • Budgeting in a Crisis 
  • Considerations for supporting a successful start to the 2020-2021 school for students with disabilities

Citation: Benton, K., Butterfield, K., Manian, N., Molina, M., Richel, M. (2020). Returning to School Toolkit for Principals. Rockville, MD: National Comprehensive Center at Westat. https://www.compcenternetwork.org/sites/default/files/local/5704/Returning%20to%20School%20Toolkit%20for%20Principals%20(07-16-2020).pdf

Linkhttps://www.compcenternetwork.org/sites/default/files/local/5704/Returning%20to%20School%20Toolkit%20for%20Principals%20(07-16-2020).pdf

 


 

Remote Instruction (Wing Institute Original Paper)

June 30, 2020

Remote forms of K-12 instruction have become increasingly prevalent as schools expand their use of educational technologies to allow for learning beyond that which takes place in brick and mortar classrooms. Remote instruction may offer a number of benefits, including reduced costs and increased student access to courses and instruction that would not be available otherwise. However, while research is limited, evidence to date suggests that fully remote instruction and virtual schools are not as effective as the face-to-face instruction that takes place in traditional schools, particularly for struggling students. Blended instructional models have shown more promise, particularly those that enable differentiated instruction through technologies such as intelligent tutoring. The success of remote instruction likely in part depends on a number of implementation factors, such as the degree to which equitable access to digital tools and resources is provided, whether and how students’ metacognitive skills that are essential for more independent, self-regulated learning are developed, the capacity of preparation and professional development to foster teachers’ technological pedagogical content knowledge, and the extent to which parents can engage in ways that allow them to effectively support their children’s learning at home.

Citation: Donley, J., Detrich, R., States, J., & Keyworth, (2020). Remote Learning Overview. Oakland, CA: The Wing Institute. https://www.winginstitute.org/effective-instruction-computers.

Link: https://www.winginstitute.org/effective-instruction-computers

 


 

Wested Responds to Covid

June 8, 2020

WestEd is a nonprofit organization tasked with promoting excellence, achieve equity, and improve learning for children, youth, and adults. WestEd offers consulting and technical assistance, evaluation, policy, professional development, and research and development to support and improve education outcomes.

As the world rallies to respond to the current public health crisis, schools across the globe have closed their doors to stop the spread of the new coronavirus and its associated disease, COVID-19. Wested has developed and compiled resources to assist schools in responding to this crisis.

The resources include;
Distance & At-Home Learning
Early Childhood
English Learners
Health, Safety, & Well-Being
Online Professional Development
Resource Planning & Management
Science & Mathematics
Special Education

Link: Wested

 


 

Why Practices Fail

May 29, 2020

The 2020 pandemic is unprecedented in living memory. This event necessitates schools adopting new technologies and teachers mastering new ways of delivering instruction. Education is engaged in a grand experiment, implementing new practices in fifty states with over 13,000 school districts. Change on this magnitude would be daunting even in normal times, and is particularly difficult in a decentralized system such as in the United States. What we know is there are bound to be many failures. Fortunately, the past 15 years have seen remarkable progress in the creation of a science of implementation to address such hurdles. This paper offers examples of failed practices in guiding schools to avoid making similar mistakes over the coming year. 

Citation: States, J., & Keyworth, R. (2020). Why Practices Fail. Oakland, CA: The Wing Institute. https://www.winginstitute.org/roadmap-overview

Link: https://www.winginstitute.org/roadmap-overview