Latest News

How are Effective Programs Disseminated and Scaled?

October 4, 2021

Scaling and Disseminating Brief Bullying Prevention Programming: Strengths, Challenges, and Considerations. One of the persistent problems in education and other human service disciplines is the research to practice gap (some would call it a chasm).  In an effort to disseminate an effective bullying program (Free2B), Leff and colleagues applied the logic of Diffusion of Innovations (Rogers, 2003).  This logic proposes that innovations are more likely to be adopted if the innovation has (1) a relative advantage over current practices, (2) is easy to use, (3) is compatible with the values, beliefs, experiences of the users, (4) can be implemented on a trial basis before large scale implementation, and (5) the opportunity for others to observe implementation and the effects of implementation.  Leff and colleagues followed these recommendations in implementing the Free2B anti-bullying program in 40 middle schools.  The authors concluded that it was an attractive alternative to many anti-bullying programs because the intervention was delivered in a school assembly that schools were already providing, so it required no additional time allocation.  Additionally, the video format made the delivery very easy compared to school-wide programs that are more time and resource intensive.  The students reported that it addressed important topics. Prior to implementation, Leff and colleagues presented pilot data to key stakeholders at the state’s Office of Safe Schools who were able to leverage adoption by schools across the state.  In addition to measuring adoption they also measured the impact on students and founds positive effects across all measures.

Citations: Leff, S. S., Waasdorp, T. E., Paskewich, B. S., & Winston, F. K. (2020). Scaling and Disseminating Brief Bullying Prevention Programming: Strengths, Challenges, and Considerations. School Psychology Review, 1-15.

Rogers, E. M. (1962). Diffusion of innovations. New York: Free Press of Glencoe.

Link: https://doi.org/10.1080/2372966X.2020.1851612

 


 

How can educators effectively incorporate Professional Judgment into the decision making process?

October 4, 2021

Overview of Professional Judgment. Educators make many decisions regarding services for students. Even when there is abundant evidence to guide their decisions, educators must use their judgment about what is appropriate in a given situation. Only on rare occasion does the available evidence perfectly match the service context of concern to the educator. To bridge the gap between research and local circumstance, the educator must make a series of judgments such as defining the problem, determining which evidence is relevant, and deciding which features of the local context are likely to require adaptations to the selected evidence-based intervention. Professional judgment is a cornerstone of evidence-based practice, as are best available evidence, stakeholder values, and the context in which services are provided. In this definition of evidence-based practice, the integration of these variables influences decisions. No one cornerstone can be substituted for the others. Judgment must be informed and constrained by the best available evidence, stakeholder values, and context.

Citation: Guinness, K., and Detrich, R. (2021). Overview of Professional Judgment. Oakland, CA: The Wing Institute. https://www.winginstitute.org/evidence-based-decision-making-professional-judgment.

Link: https://www.winginstitute.org/evidence-based-decision-making-professional-judgment

 


 

What do we know about Principal Evaluation?

August 31, 2021

Principal Evaluation. The field of principal evaluation, while gaining increased research interest in recent years, lags behind teacher evaluation in terms of conclusions that can be made regarding effective practice. Prior to Race to the Top and ESEA waivers, principal evaluation was implemented inconsistently and evaluation systems lacked instruments with validity and/or reliability, had a tenuous relationship with leadership standards, failed to include measures of student/school outcomes, and had mixed purposes as to their intended use (e.g., sometimes as formative information to help principals improve, while other times as summative information to make personnel decisions). However, today’s evaluation systems have evolved to incorporate multiple measures of principal performance that evaluate principals on research-based principles of effective leadership, often include student outcomes (which is often controversial, however), and are used both to help principals improve and to hold them accountable for their performance. Ongoing and more frequent observations, often conducted by the principal supervisor, who often also serves as a coach/mentor and directs the principal towards needed professional learning, show promise as an effective practice. Using the results from principal evaluations for personnel decisions, such as offering incentives through pay-for-performance programs, yields mixed results and warrants further research attention. 

Citation: Donley, J., Detrich, R., States, J., & Keyworth, (2021). Principal Evaluation Oakland, CA: The Wing Institute. https://www.winginstitute.org/quality-leadership-principal-evaluation

Link: https://www.winginstitute.org/quality-leadership-principal-evaluation

 


 

Do Teacher Retention Bonuses Keep High Quality Teachers in High Poverty Schools?

August 25, 2021

Effective teacher retention bonuses: Evidence from Tennessee. The data are clear that students in high poverty schools perform worse on most measures of educational attainment; however, the discrepancy between high poverty schools and more affluent schools is reduced when there are quality teachers in the high poverty schools.  The challenge is that teachers leave these schools at a higher rate.  This turnover contributes to the poor outcomes for students in high poverty schools. Recruiting and training replacement teachers is an expensive proposition for districts.  One approach to increasing retention in high poverty schools is to offer retention bonuses to teachers in these schools.  There are two questions with respect to the use of retention bonuses: 1) are they effective over the long term, and 2) does having a more stable teachering corps increase student outcomes?  A recent report examined the impact of teacher retention bonuses in Tennessee (Springer, Swain, & Rodriguez, 2016).  The main findings are that teachers that participated in the retention bonus program were significantly more likely to stay in their school than teachers who did not participate.  Importantly, the students in the classrooms of participating teachers had significantly higher academic gains than students of non-participating teachers.  Looking at these data through the Active Implementation Frameworks lens, the retention bonus represents a usable innovation.  The teacher retention bonuses are also an element of the Competency driver, specifically Selection.  Finally, this innovation links to the Organizational driver since to effectively implement it, the innovation has to be considered a system level intervention.

Citation: Springer, M. G., Swain, W. A., & Rodriguez, L. A. (2016). Effective teacher retention bonuses: Evidence from Tennessee. Educational Evaluation and Policy Analysis38(2), 199-221.

Link: https://journals.sagepub.com/doi/abs/10.3102/0162373715609687

 


 

How Well do Universities Prepare Pre-Service Candidates to Pass Licensure Exam?

August 25, 2021

Driven by Data: Using Licensure Tests to Build a Strong, Diverse Teacher Workforce. Essential to improving educational outcomes for students is to assure that well prepared teachers are in every classroom.  Teacher preparation programs are primarily responsible for preparing candidates.  One measure of how well institutions are preparing teachers is the percentage of candidates that pass state licensure tests.  The National Council on Teacher Quality (https://www.nctq.org/) recently released a report examining the pass rate of elementary education teachers by state, by de-identified teacher preparation institutions, and disaggregated data for candidates of color and socio-economic status.  Different states have different standards, rely on different methods to assess performance, and have different criteria for passing scores.  Thirty-four states provided complete data for this report, eight provided partial data, and nine states provided no data.  Based on the available data, nationally 55% of teacher candidates failed the exam on their first try.  The data vary considerably across states and across institutions within and across states.  One of the conclusions of this report is that elementary teacher candidates, regardless of race and ethnicity, are “too often poorly prepared and supported to pass their state licensure tests.”  The authors of the report identified a number of issues with how states are currently assessing teacher competency.  The report concludes with a number of recommendations for improving teacher preparation programs so that more teachers pass the licensure test.  These data are directly relevant to the competency implementation driver in the Active Implementation Frameworks.  Implementation efforts are not likely to be successful if competent personnel are not available to implement the innovation.  Competency is primarily the responsibility of the teacher preparation programs.  These programs would be well served to attend to the recommendations of this report.  In addition, education policy makers should review their state’s current methods for assessing the competency of teacher candidates.

Citation: Putman, H. & Walsh, K. (2021). Driven by Data: Using Licensure Tests to Build a Strong, Diverse Teacher Workforce. Washington, D.C.: National Council on Teacher Quality

Link: https://www.nctq.org/publications/Driven-by-Data:-Using-Licensure-Tests-to-Build-a-Strong,-Diverse-Teacher-Workforce/

 


 

Do Principals Feel They Have Influence Over Decisions in Their School?

August 25, 2021

Principals’ Perceptions of Influence Over Decisions at Their Schools in 2017-2018. Contemporary models of principal leadership are that principals are expected to be the instructional leaders in their schools.  At least two questions emerge from this expectation: (1) Do principals have the ability to influence instructional decisions in their schools? (2) Do principals have the necessary training to base instructional decisions on the best available evidence?  In a recent report published by the National Center for Education Statistics at IES (July, 2021), the degree to which principals in traditional public schools, private schools, and charter schools felt like they have influence over decisions across a number of domains of school leadership was assessed.  The degree to which they felt they had influence was related to the type of school in which they were working.  Particularly, interesting from the perspective of principals as instructional leaders, is that only 39% of principals in traditional public schools felt like they had influence over establishing curriculum.  This figure is considerably lower than for principals in private schools (69%) and principals in public charter schools (59%).  This raises the question do traditional public school principals have a commitment to the curriculum choices that are made?  If they do not, then one has to wonder if they will be champions for the curriculum and effective instructional leaders?  In terms of the Active Implementation Frameworks, effective implementation of the model of principals as instructional leaders requires that principals be involved in the identification of useable innovations, the actual implementation of the innovation in their school, and access to the data about the effectiveness of the innovation.  In addition, if principals are to be effective instructional leaders then the competency drivers of selection, training, and coaching need to be present so principals will have the necessary skills to function in those roles.  Finally, the leadership drivers of technical skills and adaptive leadership skills are necessary to adapt an instructional practice into a particular organizational and school context.  It would be interesting to see how the practices in private schools and public charter schools differ from traditional public schools that results in principals reporting they have influence over decisions involving curriculum.  This article only addresses the question of do principals have influence over curriculum decisions?  It does not address the extent to which principals have the skills to base decisions on best available evidence. Please see the Wing Institute paper on Best Available Evidence (https://www.winginstitute.org/evidence-based-decision-making-evidence) for more on this topic.

Citation: National Center for Education Statistics at IES. (2021).  Principals’ Perceptions of Influence Over Decisions at Their Schools in 2017-2018. 

Link: https://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2021091

 


 

How Effective are Interventions to Reduce Discipline Disproportionality?

August 25, 2021

Disproportionality reduction in exclusionary school discipline: A best-evidence synthesis. Disproportionality in the application of school discipline policies has been well documented over the years (Skiba, et al. (2011), and has been resistant to change.  In a systematic review of the evidence of the effectiveness of programs and practices to reduce disproportionality, Cruz, Firestone, and Rodl (2021) found that the positive effects of individual programs such as School Wide Interventions and Support, and Restorative Justice, were either mixed or not evident.  More promising were results from combining practices from different programs and including a specific equity framework for training educators.  The most promising results were obtained when in-class coaching was a component of the training approach.  The challenge of implementing a coaching model was identifying the necessary human and time resources, as well as the financial resources, to effectively implement coaching.  This paper touches on several important aspects of the Active Implementation Frameworks including the identification of effective practices (usable innovations) and implementation drivers (professional development, leadership, and enabling contexts).  The absence of any one of these features will limit the overall impact on efforts to reduce disproportionality.

Citation: Cruz, R. A., Firestone, A. R., & Rodl, J. E. (2021). Disproportionality reduction in exclusionary school discipline: A best-evidence synthesis. Review of Educational Research91(3), 397-431.

Link: https://journals.sagepub.com/doi/abs/10.3102/0034654321995255

 


 

What do we know about teacher preparation program models?

August 15, 2021

Teacher Preparation Program Models Overview. Teacher preparation began in the mid-19th century with the normal school, a 2-year course of study that prepared candidates for teaching. This model remained unchanged until the early 20th century, when universities created the undergraduate model, which currently predominates. Teacher candidates are required to spend 4 years obtaining a bachelor’s degree built around a prescribed course of education study. A second relatively recent modification is the 5-year credential model, requiring candidates to obtain a bachelor’s degree before beginning a 5th year of instruction in teaching. The driving force behind the postgraduate model was the belief that teachers were not respected. It was assumed that a post-bachelor’s and/or graduate degree certificate would confer greater esteem on the profession. This model is offered across the country and is mandated for all new teachers in California. A third option, the alternative credential (AC) model, arose as a solution to teacher shortages. The AC model is distinct from the traditional models in that candidates receive formal preparation coursework while already employed in the classroom. Currently, little evidence exists to support the superiority of any one method over the others.

Citation: Cleaver, S., Detrich, R. & States, J. (2021). Teacher Preparation Models. Oakland, CA: The Wing Institutehttps://www.winginstitute.org/pre-service-teacher-program-models.

Link: https://www.winginstitute.org/pre-service-teacher-program-models

 


 

How Effective is Teacher Pre-service Pedagogy?

August 3, 2021

Teacher Preparation: Instructional Effectiveness Overview. Discussions of teacher preparation generally focus on content (what to teach) rather than pedagogy (how to teach). Teacher training has changed little in 100 years. Preparation programs rely on lectures supplemented with 8 weeks of student teaching under minimal university oversight. Lecturing persists for various reasons: It requires nominal effort, instructors have greater control of what is presented, and assessing mastery of the material is easy using tests and papers. There are significant disadvantages to lecturing. Listening to a lecturer and answering questions during the lecture are very different from being able to perform skillfully in a real-world setting. Research shows that the most effective training of complex skills occurs when the training follows the elementary paradigm “I do,” “we do,” “you do.” This model relies on introducing skills through lectures and discussions, in tandem with demonstrating the skills (I do). This is followed by learners practicing the skills alongside a coach (we do), and finally the student teacher performing independently with feedback from the coach (you do). Research suggests it is only when coaching is added to the mix that skills are fully mastered and used effectively in the classroom.

Citation: Cleaver, S., Detrich, R., States, J. & Keyworth, R. (2021). Teacher Preparation: Instructional Effectiveness. Oakland, CA: The Wing Institute. https://www.winginstitute.org/pre-service-teacher-instructional-effectiveness.

Link: https://www.winginstitute.org/pre-service-teacher-instructional-effectiveness

 


 

What are common criticisms expressed against data-based decision making?

July 7, 2021

Misconceptions about data-based decision making in education: An exploration of the literature. Research on data-based decision making has proliferated around the world, fueled by policy recommendations and the diverse data that are now available to educators to inform their practice. Yet, many misconceptions and concerns have been raised by researchers and practitioners. This paper surveys and synthesizes the landscape of the data-based decision-making literature to address the identified misconceptions and then to serve as a stimulus to changes in policy and practice as well as a roadmap for a research agenda.

Citation: Mandinach, E. B., & Schildkamp, K. (2021). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation69, 100842.

Link: https://www.sciencedirect.com/science/article/pii/S0191491X1930416X