Education Drivers

Staff Treatment Integrity

For the best chance of a positive impact on educational outcomes, two conditions must be met: (a) Effective interventions must be adopted, and (b) those interventions must be executed with sufficient quality (treatment integrity) to ensure the intervention is implemented as designed. Treatment integrity research finds that integrity scores are very low and, in practice, implementation is rarely assessed. If an intervention with a strong research base is not implemented with a high level of treatment integrity, then the students do not actually experience the intervention and there is no reason to assume they will benefit from it. Under these circumstances, it is impossible to know if poor outcomes are the result of an ineffective intervention or poor implementation of that intervention. Treatment integrity is defined as consistently implementing the essential components of an intervention as planned, intended, and originally designed. Studies find degradation of fidelity begins shortly after training. To ensure consistent levels of treatment integrity, teachers require ongoing monitoring and feedback of implementation. To date, research has not identified what threshold of treatment integrity is required to ensure the optimum benefit of an evidence-based practice.

Staff Treatment Integrity

Staff Treatment Integrity PDF

Citation: Detrich, R., States, J., & Keyworth, R. (2017). Staff Treatment Integrity.Oakland, CA: The Wing Institute. https://www.winginstitute.org/staff-treatment-intergity.

For the best chance of producing positive educational outcomes for all children, two conditions must be met: (a) adopting effective empirically supported (evidence-based) practices and (b) implementing those practices with sufficient quality that they make a difference (treatment integrity) (Detrich, 2014). Both are necessary as neither on its own is sufficient to result in positive outcomes. Figure 1 describes the relationship between empirically supported practices and treatment integrity.

 

Probability Benefits

Figure 1. Relationship between empirically supported practices and treatment integrity

            If an intervention has strong empirical support and is implemented with high integrity, then there is a high probability that positive outcomes will be achieved (upper left quadrant). The other quadrants illustrate that the lack of either element reduces the probability of positive outcomes: If a well-supported, research-based intervention is not implemented with high integrity (lower left quadrant); if an intervention is implemented with high integrity but is not empirically supported (upper right quadrant); or if a nonempirically supported intervention is implemented poorly (lower right quadrant).

            It should be noted that some interventions are not empirically supported because sufficient research has demonstrated that they do not produce positive outcomes. Alternatively, some interventions are not empirically supported because they have not been experimentally evaluated. This latter class of interventions is still in the experimental phase of development. Using these interventions is tantamount to conducting research and all of the rules for engaging in research should be followed. Because these interventions are still experimental, their effectiveness is unknown and they should be implemented only with the fully informed consent of both educators and parents.

            The advent of the evidence-based practice movement in education has resulted in considerable effort to identify practices that are empirically supported. Organizations such as the What Works Clearinghouse (https://ies.ed.gov/ncee/wwc) and the Best Evidence Encyclopedia (http://www.bestevidence.org) have reviewed a large number of interventions to discern the research base for each intervention. Until the past 20 years, treatment integrity did not receive significant scholarly attention. Even with the increased attention, treatment integrity measures are reported in about half of the published intervention research reports (Sanetti, Dobey, & Gritter, 2012; Sanetti, Gritter, & Dobey, 2011). When treatment integrity data are not published in research reports, it is difficult to know if the intervention that the researchers reported was actually implemented and was responsible for the outcomes or if there was some undocumented variation of the intervention that actually accounted for the outcomes.

           As important as treatment integrity is in research, it is equally important in practice settings. Measures of treatment integrity are fundamental to data-based decision making. Effective interventions may be prematurely terminated if the level of treatment integrity is not known. Student performance data tell us only how well a student is responding to the intervention as it is implemented. Treatment integrity measures tell us how well the intervention is being implemented. Without knowing about treatment integrity, it is not possible to know if a student’s failure to benefit from an intervention is a function of an ineffective intervention or ineffective implementation (see Treatment Integrity in the Problem-Solving Process for more discussion).

References

Detrich, R. (2014). Treatment integrity: Fundamental to education reform. Journal of Cognitive Education and Psychology13(2), 258–271.

Sanetti, L. M. H., Dobey, L. M., & Gritter, K. L. (2012). Treatment integrity of interventions with children in the Journal of Positive Behavior interventions from 1999 to 2009. Journal of Positive Behavior Interventions14(1), 29–46.

Sanetti, L. M. H., Gritter, K. L., & Dobey, L. M. (2011). Treatment integrity of interventions with children in the school psychology literature from 1995 to 2008. School Psychology Review40(1), 72–84.

 

Publications

TITLE
SYNOPSIS
CITATION
Overview: Formal Teacher Evaluation

The purpose of this overview is to provide information about the role of formal teacher evaluation, the research that examines the practice, and its impact on student outcomes.

Cleaver, S., Detrich, R. & States, J. (2018). Overview of Teacher Formal Evaluation. Oakland, CA: The Wing Institute.https://www.winginstitute.org/teacher-evaluation-formal.

Value-Added Research in Education: Reliability, Validity, Efficacy, and Usefulness

The purpose of this paper on value-added research in education is to define this type of research, provide an overview of how it has been conducted, and discuss its benefits and limitations.

Cleaver, S., Detrich, R. & States, J. (2020). Overview of Value-Added Research in Education: Reliability, Validity, Efficacy, and Usefulness. Oakland, CA: The Wing Institute. https://www.winginstitute.org/staff-value-added.

  

Performance Feedback in Education: On Who and For What

This paper reviews the importance of feedback in education reviewed the scientific model of behavior change (antecedent, behavior, consequences).

Daniels, A. (2013). Feedback in Education: On Whom and for What. In Performance Feedback: Using Data to Improve Educator Performance (Vol. 3, pp. 77-95). Oakland, CA: The Wing Institute.

Approaches to Increasing Treatment Integrity

Strategies designed to increase treatment integrity fall into two categories: antecedent-based strategies and consequence-based strategies.

Detrich, R., States, J. & Keyworth, R. (2017). Approaches to Increasing Treatment Integrity. Oakland, Ca. The Wing Institute

 

Treatment Integrity in the Problem Solving Process

The usual approach to determining if an intervention is effective for a student is to review student outcome data; however, this is only part of the task. Student data can only be understood if we know something about how well the intervention was implemented. Student data without treatment integrity data are largely meaningless because without knowing how well an intervention has been implemented, no judgments can be made about the effectiveness of the intervention. Poor outcomes can be a function of an ineffective intervention or poor implementation of the intervention. Without treatment integrity data, the is a risk that an intervention will be judged as ineffective when, in fact, the quality of implementation was so inadequate that it would be unreasonable to expect positive outcomes.

Detrich, R., States, J. & Keyworth, R. (2017). Treatment Integrity in the Problem Solving Process. Oakland, Ca. The Wing Institute.

 

 

Data Mining

TITLE
SYNOPSIS
CITATION
What Teacher Training Methods Result in Changes in Classroom Practices?

This analysis compares the effectiveness of staff development methods that include, didactic presentation, modeling, practice with feedback, and coaching.

States, J. (2011). What Teacher Training Methods Result in Changes in Classroom Practices? Retrieved from what-teacher-training-methods.

How does performance feedback affect the way teachers carry out interventions?
This analysis examined the impact of performance feedback on the quality of implementation of interventions.
Detrich, R. (2015). How does performance feedback affect the way teachers carry out interventions? Retrieved from how-does-performance-feedback.
How often are treatment integrity measures reported in published research?
This analysis examined the frequency that treatment integrity is reported in studies of research-based interventions.
Detrich, R. (2015). How often are treatment integrity measures reported in published research? Retrieved from how-often-are-treatment.
How well are Interventions Implemented in Educational Settings?
This analysis examined two studies to understand the reliability of self-reporting of practitioners implementing interventions.
Detrich, R. (2015). How well are Interventions Implemented in Educational Settings? Retrieved from how-well-are-interventions.
Does Feedback Improve Performance?
This review is a summary of the effect size of the effectiveness feedback to improve both student and teacher performance.
States, J. (2011). Does Feedback Improve Performance? Retrieved from does-feedback-improve-performance.
Does professional development make a difference in student performance?
This analysis looks at a systematic review of teacher professional development on student achievement.
States, J. (2011). Does professional development make a difference in student performance? Retrieved from does-professional-development-make.
Is there empirical research to validate the use of prereferral intervention teams (PIT) to reduce special education referrals, achieve gains, or improve student conduct?
This is a review of a meta-analysis of Prereferral Intervention Teams on student and system outcomes.
States, J. (2011). Is there empirical research to validate the use of prereferral intervention teams (PIT) to reduce special education referrals, achieve gains, or improve student conduct? Retrieved from is-there-empirical-research.
How does coaching compare with traditional staff development in improving student achievement?
This analysis compares the effectiveness of coaching compared to traditional forms of professional development for teachers.
States, J. (2012). How does coaching compare with traditional staff development in improving student achievement? Retrieved from how-does-coaching-compare.
What evidence do principals rely on in assessing the quality of a teacher’s instruction?
This analysis examines principal sources of information on teacher instructional competency and the amount of time spent assessing teacher's instructional skills.
States, J. (2015). What evidence do principals rely on in assessing the quality of a teacher’s instruction? Retrieved from what-evidence-do-principals.

 

Presentations

TITLE
SYNOPSIS
CITATION
Performance Feedback: Use It or Lose It

This paper examines the importance of performance feedback systems at all levels of school, staff and student outcomes to achieve desired results over time.

Keyworth, R. (2011). Performance Feedback: Use It or Lose It [Powerpoint Slides]. Retrieved from 2011-aba-presentation-randy-keyworth.

Performance Feedback in Education: On Who and For What
This paper reviews the importance of feedback in education reviewed the scientific model of behavior change (antecedent, behavior, consequences).
Daniels, A. (2011). Performance Feedback in Education: On Who and For What [Powerpoint Slides]. Retrieved from 2011-wing-presentation-aubrey-daniels.
Using Student Data as a Basis for Feedback to Teachers
This paper offers an alternative to evaluating teachers based on student performance on annual high stakes tests.
Detrich, R. (2011). Using Student Data as a Basis for Feedback to Teachers [Powerpoint Slides]. Retrieved from 2011-aba-presentation-ronnie-detrich.
Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes
Treatment integrity is necessary to improve outcomes but it is not sufficient. It is also necessary to implement scientifically supported interventions.
Detrich, R. (2015). Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes [Powerpoint Slides]. Retrieved from 2015-ebpindisabilities-txint-presentation-ronnie-detrich.
Teacher Induction: Where the Rubber Meets the Road
The paper examines one of the most critical components of teach training: an on-the-job, ongoing system of coaching and performance feedback to improve skill acquisition, generalization and maintenance.
Keyworth, R. (2010). Teacher Induction: Where the Rubber Meets the Road [Powerpoint Slides]. Retrieved from 2010-aba-presentation-randy-keyworth.
School Reform and Culture Change: What We Missed
This analysis reviews the ongoing failure of school reform efforts in the context of poor teacher preparation and performance feedback.
Keyworth, R. (2012). School Reform and Culture Change: What We Missed [Powerpoint Slides]. Retrieved from 2012-wing-presentation-randy-keyworth.
Teacher Coaching: The Missing Link in Teacher Professional Development
Research suggests that coaching is one of the most effective strategies in training teachers. This paper identifies the critical practice elements of coaching and their absence in teacher training.
Keyworth, R. (2013). Teacher Coaching: The Missing Link in Teacher Professional Development [Powerpoint Slides]. Retrieved from 2013-calaba-presentation-randy-keyworth.

 

Student Research

TITLE
SYNOPSIS
CITATION
Effects of a problem solving team intervention on the problem-solving process: Improving concept knowledge, implementation integrity, and student outcomes.

This study evaluated the effects of a problem solving intervention package that included problem-solving information, performance feedback, and coaching in a student intervention planning protocol.

Vaccarello, C. A. (2011). Effects of a problem solving team intervention on the problem-solving process: Improving concept knowledge, implementation integrity, and student outcomes. Retrieved from student-research-2011.

TITLE
SYNOPSIS
CITATION
Introduction: Proceedings from the Wing Institute’s Sixth Annual Summit on Evidence-Based Education: Performance Feedback: Using Data to Improve Educator Performance.

This book is compiled from the proceedings of the sixth summit entitled “Performance Feedback: Using Data to Improve Educator Performance.” The 2011 summit topic was selected to help answer the following question: What basic practice has the potential for the greatest impact on changing the behavior of students, teachers, and school administrative personnel?

States, J., Keyworth, R. & Detrich, R. (2013). Introduction: Proceedings from the Wing Institute’s Sixth Annual Summit on Evidence-Based Education: Performance Feedback: Using Data to Improve Educator Performance. In Education at the Crossroads: The State of Teacher Preparation (Vol. 3, pp. ix-xii). Oakland, CA: The Wing Institute.

 

 

Teachers and student achievement in the Chicago Public High Schools

The authors estimate the importance of teachers in Chicago public high schools using matched student-teacher administrative data. 

Aaronson, D., Barrow, L., & Sander, W. (2007). Teachers and student achievement in the Chicago public high schools. Journal of labor Economics25(1), 95-135.

Coaching side by side: One-on-one collaboration creates caring, connected teachers

This article describes a school district administrator's research on optimal coaching experiences for classroom teachers. This research was done with the intent of gaining a better understanding of how coaching affects student learning. 

Akhavan, N. (2015). Coaching side by side: One-on-one collaboration creates caring, connected

teachers. Journal of Staff Development, 36,34-37.

 

Pushing the horizons of student teacher supervision: Can a bug-in-ear system be an effective plug-and-play tool for a novice electronic coach to use in student teacher supervision? ProQuest Dissertations and Theses.

This case study explored the use of the Bug-in-Ear (BIE) tool for undergraduate student-teacher supervision in the hands of a novice BIE2 coach, including the ease with which BIE equipment can be set up and operated by a novice coach and naïve users in the classroom. 

Almendarez, M. B., Zigmond, N., Hamilton, R., Lemons, C., Lyon, S., McKeown, M., Rock, M. (2012). Pushing the horizons of student teacher supervision: Can a bug-in-ear system be an effective plug-and-play tool for a novice electronic coach to use in student teacher supervision? ProQuest Dissertations and Theses.

The effectiveness of a technologically facilitated classroom-based early reading intervention: The targeted reading intervention

The purpose of this study was to evaluate the efficacy of a classroom-teacher-delivered reading intervention for struggling readers called the Targeted Reading Intervention (TRI), designed particularly for kindergarten and first-grade teachers and their struggling students in rural, low-wealth communities. 

Amendum, S. J., Vernon-Feagans, L., & Ginsberg, M. C. (2011). The effectiveness of a technologically facilitated classroom-based early reading intervention: The targeted reading intervention. The Elementary School Journal112(1), 107-131.

ASA statement on using value-added models for educational assessment

Value-Added Models (VAMs) has been embraced by many states and school districts as part of educational accountability systems. Value-Added Assessment (VAA) Models attempt to estimate effects of individual teachers or schools on student achievement while accounting for differences in student background. This paper provides a summary of the American Statistical Associations analysis of the efficacy of value-added modeling in education.

American Statistical Association. (2014). ASA statement on using value-added models for educational assessment. Alexandria, VA.

Instructional Coaching: Professional development strategies that improve instruction

This article discusses instructional coaching as well as the eight factors that can increase the likelihood that coaching will be a real fix for a school. Instructional coaching holds much potential for improving the way teachers teach and the way students learn, but that potential will only be realized if leaders plan their coaching program with care. 

Annenburg Institute for School Reform. (2004). Instructional Coaching: Professional development strategies that improve instruction. 

Increasing Pre-service Teachers’ Use of Differential Reinforcement: Effects of Performance Feedback on Consequences for Student Behavior

Differential reinforcement of appropriate behavior is an important skill for classroom teachers. This study examined the use of performance feedback to increase the rate of differential reinforcement by pre-service teachers.

Auld, R. G., Belfiore, P. J., & Scheeler, M. C. (2010). Increasing Pre-service Teachers’ Use of Differential Reinforcement: Effects of Performance Feedback on Consequences for Student Behavior. Journal of Behavioral Education, 19(2), 169-183.

Questioning the Author: An approach for enhancing student engagement with text

The book presents many examples of Questioning the Author (QtA) in action as children engage with narrative and expository texts to construct meaning.

Beck, I. L., & McKeown, M. G., Hamilton, R. L., & Kugan, L. (1997). Questioning the Author: An approach for enhancing student engagement with text.Newark, DE: International Reading Association.

 

Questioning the Author: An approach for enhancing student engagement with text

The book presents many examples of Questioning the Author (QtA) in action as children engage with narrative and expository texts to construct meaning.

Beck, I. L., & McKeown, M. G., Hamilton, R. L., & Kugan, L. (1997). Questioning the Author: An approach for enhancing student engagement with text.Newark, DE: International Reading Association.

 

Growth, Standards and Accountability

This paper introduces analysis techniques and results showing how student growth percentiles, a normative growth analysis technique, can be used to examine the illuminate the relationship between standards based accountability systems and the performance standards on which they are based.

Betebenner, D. (2009). Growth, standards and accountability. Dover, NH: National Center for the Improvement of Educational Assessment. Retrieved from https://www.nciea.org/sites/default/files/publications/growthandStandard_DB09.pdf

Effects of coaching on teachers’ use of function-based interventions for students with severe disabilities

This study used a delayed multiple-baseline across-participants design to analyze the effects of coaching on special education teachers’ implementation of function-based interventions with students with severe disabilities. This study also examined the extent to which teachers could generalize function-based interventions in different situations. 

Bethune, K. S., & Wood, C. L. (2013). Effects of coaching on teachers’ use of function-based interventions for students with severe disabilities. Teacher Education and Special Education, 36(2), 97-114.

 

Professional development and teacher learning: Mapping the terrain

Teacher professional development is essential to efforts to improve our schools. This article maps the terrain of research on this important topic. It first provides an overview of what we have learned as a field, about effective professional development programs and their impact on teacher learning. 

Borko, H. (2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher30(8), 3–15.

The value in value added depends on the ecology.

These five articles begin to build a bridge between literature. specifically, they report on how the use of the indicators derived from value-added models (VAM) actually payout in practice and give carefully consideration to how the design and implementation of teacher evaluation system could be modified to enhance the positive impact of accountability and mitigate the negative consequences,

Braun, H. (2015). The value in value added depends on the ecology. Educational Researcher, 44(2), 127–131. Retrieved from https://doi.org/10.3102%2F0013189X15576341

Professional community in Chicago elementary schools: Facilitating factors and organizational consequences.

Using data from a large urban school district, this article tests the impact of structural, human, and social factors on the emergence of school-based professional community and examines the extent to which such developments in turn promote learning and experimentation among faculty

Bryk, A., Camburn, E., & Louis, K. S. (1999). Professional community in Chicago elementary schools: Facilitating factors and organizational consequences. Educational Administration Quarterly, 35(5), 751–781. https://www.researchgate.net/profile/Karen_Louis/publication/249684711_Professional_Community_in_Chicago_Elementary_Schools_Facilitating_Factors_and_Organizational_Consequences/links/5845de4f08ae8e63e6286a05/Professional-Community-in-Chicago-Elementary-Schools-Facilitating-Factors-and-Organizational-Consequences.pdf

 

 
Using performance feedback to enhance implementation fidelity of the problem-solving team process

This study examines the importance of implementation integrity for problem-solving teams (PST) and response-to-intervention models.

Burns, M. K., Peters, R., & Noell, G. H. (2008). Using performance feedback to enhance implementation fidelity of the problem-solving team process. Journal of School Psychology, 46(5), 537-550.

Using performance feedback to enhance implementation fidelity of the problem-solving team process

This study examines the importance of implementation integrity for problem-solving teams (PST) and response-to-intervention models.

Burns, M. K., Peters, R., & Noell, G. H. (2008). Using performance feedback to enhance implementation fidelity of the problem-solving team process. Journal of School Psychology, 46(5), 537-550.

The Long-Term Impacts Of Teachers: Teacher Value-Added And Student Outcomes In Adulthood

This paper examines the issue of efficacy of value-added measures in evaluating teachers. This question is important in understanding whether value-added analysis provides unbiased estimates of teachers’ impact on student achievement and whether these teachers improve long-term student outcomes.

Chetty, R., Friedman, J. N., & Rockoff, J. E. (2011). The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood (No. w17699). National Bureau of Economic Research.

How does your kindergarten classroom affect your earnings? Evidence from Project STAR.

This paper evaluates the long-term impacts of STAR by linking the experimental data to administrative records.

Chetty, R., Friedman, J., Hilger, N., Saez, E., Schanzenbach, D. W., & Yagan, D. (2011). How does your kindergarten classroom affect your earnings? Evidence from Project STAR. Quarterly Journal of Economics, 126(4), 1593–1660.

Overview: Formal Teacher Evaluation

The purpose of this overview is to provide information about the role of formal teacher evaluation, the research that examines the practice, and its impact on student outcomes.

Cleaver, S., Detrich, R. & States, J. (2018). Overview of Teacher Formal Evaluation. Oakland, CA: The Wing Institute.https://www.winginstitute.org/teacher-evaluation-formal.

Value-Added Research in Education: Reliability, Validity, Efficacy, and Usefulness

The purpose of this paper on value-added research in education is to define this type of research, provide an overview of how it has been conducted, and discuss its benefits and limitations.

Cleaver, S., Detrich, R. & States, J. (2020). Overview of Value-Added Research in Education: Reliability, Validity, Efficacy, and Usefulness. Oakland, CA: The Wing Institute. https://www.winginstitute.org/staff-value-added.

  

Effects of immediate performance feedback on implementation of behavior support plans, 2005

The purpose of this study is to examine the effects of feedback on treatment integrity for implementing behavior support plans.

Codding, R. S., Feinberg, A. B., Dunn, E. K., & Pace, G. M. (2005). Effects of immediate performance feedback on implementation of behavior support plans. Journal of Applied Behavior Analysis, 38(2), 205-219.

Teacher heterogeneity, value-added and education policy.

This study examines the theoretical and practical implications of ranking teachers with a one-dimensional value-added metric when teacher effectiveness varies across subjects or student types.

Condie, S., Lefgren, L., & Sims, D. (2014). Teacher heterogeneity, value-added and education policy. Economics of Education Review40, 76-92.

Introduction to classical and modern test theory.

This text was written to help the reader acquire a base of knowledge about classical psychometrics and to integrate new ideas into that framework of knowledge.

Crocker, L. M., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart and Winston.

Performance Feedback in Education: On Who and For What

This paper reviews the importance of feedback in education reviewed the scientific model of behavior change (antecedent, behavior, consequences).

Daniels, A. (2013). Feedback in Education: On Whom and for What. In Performance Feedback: Using Data to Improve Educator Performance (Vol. 3, pp. 77-95). Oakland, CA: The Wing Institute.

What research says about using value-added measures to evaluate teachers.

A growing number of researchers are studying whether value-added measures can do a good job of measuring the contribution of teachers to test score growth. Here I summarize a handful of analyses that shed light on two questions.

David, J. L. (2010). What research says about using value-added measures to evaluate teachers. Educational Leadership, 67(8), 81–82. Retrieved from http://www.ascd.org/publications/educational_leadership/may10/vol67/num08/Using_Value-Added_Measures_to_Evaluate_Teachers.aspx

Treatment integrity: A wicked problem and some solutions

Presentation by Wing Institute with goals: Make the case that treatment integrity monitoring is a necessary part of service delivery; describe dimensions of treatment integrity; suggest methods for increasing treatment integrity; place treatment integrity within systems framework . 

Detrich, R. (2015). Treatment integrity: A wicked problem and some solutions. Missouri Association for Behavior Analysis 2015 Conference. http://winginstitute.org/2015-MissouriABA-Presentation-Ronnie-Detrich

Innovation, Implementation Science, and Data-Based Decision Making: Components of Successful Reform

Over the last fifty years, there have been many educational reform efforts, most of which have had a relatively short lifespan and failed to produce the promised results. One possible reason for this is for the most part these innovations have been poorly implemented. In this chapter, the author proposes a data-based decision making approach to assuring high quality implementation.

Detrich, R. Innovation, Implementation Science, and Data-Based Decision Making: Components of Successful Reform. In M. Murphy, S. Redding, and J. Twyman (Eds). Handbook on Innovations in Learning, 31. Charlotte, NC: Information Age Publishing

Effects of public feedback during RTI team meetings on teacher implementation integrity and student academic performance.

This study evaluated the impact of public feedback in RtI team meetings on the quality of implementation.  Feedback improved poor implementation and maintained high level implementation.

Duhon, G. J., Mesmer, E. M., Gregerson, L., & Witt, J. C. (2009). Effects of public feedback during RTI team meetings on teacher implementation integrity and student academic performance. Journal of School Psychology, 47(1), 19-37.

An Exploration of Teacher Acceptability of Treatment Plan Implementation: Monitoring and Feedback Methods.

This paper summarizes survey results about the acceptability of different methods for monitoring treatment integrity and performance feedback.

Easton, J. E., & Erchul, W. P. (2011). An Exploration of Teacher Acceptability of Treatment Plan Implementation: Monitoring and Feedback Methods. Journal of Educational & Psychological Consultation, 21(1), 56-77. Retrieved from http://www.tandfonline.com/doi/abs/10.1080/10474412.2011.544949?journalCode=hepc20.

Value-added modeling and educational accountability: Are we answering the real questions?

Value-added estimates of teacher or school quality are increasingly used for both high- and low-stakes accountability purposes, making understanding of their limitations critical.

Everson, K. C. (2017). Value-added modeling and educational accountability: Are we answering the real questions?. Review of Educational Research87(1), 35-70.

Promoting teachers' implementation of culturally and contextually relevant class-wide behavior plans

Research suggests student of differing racial groups are unequally impacted by school disciplinary interventions. This study examines whether teachers who self-assessed their own use of culturally and contextually relevant practices would implement a class-wide behavior plan with high levels of implementation fidelity. Results indicated that teachers who engaged in self-assessment and training did implement the plan with high levels of implementation fidelity, particularly when given performance feedback. 

Fallon, L. M., Cathcart, S. C., DeFouw, E. R., O'Keeffe, B. V., & Sugai, G. Promoting teachers’ implementation of culturally and contextually relevant class‐wide behavior plans. Psychology in the Schools.

Stand by me: What teachers say about unions, merit pay, and other professional matters

This paper exams teachers' views on unions, tenure, pay-for-performance, alternative certification, and other issues and finds that while most teachers are strong supporters of standards, a sense of vulnerability, along with fears of politics and favoritism, make them loyal to the tenure system, loyal to their unions, and highly skeptical about pay tied to student test scores.

Farkas, S., Johnson, J., & Duffett, A. (2003). Stand by me: What teachers say about unions,

merit pay, and other professional matters. New York: Public Agenda.

Administrator career paths and decision processes: Evidence from Delaware

The purpose of this paper is to present qualitative evidence on the processes and forces that shape school administrator career paths.

Farley-Ripple E. N., Raffel, J. A., & Welch, J. C. (2012). Administrator career paths and decision processes: Evidence from Delaware. Journal of Educational Administration50(6), 788–816.

Coaching middle-level teachers to think aloud improves comprehension instruction and student reading achievement
In an effort to improve student achievement, a group of middle-school teachers at an underperforming school developed a school-wide literacy plan. As part of the plan, they agreed to model their thinking while reading aloud. Eight teachers were selected for coaching related to thinking aloud in which they exposed students to comprehension strategies that they used while reading. 

Fisher, D., Frey, N., & Lapp, D. (2011). Coaching middle-level teachers to think aloud improves comprehension instruction and student reading achievement. The Teacher Educator, 46(3), 231-243.

Strategies for Effective Classroom Coaching

This article aimed to present frameworks and practices coaches can use with classroom teachers to facilitate the implementation of evidence-based interventions in schools.

Garbacz, S. A., Lannie, A. L., Jeffrey-Pearsall, J. L., & Truckenmiller, A. J. (2015). Strategies for effective classroom coaching. Preventing School Failure: Alternative Education for Children and Youth59(4), 263-273.

Supporting teacher use of interventions: effects of response dependent performance feedback on teacher implementation of a math intervention

This study examined general education teachers’ implementation of a peer tutoring intervention for five elementary students referred for consultation and intervention due to academic concerns. Treatment integrity was assessed via permanent products produced by the intervention.

Gilbertson, D., Witt, J. C., Singletary, L. L., & VanDerHeyden, A. (2007). Supporting teacher use of interventions: Effects of response dependent performance feedback on teacher implementation of a math intervention. Journal of Behavioral Education, 16(4), 311-326.

Is it just a bad class? Assessing the stability of measured teacher performance.

This paper report on work estimating the stability of value-added estimates of teacher effects, an important area of investigation given that new workforce policies implicitly assume that effectiveness is a stable attribute within teachers. 

Goldhaber, D. D., & Hansen, M. (2008). Is it Just a Bad Class?: Assessing the Stability of Measured Teacher Performance. Seattle, WA: Center on Reinventing Public Education.

Make room value added: Principals’ human capital decisions and the emergence of teacher observation data.

Interview and survey data from six school districts that have recently implemented new evaluation systems with classroom observations provide evidence that principals tend to rely less on test scores in their human capital decisions. 

Goldring, E., Grissom, J. A., Rubin, M., Neumerski, C. M., Cannata, M., Drake, T., & Schuermann, P. (2015). Make room value added: Principals’ human capital decisions and the emergence of teacher observation data. Educational Researcher44(2), 96-104.

Treatment integrity of school-based behavioral intervention studies: 1980-1990

This study reviewed the reporting rates of treatment integrity for school based interventions.

Gresham, F. M., & Gansle, K. A. (1993). Treatment integrity of school-based behavioral intervention studies: 1980-1990. School Psychology Review, 254. 

Treatment integrity in applied behavior analysis with children.

This study reviewed all intervention studies published between 1980-1990 in Journal of Applied Behavior Analysis in which children were the subjects of the study. The authors found that treatment integrity was reported in only 16% of the studies.

Gresham, F. M., Gansle, K. A., & Noell, G. H. (1993). Treatment ?integrity in ?applied behavior analysis with children. Journal of Applied ?Behavior Analysis, 26(2), 257-263.

Treatment integrity in learning disabilities intervention research: Do we really know how treatments are implemented

The authors reviewed three learning disabilities journals between 1995-1999 to determine what percent of the intervention studies reported measures of treatment integrity. Only 18.5% reported treatment integrity measures.

Gresham, F. M., MacMillan, D. L., Beebe-Frankenberger, M. E., & Bocian, K. M. ?(2000). Treatment integrity in learning disabilities intervention research: Do we really know how treatments are implemented. Learning Disabilities ?Research & Practice, 15(4), 198-205.

What works in professional development?

A research synthesis confirms the difficulty of translating professional development into student achievement gains despite the intuitive and logical connection. Those responsible for planning and implementing professional development must learn how to critically assess and evaluate the effectiveness of what they do.

Guskey, T. R., & Yoon, K. S.(2009). What works in professional development? Phi Delta Kappan.doi: 10.1177003172170909000709.

Generalizations about using value-added measures of teacher quality.

The precise method of attributing differences in classroom achievement to teachers is the
subject of considerable discussion and analysis.

Hanushek, E. A., & Rivkin, S. G. (2010). Generalizations about using value-added measures of teacher quality. American Economic Review100(2), 267-71.

The role of cognitive skills in economic development.

This paper reviews the role of cognitive skills in promoting economic well-being, with a particular focus on the role of school quality and quantity.

Hanushek, E. A., & Woessmann, L. (2008). The role of cognitive skills in economic development. Journal of economic literature46(3), 607-68.

Balancing Fidelity With Flexibility and Fit: What Do We Really Know About Fidelity of Implementation in Schools

This paper suggests a model for selecting interventions that match the context of classrooms.

Harn, B., Parisi, D., & Stoolmiller, M. (2013). Balancing fidelity with flexibility and Fit: What do we really know about fidelity of implementation in schools?. Exceptional Children, 79(2), 181-193.

Skills, productivity, and the evaluation of teacher performance.

The authors examine the relationships between observational ratings of teacher performance, principals’ evaluations of teachers’ cognitive and non-cognitive skills and test-score based measures of teachers’ productivity. 

Harris, D. N., & Sass, T. R. (2014). Skills, productivity and the evaluation of teacher performance. Economics of Education Review40, 183-204.

Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems

This article discusses the current focus on using teacher observation instruments as part of new teacher evaluation systems being considered and implemented by states and districts. 

Hill, H., & Grossman, P. (2013). Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems. Harvard Educational Review, 83(2), 371-384.

The mirage: Confronting the hard truth about our quest for teacher development

This piece describes the widely held perception among education leaders that we already  know how to help teachers improve, and that we could achieve our goal of great teaching in far more classrooms if we just applied what we know more widely. 

Jacob, A., & McGovern, K. (2015). The mirage: Confronting the hard truth about our quest for teacher development. Brooklyn, NY: TNTP. https://tntp.org/assets/documents/TNTP-Mirage_2015.pdf.

 

Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education

This paper examines how well principals can distinguish between more and less effective teachers. To put principal evaluations in context, we compare them with the traditional determinants of teacher compensation-education and experience-as well as value-added measures of teacher effectiveness.

Jacob, B. A., & Lefgren, L. (2008). Can principals identify effective teachers? Evidence on subjective performance evaluation in education. Journal of Labor Economics, 26(1), 101-136.

Teacher perspectives on evaluation reform: Chicago’s REACH students.

This study draws on 32 interviews from a random sample of teachers and 2 years of survey data from more than 12,000 teachers per year to measure their perceptions of the clarity, practicality, and cost of the new system.

Jiang, J. Y., Sporte, S. E., & Luppescu, S. (2015). Teacher perspectives on evaluation reform: Chicago’s REACH students. Educational Researcher44(2), 105-116.

Student Achievement through Staff Development

This book provides research as well as case studies of successful professional development strategies and practices for educators.

Joyce, B. R., & Showers, B. (2002). Student achievement through staff development. ASCD.

Assessing the cost of instructional coaching.

this study presents and apply a framework for measuring the cost of coaching programs to 3 schools. Then the study discusses strategies for reducing the average cost of instructional coaching. 

Knight, D. S. (2012). Assessing the cost of instructional coaching. Journal of Education Finance, 52-80.

A measured approach: Value-added models are a promising improvement, but no one measure can evaluate teacher performance

The education policy community is abuzz with interest in value-added modeling as a way to estimate the effectiveness of schools and especially teachers. Value-added models provide useful information, but that information is error-prone and has a number of other important limitations.

Koretz, D. (2008). A measured approach. American Educator32(2), 18-39.

The validity of gains on the Kentucky Instructional Results Information System (KIRIS).

This study evaluated the extent to which the large performance gains shown on KIRIS represented real improvements in student learning rather than inflation of scores. 

Koretz, D. M., & Barron, S. I. (1998). The validity of gains on the Kentucky instructional results information system. KIRIS). Santa Monica: RAND.

The effect of teacher coaching on instruction and achievement: A meta-analysis of the causal evidence

This study review the empirical literature on teacher coaching and conduct meta-analyses to estimate the mean effect of coaching programs on teachers’ instructional practice and students’ academic achievement.

Kraft, M. A., Blazar, D., & Hogan, D. (2018). The effect of teacher coaching on instruction and achievement: A meta-analysis of the causal evidence. Review of Educational Research88(4), 547-588.

Using Coaching to improve the Fidelity of Evidence-Based Practices: A Review of Studies

The authors conducted a comprehensive review of research to identify the impact of coaching on changes in preservice and in-service teachers’ implementation of evidence-based practices.

Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education33(4), 279-299.

Using in-service and coaching to increase teachers’ accurate use of research-based strategies

This study examined the effects of in-service plus follow-up coaching on first grade teachers’ accurate delivery of three research-based strategies during math instruction.

Kretlow, A. G., Cooke, N. L., & Wood, C. L. (2012). Using in-service and coaching to increase teachers’ accurate use of research-based strategies. Remedial and Special Education33(6), 348-361.

Using in-service and coaching to increase kindergarten teachers’ accurate delivery of group instructional units.

This study examined the effects of in-service support plus coaching on kindergarten teachers’ accurate delivery of group instructional units in math.

Kretlow, A. G., Wood, C. L., & Cooke, N. L. (2011). Using in-service and coaching to increase kindergarten teachers’ accurate delivery of group instructional units. The Journal of Special Education44(4), 234-246.

What matters for elementary literacy coaching? Guiding principles for instructional improvement and student achievement

The seven guiding principles in this manuscript offer research-based directions for literacy coaching.

L’Allier, S., Elish-Piper, L., & Bean, R. M. (2011). What matters for elementary literacy coaching? Guiding principles for instructional improvement and student achievement. The Reading Teacher, 63,544-554. doi: 10.1598/RT.63.7.2

Teacher Incentives

Three questions are addressed. First, what are the principles behind creating optimal teacher incentives, and how close do the actual structures in Sweden and the US conform to the ideal ones? Second, how much is performance affected by creating incentives for current teachers, and how much by changing the pool of teacher applicants? Third, do teacher preferences align with those of their students and of society in general, and if not, why not? Associated with each of these questions are policy implications that may remedy existing distortions.

Lazear, E. P. (2003). Teacher incentives. Swedish Economic Policy Review10(2), 179-214.

The sensitivity of value-added teacher effect estimates to different mathematics achievement measures.

Using longitudinal data from a cohort of middle school students from a large school district,
we estimate separate “value‐added” teacher effects for two subscales of a mathematics
assessment under a variety of statistical models varying in form and degree of control for
student background characteristics.

Lockwood, J. R., McCaffrey, D. F., Hamilton, L. S., Stecher, B., Le, V. N., & Martinez, J. F. (2007). The sensitivity of value‐added teacher effect estimates to different mathematics achievement measures. Journal of Educational Measurement44(1), 47-67.

Distorting value-added: The use of longitudinal, vertically scaled student achievement data for growth-based, value-added accountability.

This study demonstrates mathematically that the use of such “construct-shifting” vertical scales in longitudinal, value-added models introduces remarkable distortions in the value-added estimates of the majority of educators

Martineau, J. A. (2006). Distorting value-added: The use of longitudinal, vertically scaled student achievement data for growth-based, value-added accountability. Journal of Educational and Behavioral Statistics, 31(1), 35–62.

The effect of content-focused coaching on the quality of classroom text discussions

This study examines the effect of a comprehensive literacy-coaching program focused on enacting a discussion-based approach to reading comprehension instruction (content-focused coaching [CFC]) on the quality of classroom text discussions over 2 years.

Matsumura, L. C., Garnier, H.E., Spybrook, J. (2012). The effect of content-focused coaching on the quality of classroom text discussions. Journal of Teacher Education, 63,214-228.

Do value-added methods level the playing field for teachers? Carnegie Knowledge Network

In this brief, we discuss what is and is not known about how well value‐added measures level the playing field for teachers by controlling for student characteristics. 

McCaffrey, D. F. (2012). Do value-added methods level the playing field for teachers. Carnegie Knowledge Network.

Is value-added accurate for teachers of students with disabilities

In this brief, we discuss the challenges of using value-added to evaluate teachers of students with disabilities.

McCaffrey, D. F., & Buzick, H. (2014). Is value-added accurate for teachers of students with disabilities. Carnegie Knowledge Network Brief, (14).

Missing data in value-added modeling of teacher effects

The current study extends recent value-added modeling approaches for longitudinal student achievement data Lockwood et al. [J. Educ. Behav. Statist. 32 (2007) 125–150] to allow data to be missing not at random via random effects selection and pattern mixture models, and applies those methods to data from a large urban school district to estimate effects of elementary school mathematics teachers. 

McCaffrey, D. F., & Lockwood, J. R. (2011). Missing data in value-added modeling of teacher effects. The Annals of Applied Statistics, 773-797.

Evaluating Value-Added Models for Teacher Accountability. Monograph.

Value added modeling has become of interest to policymakers interested in evaluating teacher performance.  The authors argue that the models work well when the schools in the sample are homogenous but as heterogeneity of the student population  increases estimates of teacher effects are likely to confounded.

McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., & Hamilton, L. S. (2003). Evaluating Value-Added Models for Teacher Accountability. Monograph. ERIC. Retrieved from http://eric.ed.gov/?id=ED529961

Early intervention in reading: From research to practice

This study documents the implementation of research-based strategies to minimize the occurrence of reading difficulties in a first-grade population. Three strategies were implemented. 

Menzies, H. M, Mahdavi, J. N., & Lewis, J. L. (2008). Early intervention in reading: From research to practice. Remedial and Special Education, 29(2), 67-77.

The relationship between standards-based teacher evaluation scores and student achievement: Replication and extensions at three sites

This paper reports on the results of the analysis of an additional year of evaluation and student achievement data at some research.

Milanowski, A. T., Kimball, S. M., & White, B. (2004). The Relationship Between Standards-Based Teacher Evaluation Scores and Student Achievement: Replication and Extensions at Three Sites Consortium for Policy Research in Education (CPRE)-University of Wisconsin Working Paper Series. TC4(01).

The Use of Weekly Performance Feedback to Increase Teacher Implementation of a Pre-referral Academic Intervention.

This study evaluated the effects of performance feedback on the implementation of a classroom intervention.

Mortenson, B. P., & Witt, J. C. (1998). The use of weekly performance feedback to increase teacher implementation of a prereferral academic intervention. School Psychology Review, 613-627. 

How important are the cognitive skills of teenagers in predicting subsequent earnings?

How important are teenagers' cognitive skills in predicting subsequent labor market success? Do cognitive skills pay off in the labor market only for students who go to college? Does college benefit only students who enter with strong basic skills? These questions are often part of current policy debates about how to improve the earnings prospects for young Americans. 

Murnane, R. J., Willett, J. B., Duhaldeborde, Y., & Tyler, J. H. (2000). How important are the cognitive skills of teenagers in predicting subsequent earnings?. Journal of Policy Analysis and Management19(4), 547-568.

Promoting language and literacy development for early childhood educators: A mixed-methods study of coursework and coaching

This study examines the impact of 2 forms of professional development on prekindergarten teachers' early language and literacy practice: coursework and coaching. 

Neuman, S. B., & Wright, T. S. (2010). Promoting language and literacy development for early childhood educators: A mixed-methods study of coursework and coaching. Elementary School Journal, 11,63-86. No Child Left Behind Act of 2001, P.L. 107-110, 20 U.S.C. § 6319 (2002).

No Child Left Behind Act of 2001

No Child Left Behind Act of 2001 ESEA Reauthorization

No child left behind act of 2001. Publ. L, 107-110. (2002)

Increasing intervention implementation in general education following consultation: A comparison of two follow-up strategies.

This study compared the effects of discussing issues of implementation challenges and performance feedback on increasing the integrity of implementation. Performance feedback was more effective than discussion in increasing integrity.

Noell, G. H., & Witt, J. C. (2000). Increasing intervention implementation in general education following consultation: A comparison of two follow-up strategies. Journal of Applied Behavior Analysis, 33(3), 271.

Increasing teacher intervention implementation in general education settings through consultation and performance feedback

This study evaluated the effects of consultation and performance feedback in a public school setting.

Noell, G. H., Witt, J. C., Gilbertson, D. N., Ranier, D. D., & Freeland, J. T. (1997). ?Increasing teacher intervention implementation in general education settings through consultation and performance feedback. School Psychology Quarterly, 12(1), 77-88.

Increasing Teacher Intervention Implementation in General Education Settings through Consultation and Performance Feedback

This study looks at treatment integrity with which general education teachers implemented a reinforcement based intervention designed to improve the academic performance of elementary school students.

Noell, G. H., Witt, J. C., Gilbertson, D. N., Ranier, D. D., & Freeland, J. T. (1997). Increasing teacher intervention implementation in general education settings through consultation and performance feedback. School Psychology Quarterly, 12(1), 77.

Effects of an early literacy professional development intervention on Head Start teachers and children

Effects of a 1-semester professional development (PD) intervention that included expert coaching with Head Start teachers were investigated in a randomized controlled trial with 88 teachers and 759 children. 

Powell, D. R., Diamond, K. E., Burchinal, M. R., & Koehler, M. J. (2010). Effects of an early literacy professional development intervention on Head Start teachers and children. Journal of Educational Psychology, 102, 299-312.

Using Coaching to Support Teacher Implementation of Classroom-based Interventions.

This study evaluted the impact of coaching on the implementation of an intervention.  Coaching with higher rates of performance feedback resulted in the highest level of treatment integrity.

Reinke, W., Stormont, M., Herman, K., & Newcomer, L. (2014). Using Coaching to Support Teacher Implementation of Classroom-based Interventions. Journal of Behavioral Education, 23(1), 150-167.

Teachers, schools, and academic achievement.

This paper disentangles the impact of schools and teachers in influencing achievement with special attention given to the potential problems of omitted or mismeasured variables and of student and school selection. 

Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica73(2), 417-458.

Teacher quality in educational production: Tracking, decay, and student achievement.

The author develop falsification tests for three widely used VAM specifications, based on the idea that future teachers cannot influence students' past achievement. 

Rothstein, J. (2010). Teacher quality in educational production: Tracking, decay, and student achievement. The Quarterly Journal of Economics125(1), 175-214.

A randomized controlled trial of COMPASS web-based and face-to-face teacher coaching in autism

Most children with autism rely on schools as their primary source of intervention, yet research has suggested that teachers rarely use evidence-based practices. To address the need for improved educational outcomes, a previously tested consultation intervention called the Collaborative Model for Promoting Competence and Success was evaluated in a 2nd randomized controlled trial, with the addition of a web-based group. 

Ruble, L. A., McGrew, J. H., Toland, M. D., Dalrymple, N. J., & Jung, L. (2013). A randomized controlled trial of COMPASS web-based and face-to-face teacher coaching in autism. Journal of Consulting and Clinical Psychology, 81, 566-572.

Using value-added models to measure teacher effects on students’ motivation and achievement

Using data from 35 seventh-grade teachers and 2,026 students across seven schools, we employ VA methods to measure teacher contributions to students’ motivational orientations (mastery and performance achievement goals) and their mathematics performance. 

Ruzek, E. A., Domina, T., Conley, A. M., Duncan, G. J., & Karabenick, S. A. (2015). Using value-added models to measure teacher effects on students’ motivation and achievement. The Journal of Early Adolescence35(5-6), 852-882.

Professional development for cognitive reading strategy instruction

In this article, we describe and report on the results of a study in Texas that tested 2 models of professional development for classroom teachers as a way of improving their practices and increasing the reading achievement of their students. 

Sailors, M., & Price, L. (2010). Professional development for cognitive reading strategy instruction. Elementary School Journal, 110,301-323.

 

Research Findings from the Tennessee Value-Added Assessment System (TVAAS) Database: Implications for Educational Evaluation and Research

The Tennessee Value-Added Assessment System determines the effectiveness of school systems, schools, and teachers based on student academic growth over time.

Sanders, W. L., & Horn, S. P. (1998). Research findings from the Tennessee Value-Added Assessment System (TVAAS) database: Implications for educational evaluation and research. Journal of Personnel Evaluation in Education12(3), 247-256.

Treatment integrity assessment within a problem-solving model

The purpose of this chapter is to explain the role of treatment integrity assessment within the “implementing solutions” stage of a problem-solving model.

Sanetti, L. H., & Kratochwill, T. R. (2005). Treatment integrity assessment within a problem-solving model. Assessment for intervention: A problem-solving approach, 314-325.

Treatment Integrity of Interventions With Children in the Journal of Positive Behavior Interventions: From 1999 to 2009

The authors reviewed all intervention studies published in the Journal of Positive Behavior Interventions between 1999-2009 to determine the percent of those studies that reported a measure of treatment integrity. Slightly more than 40% reported a measure of treatment integrity.

Sanetti, L. M. H., Dobey, L. M., & Gritter, K. L. (2012). Treatment Integrity of Interventions With Children in the Journal of Positive Behavior Interventions: From 1999 to 2009. Journal of Positive Behavior Interventions, 14(1), 29-46.

Treatment integrity of interventions with children in the school psychology literature from 1995 to 2008

The authors reviewed four school psychology journals between 1995-2008 to estimate the percent of intervention studies that reported some measure of treatment integrity. About 50% reported a measure of treatment integrity.

Sanetti, L. M. H., Gritter, K. L., & Dobey, L. M. (2011). Treatment integrity of interventions with children in the school psychology literature from 1995 to 2008. School Psychology Review, 40(1), 72-84.

Effects of multilevel support on first-grade teachers’ use of research-based strategies during beginning reading instruction

The purpose of this study was to examine the effects of multilevel support on first-grade teachers' accurate use of research-based strategies during beginning reading instruction and the extent to which teachers maintained use of these strategies. 

Schnorr, C. I. (2013). Effects of multilevel support on first-grade teachers' use of research-based strategies during beginning reading instruction (Doctoral dissertation, The University of North Carolina at Charlotte).

Incorporating student performance measures into teacher evaluation systems.

the authors examine how the five profiled systems are addressing assessment quality, evaluating teachers in nontested subjects and grades, and assigning teachers responsibility for particular students. The authors also examine what is and is not known about the quality of various student performance measures used by school systems.

Steele, J. L., Hamilton, L. S., & Stecher, B. M. (2010). Incorporating Student Performance Measures into Teacher Evaluation Systems. Technical Report. Rand Corporation.

Multitiered support framework for teachers’ classroom-management practices: Overview and case study of building the triangle for teachers

In this article, the authors describe key features of the multi-tiered support (MTS) continuum of intervention and assessment and present a case study to illustrate implementation of some components of the framework with four middle school teachers.

Sugai, G. (2014). Multitiered support framework for teachers’ classroom-management practices: Overview and case study of building the triangle for teachers. Journal of Positive Behavior Interventions, 16(3), 179-190.

Targeted reading intervention: A coaching model to help classroom teachers with struggling readers

This study examined the effectiveness of a classroom teacher intervention, the Targeted Reading Intervention (TRI), in helping struggling readers in kindergarten and first grade. This intervention used biweekly literacy coaching in the general education classroom to help classroom teachers use diagnostic strategies with struggling readers in one-on-one 15-min sessions.  

Targeted reading intervention: A coaching model to help classroom teachers with struggling readers. Learning Disability Quarterly, 35, 102-114.

The Mirage: Confronting the truth about our quest for teacher development

"The Mirage" describes the widely held perception among education leaders that they already know how to help teachers improve, and that they could achieve their goal of great teaching in far more classrooms if they just applied what they knew more widely.

TNTP. (2015). The Mirage: Confronting the truth about our quest for teacher development. Retrieved from: https://tntp.org/publications/view/the-mirage-confronting-the-truth-about-our-quest-for-teacher-development

Rush to judgment: Teacher evaluation in public education

The authors examine the causes and consequences of the status of teacher evaluation and its implications for the current national debate about performance pay for teachers. The report also examines a number of national, state, and local evaluation systems that offer potential alternatives to current practice.

Toch, T., & Rothman, R. (2008). Rush to Judgment: Teacher Evaluation in Public Education. Education Sector Reports. Education Sector.

The coaching of teachers: Results of five training studies.

In this study, the results of five training studies evaluating the effects of a coaching program for use in Dutch primary and secondary schools are described.

Veenman, S, & Denessen, E. (2001). The coaching of teachers: Results of five training studies.

Educational Research and Evaluation, 7(4), 385–417.

The Widget Effect: Our National Failure to Acknowledge and Act on Differences in Teacher Effectiveness.

This report examines the pervasive and longstanding failure to recognize and respond to variations in the effectiveness of teachers. 

Weisberg, D., Sexton, S., Mulhern, J., Keeling, D., Schunck, J., Palcisco, A., & Morgan, K. (2009). The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness. New Teacher Project.

Making the case for evidence-based policy

U.S. public policy has increasingly been conceived, debated, and evaluated through the lenses of politics and ideology. The fundamental question -- Will the policy work? -- too often gets short shrift or even ignored. A remedy is an evidence-based policy--a rigorous approach that draws on careful data collection, experimentation, and both quantitative and qualitative analysis to determine what the problem is, which ways it can be addressed, and the probable impacts of each of these ways. 

Wesley, P. W., & Buysse, V. (2006). Making the case for evidence- based policy. In V. Buysse & P. W. Wesley (Eds.), Evidence-based practice in the early childhood field (pp. 117–159). Washington, DC: Zero to Three.

Role of professional development and multi-level coaching in promoting evidence-based practice in education

 Due to the increased need to support teachers' use of evidence-based practices in multi-tiered systems of support such as RTI [Response to Intervention] and PBIS [Positive Behavior Interventions and Support], coaching can extend and strengthen professional development. This paper describes a multi-level approach to coaching and provides implications for practice and research.

Wood, C. L., Goodnight, C. I., Bethune, K. S., Preston, A. I., Cleaver, S. L. (2016). Role of professional development and multi-level coaching in promoting evidence-based practice in education. Learning Disabilities: A Contemporary Journal, 14,159-170.

Reviewing the Evidence on How Teacher Professional Development Affects Student Achievement. Issues & Answers.

The purpose of this study is to examine research to answer the question, What is the impact of teacher professional development on student achievement.

Yoon, K. S., Duncan, T., Lee, S. W. Y., Scarloss, B., & Shapley, K. L. (2007). Reviewing the Evidence on How Teacher Professional Development Affects Student Achievement. Issues & Answers. REL 2007-No. 033. Regional Educational Laboratory Southwest (NJ1).

From Policy to Practice: Evidence-based Practice and IDEIA
No Child Left Behind (NCLB) as federal policy required the use of scientifically based instruction to improve educational outcomes. It is a long way from policy to impacting what actually happens in a classroom. In this chapter, the author reviews what is known from implementation science to assure that policy becomes practice.
Detrich, R. (2008). From Policy to Practice: Evidence-based Practice and IDEIA. In Grigorenko, E. L. (Ed.) Educating Individuals with Disabilities: IDEIA 2004 and Beyond, 85. Springer Publishing Company
A Decade of Evidence-Based Education: Where Are We and Where Do We Need to Go?
No Child Left Behind (NCLB) emphasizing scientifically based instruction became law in 2001. In this paper, the authors review the progress that has been made in implementing NCLB and conclude that the greatest threat to its effectiveness is the quality of the implementation of the scientifically based instructional practices.
Detrich, R., & Lewis, T. (2012). A Decade of Evidence-Based Education: Where Are We and Where Do We Need to Go?. Journal of Positive Behavior Interventions, 1098300712460278.
Evolution of the Treatment Integrity Concept: Current Status and Future Directions
The article discusses treatment integrity.
Gresham, F. M. (2009). Evolution of the Treatment Integrity Concept: Current Status and Future Directions. School Psychology Review, 38(4), 533-540.
Toward Developing a Science of Treatment Integrity: Introduction to the Special Series
This article provides an overview of the current state of conceptual models of treatment integrity and suggest future directions for research, practice, and policy related to treatment integrity.
Hagermoser Sanetti, L. M., & Kratochwill, T. R. (2009). Toward Developing a Science of Treatment Integrity: Introduction to the Special Series. School Psychology Review, 38(4), 445-459.
Treatment integrity of school-based interventions with children in the journal of applied behavior analysis 1991-2005.
The authors reviewed all intervention studies published in the Journal of Applied Behavior Analysis between 1991-2005 that occurred in school settings to determine the percent of studies that reported treatment integrity measures. In this review, 30% of the studies reported treatment integrity.
McIntyre, L. L., Gresham, F. M., DiGennaro, F. D., & Reed, D. D. (2007). Treatment integrity of school-based interventions with children in the ?journal of applied behavior analysis 1991-2005. Journal of Applied Behavior Analysis, 40(4), 659-672.
Treatment Implementation Following Behavioral Consultation in Schools: A Comparison of Three Follow-up Strategies
This study examines teachers' implementation of treatment plans following consultation.
Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., ... & Duhon, G. J. (2005). Treatment implementation following behavioral consultation in schools: A comparison of three follow-up strategies. School Psychology Review.

No items found.

Back to Top