Staff Treatment Integrity

All Wing Resources

Publications

TITLE
SYNOPSIS
CITATION
Approaches to Increasing Treatment Integrity

Strategies designed to increase treatment integrity fall into two categories: antecedent-based strategies and consequence-based strategies.

Detrich, R., States, J. & Keyworth, R. (2017). Approaches to Increasing Treatment Integrity. Oakland, Ca. The Wing Institute

 

Performance Feedback in Education: On Who and For What

This paper reviews the importance of feedback in education reviewed the scientific model of behavior change (antecedent, behavior, consequences).

Daniels, A. (2013). Feedback in Education: On Whom and for What. In Performance Feedback: Using Data to Improve Educator Performance (Vol. 3, pp. 77-95). Oakland, CA: The Wing Institute.

Treatment Integrity in the Problem Solving Process

The usual approach to determining if an intervention is effective for a student is to review student outcome data; however, this is only part of the task. Student data can only be understood if we know something about how well the intervention was implemented. Student data without treatment integrity data are largely meaningless because without knowing how well an intervention has been implemented, no judgments can be made about the effectiveness of the intervention. Poor outcomes can be a function of an ineffective intervention or poor implementation of the intervention. Without treatment integrity data, the is a risk that an intervention will be judged as ineffective when, in fact, the quality of implementation was so inadequate that it would be unreasonable to expect positive outcomes.

Detrich, R., States, J. & Keyworth, R. (2017). Treatment Integrity in the Problem Solving Process. Oakland, Ca. The Wing Institute.

 

Working with Staff to Promote Data-Based Decision Making: Recommended Strategies and Common Pitfalls [Publication]
This paper discusses evidence-based ways of working with staff to promote program intervention integrity and accurate data collection.
Reid, D. (2010). Working with Staff to Promote Data-Based Decision Making: Recommended Strategies and Common Pitfalls.Journal of Evidence-Based Practices for Schools, 11(2), 169–186.

 

Data Mining

TITLE
SYNOPSIS
CITATION
Does Feedback Improve Performance?
This review is a summary of the effect size of the effectiveness feedback to improve both student and teacher performance.
States, J. (2011). Does Feedback Improve Performance? Retrieved from does-feedback-improve-performance.
Does professional development make a difference in student performance?
This analysis looks at a systematic review of teacher professional development on student achievement.
States, J. (2011). Does professional development make a difference in student performance? Retrieved from does-professional-development-make.
How does coaching compare with traditional staff development in improving student achievement?
This analysis compares the effectiveness of coaching compared to traditional forms of professional development for teachers.
States, J. (2012). How does coaching compare with traditional staff development in improving student achievement? Retrieved from how-does-coaching-compare.
How does performance feedback affect the way teachers carry out interventions?
This analysis examined the impact of performance feedback on the quality of implementation of interventions.
Detrich, R. (2015). How does performance feedback affect the way teachers carry out interventions? Retrieved from how-does-performance-feedback.
How often are treatment integrity measures reported in published research?
This analysis examined the frequency that treatment integrity is reported in studies of research-based interventions.
Detrich, R. (2015). How often are treatment integrity measures reported in published research? Retrieved from how-often-are-treatment.
How well are Interventions Implemented in Educational Settings?
This analysis examined two studies to understand the reliability of self-reporting of practitioners implementing interventions.
Detrich, R. (2015). How well are Interventions Implemented in Educational Settings? Retrieved from how-well-are-interventions.
Is there empirical research to validate the use of prereferral intervention teams (PIT) to reduce special education referrals, achieve gains, or improve student conduct?
This is a review of a meta-analysis of Prereferral Intervention Teams on student and system outcomes.
States, J. (2011). Is there empirical research to validate the use of prereferral intervention teams (PIT) to reduce special education referrals, achieve gains, or improve student conduct? Retrieved from is-there-empirical-research.
What evidence do principals rely on in assessing the quality of a teacher’s instruction?
This analysis examines principal sources of information on teacher instructional competency and the amount of time spent assessing teacher's instructional skills.
States, J. (2015). What evidence do principals rely on in assessing the quality of a teacher’s instruction? Retrieved from what-evidence-do-principals.
What Teacher Training Methods Result in Changes in Classroom Practices?

This analysis compares the effectiveness of staff development methods that include, didactic presentation, modeling, practice with feedback, and coaching.

States, J. (2011). What Teacher Training Methods Result in Changes in Classroom Practices? Retrieved from what-teacher-training-methods.

 

Presentations

TITLE
SYNOPSIS
CITATION
Performance Feedback in Education: On Who and For What
This paper reviews the importance of feedback in education reviewed the scientific model of behavior change (antecedent, behavior, consequences).
Daniels, A. (2011). Performance Feedback in Education: On Who and For What [Powerpoint Slides]. Retrieved from 2011-wing-presentation-aubrey-daniels.
Performance Feedback: Use It or Lose It

This paper examines the importance of performance feedback systems at all levels of school, staff and student outcomes to achieve desired results over time.

Keyworth, R. (2011). Performance Feedback: Use It or Lose It [Powerpoint Slides]. Retrieved from 2011-aba-presentation-randy-keyworth.

School Reform and Culture Change: What We Missed
This analysis reviews the ongoing failure of school reform efforts in the context of poor teacher preparation and performance feedback.
Keyworth, R. (2012). School Reform and Culture Change: What We Missed [Powerpoint Slides]. Retrieved from 2012-wing-presentation-randy-keyworth.
Teacher Coaching: The Missing Link in Teacher Professional Development
Research suggests that coaching is one of the most effective strategies in training teachers. This paper identifies the critical practice elements of coaching and their absence in teacher training.
Keyworth, R. (2013). Teacher Coaching: The Missing Link in Teacher Professional Development [Powerpoint Slides]. Retrieved from 2013-calaba-presentation-randy-keyworth.
Teacher Induction: Where the Rubber Meets the Road
The paper examines one of the most critical components of teach training: an on-the-job, ongoing system of coaching and performance feedback to improve skill acquisition, generalization and maintenance.
Keyworth, R. (2010). Teacher Induction: Where the Rubber Meets the Road [Powerpoint Slides]. Retrieved from 2010-aba-presentation-randy-keyworth.
Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes
Treatment integrity is necessary to improve outcomes but it is not sufficient. It is also necessary to implement scientifically supported interventions.
Detrich, R. (2015). Treatment Integrity: Necessary by Not Sufficient for Improving Outcomes [Powerpoint Slides]. Retrieved from 2015-ebpindisabilities-txint-presentation-ronnie-detrich.
Using Student Data as a Basis for Feedback to Teachers
This paper offers an alternative to evaluating teachers based on student performance on annual high stakes tests.
Detrich, R. (2011). Using Student Data as a Basis for Feedback to Teachers [Powerpoint Slides]. Retrieved from 2011-aba-presentation-ronnie-detrich.
Working with Staff to Promote Data-Based Decision Making: Recommended Strategies and Common Pitfalls
This paper discusses evidence-based ways of working with staff to promote program intervention integrity and accurate data collection.
Reid, D. (2009). Working with Staff to Promote Data-Based Decision Making: Recommended Strategies and Common Pitfalls [Powerpoint Slides]. Retrieved from 2009-wing-presentation-dennis-reid.

 

Student Research

TITLE
SYNOPSIS
CITATION
Effects of a problem solving team intervention on the problem-solving process: Improving concept knowledge, implementation integrity, and student outcomes.

This study evaluated the effects of a problem solving intervention package that included problem-solving information, performance feedback, and coaching in a student intervention planning protocol.

Vaccarello, C. A. (2011). Effects of a problem solving team intervention on the problem-solving process: Improving concept knowledge, implementation integrity, and student outcomes. Retrieved from student-research-2011.

Back to Top