Education Drivers

Evaluation

Publications

TITLE
SYNOPSIS
CITATION
Overview of Teacher Evaluation

This overview provides information about teacher evaluation as it relates to collecting information about teacher practice and using it to improve student outcomes. The history of teacher evaluation and current research findings and implications are included.

Cleaver, S., Detrich, R. & States, J. (2018). Overview of Teacher Evaluation. Oakland, CA: The Wing Institute. https://www.winginstitute.org/assessment-summative.

Overview: Formal Teacher Evaluation

The purpose of this overview is to provide information about the role of formal teacher evaluation, the research that examines the practice, and its impact on student outcomes.

Cleaver, S., Detrich, R. & States, J. (2018). Overview of Teacher Formal Evaluation. Oakland, CA: The Wing Institute.https://www.winginstitute.org/teacher-evaluation-formal.

Performance Feedback Overview

This overview examines the current understanding of research on performance feedback as a way to improve teacher performance and student outcomes. 

Cleaver, S., Detrich, R. & States, J. (2019). Overview of Performance Feedback. Oakland, CA: The Wing Institute. https://www.winginstitute.org/teacher-evaluation-feedback.

Informal Teacher Evaluation

The purpose of this overview is to provide information about informal evaluation as a practice in schools, and the current understanding of research related to informal teacher evaluation to improve teacher performance and student outcomes.

Cleaver, S., Detrich, R., & States, J. (2019). Informal Teacher Evaluation. Oakland, CA: The Wing Institute. Retrieved from https://www.winginstitute.org/staff-informal.

 

Data Mining

TITLE
SYNOPSIS
CITATION
Would a student rated 'Proficient' in Reading in one state be rated 'Proficient' in Reading in another state?
The inquiry compares student performance between state proficiency standards and the National Assessment Education Progress proficiency standards.
Gibson, S. (2009). Would a student rated 'Proficient' in Reading in one state be rated 'Proficient' in Reading in another state? Retrieved from would-student-rated-'proficient.
TITLE
SYNOPSIS
CITATION
Risks and rewards of school-based mentoring Relationships: A reanalysis of the student mentoring program evaluation.

This study presents a reanalysis of a large randomized controlled trial of school-based mentoring and examines the estimated effect of mentoring as a function of mentee-reported relationship quality using a novel statistical approach.

Lyons, M. D., & McQuillin, S. D. (2019). Risks and rewards of school-based mentoring relationships: A reanalysis of the student mentoring program evaluation. School Psychology, 34(1), 76-85.

http://dx.doi.org/10.1037/spq0000265

Outcome evaluation of Washington State's research-based programs for juvenile offenders.

The CJAA funded the nation’s first statewide experiment concerning research-based programs for juvenile justice. The question here was whether they work when applied statewide in a “real world” setting. This report indicates that the answer to this question is yes— when the programs are competently delivered. 

Barnoski, R., & Aos, S. (2004). Outcome evaluation of Washington State’s research-based programs for juvenile offenders. Olympia, WA: Washington State Institute for Public Policy, 460.

Evaluation of Procedure‐Based Scoring for Hands‐On Science Assessment

This article evaluates a procedure‐based scoring system for a performance assessment (an observed paper towels investigation) and a notebook surrogate completed by fifth‐grade students varying in hands‐on science experience. 

Baxter, G. P., Shavelson, R. J., Goldman, S. R., & Pine, J. (1992). Evaluation of procedure‐based scoring for hands‐on science assessment. Journal of Educational Measurement29(1), 1-17.

Effective Teaching: What Is It and How Is It Measured?

This paper examines how to measure teacher performance and the practices necessary for increasing teacher trust in systems designed to effectively measure performance.

Cantrell, S., & Scantlebury, J. (2011). Effective Teaching: What Is It and How Is It Measured?. Effective Teaching as a Civil Right, 28.

Does external accountability affect student outcomes? A cross-state analysis.

This study developed a zero-to-five index of the strength of accountability in 50 states based on the use of high-stakes testing to sanction and reward schools, and analyzed whether that index is related to student gains on the NAEP mathematics test in 1996–2000.

Carnoy, M., & Loeb, S. (2002). Does external accountability affect student outcomes? A cross-state analysis. Educational Evaluation and Policy Analysis, 24(4), 305-331.

Psychometric Considerations when Evaluating Response to Intervention

This chapter provides an integrative approach to measurement as it is likely to be applied to assessment and evaluation within an RTI framework

Christ, T. J., & Hintze, J. M. (2007). Psychometric considerations when evaluating response to intervention. In Handbook of response to intervention (pp. 93-105). Springer, Boston, MA.

Overview of Teacher Evaluation

This overview provides information about teacher evaluation as it relates to collecting information about teacher practice and using it to improve student outcomes. The history of teacher evaluation and current research findings and implications are included.

Cleaver, S., Detrich, R. & States, J. (2018). Overview of Teacher Evaluation. Oakland, CA: The Wing Institute. https://www.winginstitute.org/assessment-summative.

Overview: Formal Teacher Evaluation

The purpose of this overview is to provide information about the role of formal teacher evaluation, the research that examines the practice, and its impact on student outcomes.

Cleaver, S., Detrich, R. & States, J. (2018). Overview of Teacher Formal Evaluation. Oakland, CA: The Wing Institute.https://www.winginstitute.org/teacher-evaluation-formal.

Performance Feedback Overview

This overview examines the current understanding of research on performance feedback as a way to improve teacher performance and student outcomes. 

Cleaver, S., Detrich, R. & States, J. (2019). Overview of Performance Feedback. Oakland, CA: The Wing Institute. https://www.winginstitute.org/teacher-evaluation-feedback.

Informal Teacher Evaluation

The purpose of this overview is to provide information about informal evaluation as a practice in schools, and the current understanding of research related to informal teacher evaluation to improve teacher performance and student outcomes.

Cleaver, S., Detrich, R., & States, J. (2019). Informal Teacher Evaluation. Oakland, CA: The Wing Institute. Retrieved from https://www.winginstitute.org/staff-informal.

Evaluating the Effectiveness of Teacher Preparation Programs for Support and Accountability. Research & Policy Brief

This brief explores research that points to the opportunities and the challenges that evaluating teacher preparation programs differently presents.

Coggshall, J. G., Bivona, L., & Reschly, D. J. (2012). Evaluating the Effectiveness of Teacher Preparation Programs for Support and Accountability. Research & Policy Brief. National Comprehensive Center for Teacher Quality. Retrieved from https://eric.ed.gov/?id=ED543773

Program integrity in primary and early secondary prevention: are implementation effects out of control?

The authors examined the extent to which program integrity (i.e., the degree to which programs were implemented as planned) was verified and promoted in evaluations of primary and early secondary prevention programs published between 1980 and 1994. 

Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clinical psychology review18(1), 23-45.

Teacher evaluation in the organizational context: A review of the literature.

This article presents a conceptual framework for examining the design and implementation of teacher evaluation processes in school organizations. 

Darling-Hammond, L., Wise, A. E., & Pease, S. R. (1983). Teacher evaluation in the organizational context: A review of the literature. Review of educational research53(3), 285-328.

What research says about using value-added measures to evaluate teachers.

A growing number of researchers are studying whether value-added measures can do a good job of measuring the contribution of teachers to test score growth. Here I summarize a handful of analyses that shed light on two questions.

David, J. L. (2010). What research says about using value-added measures to evaluate teachers. Educational Leadership, 67(8), 81–82. Retrieved from http://www.ascd.org/publications/educational_leadership/may10/vol67/num08/Using_Value-Added_Measures_to_Evaluate_Teachers.aspx

Formative Evaluation of Individual Student Programs: A New Role for School Psychologists.

Problems associated with the school psychologists traditional assessment functions and methodology are identified and contrasted with the need for assessment information that can contribute meaningfully to the formulation and evaluation of educational interventions. 

Deno, S. L. (1986). Formative evaluation of individual student programs: A new role for school psychologists. School Psychology Review.

How do principals really improve schools?

Principals are in a paradoxical position. On one hand, they're called on to use research-based strategies to improve student achievement. On the other, they're increasingly required to micromanage teachers by observing in classrooms and engaging in intensive evaluation. The authors point out that these two positions are at odds with each other.

Dufour, R., & Mattos, M. (2013). How Do Principals Really Improve Schools?. Educational Leadership70(7), 34-40.

The Center on Standards, Alignment, Instruction, and Learning (C-SAIL)

C-SAIL was established in July 2015 as a resource on the implementation and effects of college and career readiness standards. The Center is funded through a grant from the Institute of Education Sciences (IES) of the U.S. Department of Education.

 

Edgerton, A. Polikoff, M., Desimone, L. (2017). How is policy affecting classroom instruction?. Evidence Speaks Reports. Volume 2, #14. The Center on Standards, Alignment, Instruction, and Learning (C-SAIL).

Teacher Observation. Education Endowment Foundation

Research strongly suggests that feedback obtained through direct observations of performance can be a powerful tool for improving teacher’s skills. This study examines a peer teacher observation method used in England. The study found no evidence that Teacher Observation improved student language and math scores.

 

Education Endowment Foundation (2017). Teacher Observation. Education Endowment Foundation. Retrieved https://educationendowmentfoundation.org.uk/projects-and-evaluation/projects/teacher-observation/.

 

 

Issues in Disseminating and Replicating Effective Prevention Programs

a brief overview of findings from the Blueprints for Violence Prevention-Replication Initiative is presented, identifying factors that enhance or impede a successful implementation of these programs.

Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science5(1), 47-53.

Planning, Implementing and Evaluating Evidence-Based Interventions

This section includes tools and resources that can help school leaders, teachers, and other stakeholders be more strategic in their decision-making about planning, implementing, and evaluating evidence-based interventions to improve the conditions for learning and facilitate positive student outcomes.

Elliott, S. N., Witt, J. C., & Kratochwill, T. R. (1991). Selecting, implementing, and evaluating classroom interventions. Interventions for achievement and behavior problems, 99-135.

Planning, Implementing and Evaluating Evidence-Based Interventions

This section includes tools and resources that can help school leaders, teachers, and other stakeholders be more strategic in their decision-making about planning, implementing, and evaluating evidence-based interventions to improve the conditions for learning and facilitate positive student outcomes.

Elliott, S. N., Witt, J. C., & Kratochwill, T. R. (1991). Selecting, implementing, and evaluating classroom interventions. Interventions for achievement and behavior problems, 99-135.

What educators need to know about ESSA.

The Every Student Succeeds Act (ESSA) returns decision making for our nation’s education back where it belongs – in the hands of local educators, families, and communities – while keeping the focus on students most in need.

Fennell, M. (2016). What educators need to know about ESSA. Educational Leadership, 73, 62–65.

Leading for Instructional Improvement: How Successful Leaders Develop Teaching and Learning Expertise

This book shows how principals and other school leaders can develop the skills necessary for teachers to deliver high quality instruction by introducing principals to a five-part model of effective instruction.

Fink, S., & Markholt, A. (2011). Leading for instructional improvement: How successful leaders develop teaching and learning expertise. John Wiley & Sons.

Teacher Incentives and Student Achievement: Evidence from New York City Public Schools

This article describes a school-based randomized trial in over 200 New York City public schools designed to better understand the impact of teacher incentives. 

Fryer, R. G. (2013). Teacher incentives and student achievement: Evidence from New York City public schools. Journal of Labor Economics31(2), 373-407.

The Effects of Frequent Curriculum-Based Measurement and Evaluation on Pedagogy, Student Achievement, and Student Awareness of Learning

This study examined the educational effects of repeated curriculumbased measurement and evaluation. Thirty-nine special educators, each having three to four pupils in the study, were assigned randomly to a repeated curriculum-based measurement/evaluation (experimental) treatment or a conventional special education evaluation (contrast) treatment

Fuchs, L. S., Deno, S. L., & Mirkin, P. K. (1984). The effects of frequent curriculum-based measurement and evaluation on pedagogy, student achievement, and student awareness of learning. American Educational Research Journal21(2), 449-460.

Developing Leaders: The Importance--and the Challenges--of Evaluating Principal Preparation Programs

The authors have been evaluating the impact of five principal preparation programs in the United States on student outcomes. This information should be considered as one aspect of preparation program improvement and accountability. The study team lays out its recommendations in this policy paper. 

George W. Bush Institute & Education Reform Initiative. (2016). Developing Leaders: The Importance--and the Challenges--of Evaluating Principal Preparation Programs, Retrieved from https://gwbcenter.imgix.net/Resources/gwbi-importance-of-evaluating-principal-prep.pdf

Approaches to Evaluating Teacher Effectiveness: A Research Synthesis

This research synthesis examines how teacher effectiveness is currently measured (i.e., formative vs. summative evaluation).

Goe, L., Bell, C., & Little, O. (2008). Approaches to Evaluating Teacher Effectiveness: A Research Synthesis. National Comprehensive Center for Teacher Quality.

A Practical Guide to Designing Comprehensive Teacher Evaluation Systems: A Tool to Assist in the Development of Teacher Evaluation Systems

This guide is a tool designed to assist states and districts in constructing high-quality teacher evaluation systems in an effort to improve teaching and learning.

Goe, L., Holdheide, L., & Miller, T. (2011). A Practical Guide to Designing Comprehensive Teacher Evaluation Systems: A Tool to Assist in the Development of Teacher Evaluation Systems. National Comprehensive Center for Teacher Quality.

Is this just a bad class? Assessing the stability of measured teacher performance

This paper report on work estimating the stability of value-added estimates of teacher effects, an important area of investigation given that new workforce policies implicitly assume that effectiveness is a stable attribute within teachers.

Goldhaber, D. D., & Hansen, M. (2008). Is it Just a Bad Class?: Assessing the Stability of Measured Teacher Performance. Seattle, WA: Center on Reinventing Public Education.

Identifying effective teachers using performance on the job

This paper provide some recommendations to increase the pool of potential teachers, make it tougher to award tenure to those who perform least well, and reward effective teachers who are willing to work in schools serving large numbers of low-income, disadvantaged children. 

Gordon, R., Kane, T. J., & Staiger, D. O. (2006). Identifying Effective Teachers Using Performance on the Job. The Hamilton Project Policy Brief No. 2006-01. Brookings Institution.

Undue process: Why bad teachers in twenty-five diverse districts rarely get fired

Is dismissing poorly performing teachers truly feasible in America today? After all the political capital (and real capital) spent on reforming teacher evaluation, can districts actually terminate ineffective teachers who have tenure or have achieved veteran status?

Griffith, D., & McDougald, V. (2016). Undue process: Why bad teachers in twenty-five diverse districts rarely get fired. Washington DC: Thomas B. Fordham Institute. Retrieved from http://edex. s3-us-west-2. amazonaws. com/publication/pdfs2812, 29.

No Child Left Behind, Contingencies, and Utah's Alternate Assessment

This article examine the concept of behavioral contingency and describes NCLB as a set of contingencies to promote the use of effective educational practices. Then they describe their design of an alternate assessment, including the components designed to capitalize on the contingencies of NCLB to promote positive educational outcomes. 

Hager, K. D., Slocum, T. A., & Detrich, R. (2007). No Child Left Behind, Contingencies, and Utah’s Alternate Assessment. JEBPS Vol 8-N1, 63.

Teacher characteristics and gains in student achievement: Estimation using micro-data.

The major objective of this data analysis was to estimate the relationship between variables which can be controlled by public policy and educational output. 

Hanushek, E. A. (1971). Teacher characteristics and gains in student achievement: Estimation using micro data. American Economic Review61(2), 280-288.

Teacher Deselection.

This discussion provides a quantitative statement of one approach to achieving the governors’ (and the nation’s) goals – teacher deselection.

Hanushek, E. A. (2009). Teacher deselection. Creating a new teaching profession168, 172-173.

Teacher evaluation as a policy target for improved student learning: A fifty-state review of statute and regulatory action since NCLB

This paper reports on the analysis of state statutes and department of education regulations in fifty states for changes in teacher evaluation in use since the passage of No Child Left Behind Act of 2001.

Hazi, H. M., & Rucinski, D. A. (2009). Teacher evaluation as a policy target for improved student learning: A fifty-state review of statute and regulatory action since NCLB. education policy analysis archives17, 5.

Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems

This article discusses the current focus on using teacher observation instruments as part of new teacher evaluation systems being considered and implemented by states and districts. 

Hill, H., & Grossman, P. (2013). Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems. Harvard Educational Review, 83(2), 371-384.

A New Definition

NSDC opens the door to professional learning that ensures great teaching for every student every day

Hirsh, S. (2009). A new definition. Journal of Staff Development, 30(4), 10–16.

Curriculum-based evaluation: Teaching and decision making

This book presents clear and functional techniques for deciding what students with learning disabilities should be taught and how. This book can also function as a tool to assist pre-service teachers (students) with deciding how to teach and what to teach to regular/non-special education children.

Howell, K. W. (1993). Curriculum-based evaluation: Teaching and decision making. Cengage Learning.

Do Students Show What They Know on Standardized Tests

Standardized testing has increasingly been used to hold educators accountable. Incentives are often offered as a way to improve student test performance. This study examines the impact incentives for students, parents and tutors on standardized test results. The researchers provided incentives on specially designed tests that measure the same skills as the official state standardized tests; however, performance on the official tests was not incentivized. This study finds substantial improvement for performance when there were incentives on the results did not generalize to the official test. This calls into question how to effectively use incentives so they will actually produce desired outcomes.

John A. List, Jeffrey A Livingston and Susanne Neckermann. “Do Students Show What They Know on Standardized Tests?” working papers (2016) Available at: http://works.bepress.com/jeffrey_livingston/19/

 

Estimating teacher impacts on student achievement: An experimental evaluation

This study used a random-assignment experiment in Los Angeles Unified School District to evaluate various non-experimental methods for estimating teacher effects on student test scores. Having estimated teacher effects during a pre-experimental period, the authors used these estimates to predict student achievement following random assignment of teachers to classrooms.

Kane, T. J., & Staiger, D. O. (2008). Estimating teacher impacts on student achievement: An experimental evaluation (No. w14607). National Bureau of Economic Research.

Gathering Feedback for Teaching: Combining High-Quality Observations with Student Surveys and Achievement Gains.

This report presents an in-depth discussion of the analytical methods and findings from the Measures of Effective Teaching (MET) project’s analysis of classroom observations.1 A nontechnical companion report describes implications for policymakers and practitioners.

Kane, T. J., & Staiger, D. O. (2012). Gathering Feedback for Teaching: Combining High-Quality Observations with Student Surveys and Achievement Gains. Research Paper. MET Project. Bill & Melinda Gates Foundation.

Identifying effective classroom practices using student achievement data

This paper combines information from classroom-based observations and measures of teachers' ability to improve student achievement as a step toward addressing these challenges. The results point to the promise of teacher evaluation systems that would use information from both classroom observations and student test scores to identify effective teachers.

Kane, T. J., Taylor, E. S., Tyler, J. H., & Wooten, A. L. (2011). Identifying effective classroom practices using student achievement data. Journal of human Resources, 46(3), 587-613.

 

Examining the validity of ratings from a classroom observation instrument for use in a district’s teacher evaluation system

The purpose of this study was to examine the validity of teacher evaluation scores that are derived from an observation tool, adapted from Danielson's Framework for Teaching, designed to assess 22 teaching components from four teaching domains.

Lash, A., Tran, L., & Huang, M. (2016). Examining the Validity of Ratings from a Classroom Observation Instrument for Use in a District's Teacher Evaluation System. REL 2016-135. Regional Educational Laboratory West.

Effects of performance feedback and coaching on the problem-solving process: Improving the integrity of implementation and enhancing student outcomes

the present study was designed to learn more about how to strengthen the integrity of the problem-solving process

Lundahl, A. A. (2010). Effects of Performance Feedback and Coaching on the Problem-Solving Process: Improving the Integrity of Implementation and Enhancing Student Outcomes. ProQuest LLC. 789 East Eisenhower Parkway, PO Box 1346, Ann Arbor, MI 48106.

Problem solving and intervention design: Guidelines for the evaluation of technical adequacy.

In this article, guidelines for evaluating the technical adequacy of that process are described. The guidelines highlight the interdependencies among assessment functions, subsumed by the goal of helping, and the role of structural factors (e.g., collaboration) in shaping the meaningfulness, appropriateness, and usefulness of the assessment-intervention process.

Macmann, G. M., Barnett, D. W., Allen, S. J., Bramlett, R. K., Hall, J. D., & Ehrhardt, K. E. (1996). Problem solving and intervention design: Guidelines for the evaluation of technical adequacy. School Psychology Quarterly11(2), 137.

Effective supervision: Supporting the art and science of teaching

The authors show school and district-level administrators how to set the priorities and support the practices that will help all teachers become expert teachers. Their five-part framework is based on what research tells us about how expertise develops. 

Marzano, R. J., Frontier, T., & Livingston, D. (2011). Effective supervision: Supporting the art and science of teaching. Ascd.

School leadership that works: From research to results

Building on the analysis that was first reported in School Leadership That Works, the authors of Balanced Leadership identify the 21 responsibilities associated with effective leadership and show how they relate to three overarching responsibilities: 

Marzano, R. J., Waters, T., & McNulty, B. A. (2001). School leadership that works: From research to results. ASCD.

Review of Two Alternative Teacher Preparation Proposals

This review addresses two different proposals for reforming teacher training, neither of which is grounded in research. The authors report three weak correlations between the performance of program participants and TNTP’s certification evaluation rubric. The report concludes with three self-evident aphorisms: practice improves teaching, teachers who master teaching skills do better, and inadequate performers should be weeded out. 

Mathis, W. (2014). Review of Two Alternative Teacher Preparation Proposals. National Education Policy Center. Retrieved from http://greatlakescenter.org/docs/Think_Twice/TT_Mathis_TeacherPrep.pdf

What is the purpose of teacher evaluation today? A conversation between Bellwether and Fordham.

In December 2016, Bellwether Education Partners and The Thomas B. Fordham Institute independently released two reports centered on teacher evaluation and its consequences. Both reports offer a glimpse into ongoing challenges and opportunities with teacher evaluation reform, but they have very different analyses. 

McDougald, V., Griffith, D., Pennington, K., & Mead, S. (2016). What is the purpose of teacher evaluation today? A conversation between Bellwether and Fordham. Retrieved from https://edexcellence.net/articles/what-is-the-purpose-of-teacher-evaluation-today-a-conversation-between-bellwether-and

Approaches to Evaluating Teacher Preparation Programs in Seven States.

This report describes how the seven Regional Educational Laboratory (REL) Central states (Colorado, Kansas, Missouri, Nebraska, North Dakota, South Dakota, and Wyoming) evaluate their teacher preparation programs and the changes they are making to improve their approaches to evaluation.

Meyer, S. J., Brodersen, R. M., & Linick, M. A. (2014). Approaches to Evaluating Teacher Preparation Programs in Seven States. REL 2015-044. Regional Educational Laboratory Central. Retrieved from https://eric.ed.gov/?id=ED550491

Validity research on teacher evaluation systems based on the framework for teaching.

This paper summarizes validity evidence pertaining to several different implementations of the Framework. It is based primarily on reviewing the published and unpublished studies that have looked at the relationship between teacher evaluation ratings made using systems based on the Framework and value-added measures of teacher effectiveness.

Milanowski, A. T. (2011). Validity Research on Teacher Evaluation Systems Based on the Framework for Teaching. Online Submission.

A Nation at Risk: The imperative for education reform.

This report is concerned with only one of the many causes and dimensions of the problem, but it is the one that undergirds American prosperity, security, and civility.

National Commission on Excellence in Education. (1983). A Nation at Risk: The imperative for education reform. Retrieved from https://www.edreform.com/wp-content/uploads/2013/02/A_Nation_At_Risk_1983.pdf

 

 
Promoting language and literacy development for early childhood educators: A mixed-methods study of coursework and coaching

This study examines the impact of 2 forms of professional development on prekindergarten teachers' early language and literacy practice: coursework and coaching. 

Neuman, S. B., & Wright, T. S. (2010). Promoting language and literacy development for early childhood educators: A mixed-methods study of coursework and coaching. Elementary School Journal, 11,63-86. No Child Left Behind Act of 2001, P.L. 107-110, 20 U.S.C. § 6319 (2002).

Promoting Language and Literacy Development for Early Childhood Educators: A Mixed-Methods Study of Coursework and Coaching

The goal of the study was to examine the effects of coaching or professional development coursework on teacher knowledge and teacher practice.

Neuman, S. B., & Wright, T. S. (2010). Promoting language and literacy development for early childhood educators: A mixed-methods study of coursework and coaching. Elementary School Journal, 111,63–86.

Training residential supervisors to provide feedback for maintaining staff teaching skills with people who have severe disabilities

This research evaluated procedures for training supervisors in a residential setting to provide feedback
for maintaining direct‐service staff members' teaching skills with people who have severe disabilities.

Parsons, M. B., & Reid, D. H. (1995). Training residential supervisors to provide feedback for maintaining staff teaching skills with people who have severe disabilities. Journal of Applied Behavior Analysis28(3), 317-322.

For good measure? Teacher evaluation policy in the ESSA era.

As states and districts consider potential changes to their teacher evaluation systems and policies, this paper seeks to inform those efforts by reviewing the evolution of the teacher evaluation policy movement over the last several years, identifying positive outcomes of new systems and negative consequences, and describing risks that should be considered. 

Pennington, K., & Mead, S. (2016). For good measure? Teacher evaluation policy in the ESSA era. Washington, DC: Bellwether Education Partners. Retrieved from https://bellwethereducation.org/publication/good-measure-teacher-evaluation-policy-essa-era

Teacher evaluation: A comprehensive guide to new directions and practices

This handbook advocates a new approach to teacher evaluation as a cooperative effort undertaken by a group of professionals.

Peterson, K. D. (2000). Teacher evaluation: A comprehensive guide to new directions and practices. Corwin Press.

Drive: The surprising truth about what motivates us

In this provocative and persuasive new book, the author asserts that the secret to high performance and satisfaction-at work, at school, and at home—is the deeply human need to direct our own lives, to learn and create new things, and to do better by ourselves and our world.

Pink, D. H. (2011). Drive: The surprising truth about what motivates us. Penguin.

Teachers matter: Understanding teachers’ impact on student achievement,

Research using student scores on standardized tests confirms the common perception that some teachers are more effective than others. It also reveals that being taught by an effective teacher has important consequences for student achievement. The best way to assess a teacher's effectiveness is to look at his or her on-the-job performance.

RAND Education. (2012).Teachers matter: Understanding teachers’ impact on student achievement, Santa Monica, Calif.: Author. Retrieved from https://www.rand.org/pubs/corporate_pubs/CP693z1-2012-09.html

The impact of individual teachers on student achievement: Evidence from panel data

In order to provide accurate estimates of how much teachers affect the achievement of their students, this study used panel data covering over a decade of elementary student test scores and teacher assignment in two contiguous New Jersey school districts.

Rockoff, J. E. (2004). The impact of individual teachers on student achievement: Evidence from panel data. American economic review94(2), 247-252.

State Department of Education Support for Implementation Issues Faced by School Districts during the Curriculum Adoption Process.

This review examined the overlap between state-created curriculum evaluation tools and The Hexagon Tool created by the National Implementation Research Network. The author followed systematic procedures while conducting a web search and visiting each state’s department of education website in search of curriculum evaluation tools.

Rolf, R., R. (2019). State Department of Education Support for Implementation Issues Faced by School Districts during the Curriculum Adoption Process. Oakland, CA: The Wing Institute. https://www.winginstitute.org/student-research-2019.

Teacher Efficacy and the Effects of Coaching on Student Achievement 1

This research considers relationships between student achievement (knowledge and cognitive skill), teacher efficacy (Gibson & Dembo, 1984), and interactions with assigned coaches (self-report measures) in a sample of 18 grade 7 and 8 history teachers in 36 classes implementing a specific innovation with the help of 6 coaches.

Ross, J. A. (1992). Teacher efficacy and the effects of coaching on student achievement. Canadian Journal of Education, 17(1), 51–65.

Teacher quality in educational production: Tracking, decay, and student achievement.

The author develop falsification tests for three widely used VAM specifications, based on the idea that future teachers cannot influence students' past achievement. 

Rothstein, J. (2010). Teacher quality in educational production: Tracking, decay, and student achievement. The Quarterly Journal of Economics125(1), 175-214.

Hiring an External Evaluator

This essay seeks to help you put the hard-earned experience of others to use through a set of practical steps, prompts, and tips for matching the right evaluator to your need.

S.D. Bechtel, Jr. Foundation. (2018). Hiring an External Evaluator. Retrieved from http://sdbjrfoundation.org/wp-content/uploads/2018/04/04_Evaluation-Consultant_2018Oct25.pdf

 
Teacher evaluation: An issue overview.

Teacher evaluations matter a lot—both to teachers and to those holding them accountable. But how can schools measure the performance of all teachers fairly? And what should they do with the results?

Sawchuk, S. (2015). Teacher evaluation: An issue overview. Education Week35(3), 1-6.

Evaluation Thesaurus. Third Edition.

Written by one of the leaders in evaluation, Evaluation Thesaurus, Fourth Edition, provides readers with a quick analysis of the leading concepts, positions, acronyms, processes, techniques, and checklists in the field of evaluation.

Scriven, M. (1991). Evaluation thesaurus. Sage.

Teacher evaluation: Guide to professional practice.

This book is organized around four dominant interrelated core issues: professional standards, a guide to applying the Joint Committee's Standards, ten alternative models for the evaluation of teacher performance, and an analysis of these selected models. 

Shinkfield, A. J., & Stufflebeam, D. L. (2012). Teacher evaluation: Guide to effective practice (Vol. 41). Springer Science & Business Media.

A Consumer’s Guide to Evaluating a Core Reading Program Grades K-3: A Critical Elements Analysis

A critical review of reading programs requires objective and in-depth analysis. For these reasons, the authors offer the following recommendations and procedures for analyzing critical elements of programs.

Simmons, D. C., & Kame’enui, E. J. (2003). A consumer’s guide to evaluating a core reading program grades K-3: A critical elements analysis. Retrieved December19, 2006.

Digest of Education Statistics 2015 Report Released

 The Digest of Education Statistics 2015 was just released by The Institute for Education Sciences (IES) National Center for Education Statistics (NCES).  This annual publication provides a compilation of statistical information covering the broad field of education from prekindergarten through graduate school. Topics include: the number of schools and colleges; teachers; enrollments; graduates; educational attainment; finances; federal funds for education; employment and income of graduates; libraries; technology; and international comparisons. It has been published annually since 1962, providing over 50 years of data with which to benchmark education performance at the system level in this country.

Snyder, T.D., de Brey, C., and Dillow, S.A. (2018). Digest of Education Statistics 2016 (NCES 2017-094). National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. Washington, DC.

Teacher pay for performance: Experimental evidence from the project on incentives in teaching

This paper presents the results of a rigorous experiment examining the impact of pay for performance on student achievement and instructional practice.

Springer, M. G., Ballou, D., Hamilton, L., Le, V. N., Lockwood, J. R., McCaffrey, D. F., ... & Stecher, B. M. (2011). Teacher Pay for Performance: Experimental Evidence from the Project on Incentives in Teaching (POINT). Society for Research on Educational Effectiveness.

Improving teaching effectiveness: Final report: The intensive partnerships for effective teaching through 2015–2016

Bill & Melinda Gates Foundation launched the Intensive Partnerships for Effective Teaching initiative. The initiative's goal is dramatic gains in student achievement, graduation rates, and college-going, especially for LIM students. 

Stecher, B. M., Garet, M. S., Hamilton, L. S., Steiner, E. D., Robyn, A., Poirier, J., ... & de los Reyes, I. B. (2016). Improving Teaching Effectiveness: Implementation: The Intensive Partnerships for Effective Teaching Through 2013–2014. Rand Corporation.

The effect of evaluation on teacher performance.

This paper offers evidence that evaluation can shift the teacher effectiveness distribution through a different mechanism: by improving teacher skill, effort, or both in ways that persist long-run.

Taylor, E. S., & Tyler, J. H. (2012). The effect of evaluation on teacher performance. American Economic Review102(7), 3628-51.

Can teacher evaluation improve teaching? Evidence of systematic growth in the effectiveness of mid-career teachers.

In the research reported here, the authors study one approach to teacher evaluation: practice-based assessment that relies on multiple, highly structured classroom observations conducted by experienced peer teachers and administrators. 

Taylor, E. S., & Tyler, J. H. (2012a). Can teacher evaluation improve teaching? Evidence of systematic growth in the effectiveness of mid-career teachers. Education Next, 12(4), 79–84. Retrieved from http://educationnext.org/can-teacher-evaluation-improve-teaching/

Teacher Evaluation 2.0.

This report proposes six design standards that any rigorous and fair teacher evaluation system should meet. It offers a blueprint for better evaluations that can help every teacher succeed in the classroom—and give every student the best chance at success. 

The New Teacher Project. (2010). Teacher Evaluation 2.0.New York, NY: Author. Retrieved from: https://tntp.org/assets/documents/Teacher-Evaluation-Oct10F.pdf

Rush to judgment: Teacher evaluation in public education

The authors examine the causes and consequences of the status of teacher evaluation and its implications for the current national debate about performance pay for teachers. The report also examines a number of national, state, and local evaluation systems that offer potential alternatives to current practice.

Toch, T., & Rothman, R. (2008). Rush to Judgment: Teacher Evaluation in Public Education. Education Sector Reports. Education Sector.

Use of single-case designs to evaluate manipulable influences on school performance.

Provides 2 hypothetical case examples that illustrate how single-case designs (alternating treatments, multiple baseline, and reversal) can be used to evaluate manipulable influences on school performance. In each case, an intervention plan is proposed for a student, and the success of the intervention is evaluated within a single-case design.

Wacker, D. P., Steege, M., & Berg, W. K. (1988). Use of single-case designs to evaluate manipulable influences on school performance. School Psychology Review.

Getting to outcomes: A results-based approach to accountability

This article presents a brief description of a manual called Getting to outcomes: methods and tools for planning, evaluation, and accountability (GTO) designed to assist practitioners in formulating the planning, implementation, and evaluation strategies for programs and policies. 

Wandersman, A., Imm, P., Chinman, M., & Kaftarian, S. (2000). Getting to outcomes: A results-based approach to accountability. Evaluation and program planning23(3), 389-395.

The Widget Effect: Our National Failure to Acknowledge and Act on Differences in Teacher Effectiveness.

This report examines the pervasive and longstanding failure to recognize and respond to variations in the effectiveness of teachers. 

Weisberg, D., Sexton, S., Mulhern, J., Keeling, D., Schunck, J., Palcisco, A., & Morgan, K. (2009). The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness. New Teacher Project.

TITLE
SYNOPSIS
National Council on Teacher Quality (NCTQ)

The National Council on Teacher Quality works to achieve fundamental changes in the policy and practices of teacher preparation programs, school districts, state governments, and teachers unions.

Back to Top