Categories for Effective Instruction

What is the effect of feedback on teacher preparation programs?

October 7, 2019

Public Accountability and Nudges: The Effect of an Information Intervention on the Responsiveness of Teacher Education Programs to External Ratings.  Teacher preparation programs (TEP) have received a great deal of research and policy attention as a potential driver of improvements in teacher quality and improved student outcomes. This paper presents research on external ratings of teacher education programs (TEPs) produced by the National Council on Teacher Quality (NCTQ) and the results of an experiment to improve school rankings by providing information and feedback to TEPs about how to improve their ratings. Research suggests that higher education institutions are responsive to feedback and public ratings. The college rankings published by U.S. News and World Report (USNWR) shows how powerful ratings can be in changing higher education practices such as admissions requirements, financial aid disbursements, and policies. NCTQ released the first ranking of TEP’s in 2014 as a part of an ongoing effort to rate teacher training nationally. The intervention relied upon providing targeted information about specific programmatic changes that would improve the rating for a randomly selected sample of elementary teacher education programs. Average program ratings improved between 2013 and 2016, but we find no evidence that the information intervention increased program responsiveness to NCTQ’s rating effort. The results show that the experimental group had lower ratings than the control group in 2016. 

Citation: Goldhaber, D., & Koedel, C. (2019). Public Accountability and Nudges: The Effect of an Information Intervention on the Responsiveness of Teacher Education Programs to External Ratings. American Educational Research Journal, 0002831218820863.

Linkhttps://files.eric.ed.gov/fulltext/ED583637.pdf

 


 

What is the impact of cash incentives for grades on student cheating?

September 30, 2019

Do Pay-for-Grades Programs Encourage Student Cheating? Evidence from a randomized experiment.  Pay-for-grades programs are designed to increase student academic performance. One of the claims of those opposing such incentive systems is monetary incentives may lead to academic cheating. This randomized controlled study of 11 Chinese primary schools examines the effects of pay-for-grades programs on academic fraud. The study found widespread cheating behavior for students regardless of being in the control or experimental group, but no overall increase in the level of cheating for students in the pay-for-grades program. The authors conclude that educators need to be on the lookout for academic dishonesty, especially on standardized tests, while using moderate incentives to encourage student learning did not lead to increased levels of gaming the system.

Citation:  Li, T., & Zhou, Y. (2019). Do Pay-for-Grades Programs Encourage Student Academic Cheating? Evidence from a Randomized Experiment. Frontiers of Education in China14(1), 117-137.

Linkhttps://link.springer.com/article/10.1007/s11516-019-0005-9

 


 

A look at John Hattie’s latest work

September 27, 2019

Visible Learning Insights. This book by John Hattie and Klaus Zierer is written for teachers, education researchers, and anyone interested in the latest research on the efficacy of education practices. This research offers an overview of 1,400 meta-analyses and continues to build on the work John Hattie began with his book, Visible Learning, published over a decade ago that provided educators with a synthesis of 800 meta-analyses. 

Citation: Hattie, J., & Zierer, K. (2019). Visible Learning Insights. Routledge.

Linkhttps://www.routledge.com/Visible-Learning-Insights-1st-Edition/Hattie-Zierer/p/book/9781138549692

 


 

How can educators improve how research is conducted?

September 26, 2019

Evidence-Based Practices in a Changing World: Reconsidering the Counterfactual in Educational Research. Much of current education research relies on experimental and quasi-experimental designs to establish causality and to ascertain the effectiveness of practices. These research designs rely on a comparison between a treatment group and a control group. Current methods assume the population from which control groups are unchanging in behavior or performance. This paper challenges this notion and finds that populations and study samples often change over time and sometimes do so dramatically. The authors examine data from 5 randomized control trials of the efficacy of Kindergarten Peer-Assisted Learning Strategies, a supplemental, peer-mediated reading program. The paper finds a significant increase in the performance of control students over time, suggesting the need for a more nuanced understanding of current research practices in the identification of evidence-based practices.

Citation: Lemons, C. J., Fuchs, D., Gilbert, J. K., & Fuchs, L. S. (2014). Evidence-based practices in a changing world: Reconsidering the counterfactual in education research. Educational Researcher43(5), 242-252.

Linkhttps://edarxiv.org/67z25/download?format=pdf

 


 

Is all feedback alike?

September 26, 2019

What Is My Next Step? School Students’ Perceptions of Feedback. The power of feedback is touted as one of the most powerful practices for improving performance. Research consistently reports large effect sizes for feedback improving performance, yet variability relating to the effects of feedback exists. The Kluger and DeNisi 1996 meta-analysis was one such study that found a medium 0.41 effect size for the general impact of feedback. What Kluger and DeNisi found was that not all feedback is alike. This 2019 study attempts to increase our knowledge base by examining the power of different forms of feedback as a means to increase the impact of teacher delivered feedback. The paper aims to investigate student perceptions of feedback through designing a student feedback perception questionnaire (SFPQ) based on a conceptual model of feedback. The questionnaire was used to collect data about the helpfulness for learning resulting from different feedback types and levels. Findings from this study demonstrate that the SPFQ tool partially affirms Hattie and Timperely’s (2007) conceptual model of feedback. Feeding forward (information about improvement) was found to be a unique feedback type that was perceived by participants as being most helpful to learning compared to other feedback.

Citation: Brooks, C., Huang, Y., Hattie, J., Carroll, A., & Burton, R. (2019). What is my next step? School students’ perceptions of feedback. In Frontiers in Education (Vol. 4, p. 96). Frontiers.

Linkhttps://www.frontiersin.org/articles/10.3389/feduc.2019.00096/full

 


 

Informal Teacher Evaluation (Original Wing Institute Paper)

September 3, 2019

Research on informal teacher evaluation reveals the predominant evaluation method is the walk-though, which ranges from a brief 2- to 3-minute snapshot to longer observation. Studies support the important role principals play in instructional leadership but also suggest that principals are not good at identifying which teachers are the best instructors. Research finds that principals overwhelmingly understand the need to sample teacher performance but that they are rarely trained in how to accomplish this. 

Citation: Cleaver, S., Detrich, R., & States, J. (2019). Informal Teacher Evaluation. Oakland, CA: The Wing Institute. Retrieved from https://www.winginstitute.org/staff-informal.

Link: https://www.winginstitute.org/staff-informal-walk-throughs

 


 

Teacher Retention Analysis Overview (Wing Institute Original paper)

August 27, 2019

Matching the availability of teachers to demand constantly evolves. During recessions schools are forced to layoff teachers. As economic times improve, schools acquire resources and rehire personnel. Currently, American schools are faced with the most severe shortages in special education; science, technology, engineering, and math (STEM); and bilingual education. Shortages vary across the country and are most acute in areas with lower wages and in poor schools. Starting in the 1980’s schools began filling vacancies with under-qualified personnel hired on emergency or temporary credentials to meet needs. A 35% drop in pre-service enrollment and high teacher attrition currently impact the supply. Candidates and veteran teachers are influenced to leave teaching due to low compensation, stressful working conditions, and a perceived decline in respect. The demand side is influenced primarily by fluctuations in population, finances, and education policy. Matching supply to demand is a challenge but can be accomplished through better planning, procuring less volatile funding sources, and improving working conditions through improved pay and effective training.

Citation: Donley, J., Detrich, R. Keyworth, R., & States, J., (2019). Teacher Retention Analysis Overview. Oakland, CA: The Wing Institute. https://www.winginstitute.org/teacher-retention-turnover-analysis.

Link: https://www.winginstitute.org/teacher-retention-turnover-analysis

 


 

How to best teach critical thinking

August 15, 2019

How to teach critical thinking.  Despite consensus on the need for critical thinking, considerable debate exists over how it is learned and, how educators can best support students to develop critical thinking capabilities. This paper considers what the research can tell us about how critical thinking is acquired, and the implications for how education might best develop young people’s critical thinking capabilities.

Willingham recommends a four-step process to develop a program to teach critical thinking:

  • identify a list of critical thinking skills for each subject domain;
  • identify subject matter content for each domain;
  • plan the sequence in which knowledge and skills should be taught;
  • plan which knowledge and skills should be revisited across years.

Citation: Willingham, D. (2019). How to teach critical thinking. New South Wales (NSW) Department of Education.

Linkhttps://prod65.education.nsw.gov.au/content/dam/main-education/teaching-and-learning/education-for-a-changing-world/media/documents/How-to-teach-critical-thinking-Willingham.pdf

 


 

Which evidence-based behavior management practices support ethnically–racially diverse students?

August 15, 2019

Classroom management for ethnic–racial minority students: A meta-analysis of single-case design studies. This meta-analysis looks at behavior management practices implemented with ethnically and racially diverse students. It examines single-subject designed studies implemented at the whole class level. Results indicate that class-wide management approaches applied in diverse classrooms are heavily behavioral and highly effective in improving student behavior.

Citation: Long, A. C., Miller, F. G., & Upright, J. J. (2019). Classroom management for ethnic–racial minority students: A meta-analysis of single-case design studies. School Psychology34(1), 1.

Link: https://psycnet.apa.org/record/2018-65318-001

 


 

Which teaching practices produce the best elementary school writers.

August 15, 2019

Teaching Elementary School Students to Be Effective Writers: A Practice Guide. This What Works Clearinghouse (WWC) practice guide examines the research on how teaching elementary students how to write. The report analyzes the evidence supporting those teaching methods commonly employed to increase student competency in becoming a fluent writer. The guide is for teachers, literacy coaches, principals, districts, and curriculum developers, and other educators. The paper summarizes the available research and provides recommendations on the types of activities and strategies teachers can use to increase student writing proficiency. 

Citation: Graham, S., Bollinger, A., Olson, C. B., D’Aoust, C., MacArthur, C., McCutchen, D., & Olinghouse, N. (2012). Teaching Elementary School Students to Be Effective Writers: A Practice Guide. NCEE 2012-4058. What Works Clearinghouse.

Linkhttps://files.eric.ed.gov/fulltext/ED533112.pdf