A case study in program development and refinement is presented. We describe the
Teaching-Family model and its history, the original research goal of developing a community-
based program that was more humane, more effective in teaching communityliving skills,
and less expensive than the traditional large state institutions prevalent when we began.
This paper examines a number of promising principal preparation programs to identify lessons for improving the impact of principals on student perrmance.
A new approach to principal preparation: Innovative programs share their practices and lessons learned. Rainwater Leadership Alliance, 2010.
This review of the research on secondary reading programs focuses on 69 studies that used random assignment (n=62) or high-quality quasi-experiments (n=7) to evaluate outcomes of 51 programs on widely accepted measures of reading.The study found programs using one-to-one and small-group tutoring (+0.14 to +0.28 effect size), cooperative learning (+0.10 effect size), whole-school approaches including organizational reforms such as teacher teams (+0.06 effect size), and writing-focused approaches (+0.13 effect size) showed positive outcomes. Individual approaches in a few other categories also showed positive impacts. The findings are important suggesting interventions for secondary readers to improve struggling student’s chances of experiencing greater success in high school and better opportunities after graduation.
Citation: Baye, A., Lake, C., Inns, A. & Slavin, R. E. (2018, January). A Synthesis of Quantitative Research on Reading Programs for Secondary Students. Baltimore, MD: Johns Hopkins University, Center for Research and Reform in Education.
An ecological model for school-based mental health services that targets urban low-income aggressive children—a highly vulnerable and underserved population—is presented.
Atkins, M. S., McKay, M. M., Arvanitis, P., London, L., Madison, S., Costigan, C., ... & Bennett, D. (1998). An ecological model for school-based mental health services for urban low-income aggressive children. The Journal of Behavioral Health Services & Research, 25(1), 64-75.
This study evaluated institutional sustainability of the Early Risers “Skills for Success” conduct problems prevention program.
August, G. J., Bloomquist, M. L., Lee, S. S., Realmuto, G. M., & Hektner, J. M. (2006). Can evidence-based prevention programs be sustained in community practice settings? The Early Risers’ advanced-stage effectiveness trial. Prevention Science, 7(2), 151-165.
This study used within-program comparison of follow-up survey responses from two sets of program graduates from a university-based leadership preparation program to determine differences in program features and outcome measures.
Ballenger, J., Alford, B., McCune, S. L., & McCune, E. D. (2010). Obtaining validation from graduates on a restructured principal preparation program. Jsl Vol 19-N5, 19 533.
The advantages and challenges associated with these designs for use in special education eligibility decisions are discussed as models for child evaluation in schools.
Barnett, D. W., Daly III, E. J., Jones, K. M., & Lentz Jr, F. E. (2004). Response to intervention: Empirically based special service decisions from single-case designs of increasing and decreasing intensity. The Journal of Special Education, 38(2), 66-79.
Over the past 10 years, the Southern Regional Education Board has helped states and public universities across the region evaluate their state policies for preparing school principals who are leaders of instruction. This benchmark report reviews the past decade and looks at 10 learning-centered leadership indicators to gauge how far states have come and how far they need to go in selecting, preparing and supporting leaders of change.
Bottoms, G., Egelson, P., & Bussey, L. H. (2012). Progress over a decade in preparing more effective school principals. Atlanta, GA: Southern Regional Education Board.
Students (N = 4,466) attending 56 schools in New York State were involved in a 3-year study testing the effectiveness of a cognitive-behavioral approach to substance abuse prevention.
Botvin, G. J., Baker, E., Dusenbury, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive-behavioral approach: results of a 3-year study. Journal of consulting and clinical psychology, 58(4), 437.
This article describes an evaluation of a prisoner-run delinquency prevention program at Hawaii's major prison.
Buckner, J. C., & Chesney-Lind, M. (1983). Dramatic cures for juvenile crime: An evaluation of a prisoner-run delinquency prevention program. Criminal Justice and Behavior, 10(2), 227-247.
This study examined principal preparation programs within the Pennsylvania State System of Higher Education to ascertain whether their programs were structured in a way that would equip principal candidates with the leadership roles deemed essential for 21st century school leadership.
Burks, Karlin. (2014). An Analysis of Principal Preparation Programs at Pennsylvania State Schools. Seton Hall University Dissertations and Theses (ETDs) Paper 1934.
Explores existing models of the school as a health care service delivery setting and considers the implications of these models for the practice of psychology in schools.
Carlson, C. I., Paavola, J., & Talley, R. (1995). Historical, current, and future models of schools as health care delivery settings. School Psychology Quarterly, 10(3), 184.
This report consists of two parts: a survey of 67 public school systems district staff serving as principal supervisors and on-site analysis of six districts pre-service training and support systems for new principals.
Corcoran, A., et al. (2013). Rethinking Leadership: The Changing Role of Principal Supervisors. The Wallace Foundation.
The authors examined the extent to which program integrity (i.e., the degree to which programs were implemented as planned) was verified and promoted in evaluations of primary and early secondary prevention programs published between 1980 and 1994.
Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clinical psychology review, 18(1), 23-45.
This study describe the schools, students, and programs in the for-profit higher education sector, it's phenomenal recent growth, and it's relationship to the federal and state governments. The study find that for-profit institutions educate a larger fraction of minority, disadvantaged, and older students, and they have greater success at reatining students in their first year and fetting them to complete short programs at the certificate and AA levels. But they also find that the for-profit students end-up with higher unemployment and "idleness" rates and lower earning six years after entering programs than do comparable students from other schools. and they have far greater student debt burdens and default rates on their student loans.
Deming, David J., Claudia Goldin, and Lawrence F. Katz. 2012. "The For-Profit Postsecondary School Sector: Nimble Critters or Agile Predators?" Journal of Economic Perspectives, 26 (1): 139-64.
The purpose of this study was to determine principals' perceptions of how effective mentoring programs and university-based principal preparation programs are in developing the skills necessary to carry out the 13 critical success factors identified by the Southern Regional Education Board (SREB). A review of the literature addressed what it means to be an effective principal and what an effective mentoring program should look like.
Dodson, R. B. (2006). The Effectiveness of Principal Training and Formal Principal Mentoring Programs.
This article reviews implementation issues in prevention trials and specifically highlights the study of implementation in the 34 programs determined to be effective in a recent review conducted by the Prevention Research Center for the Center for Mental Health Services.
Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193-221.
The National Council of Teacher Quality (NCTQ) review examines teacher preparation program progress in adopting the necessary components of evidence-based reading instruction. The report continues the effort of two previous reports offering educators a look at trends on preparation program progress on providing this essential training.
Drake, G., et al. (2020). Teacher Prep Review: Program Performance in Early Reading Instruction. National Council on Teacher Quality.https://www.nctq.org/dmsView/NCTQ_2020_Teacher_Prep_Review_Program_Performance_in_Early_Reading_Instruction
a brief overview of findings from the Blueprints for Violence Prevention-Replication Initiative is presented, identifying factors that enhance or impede a successful implementation of these programs.
Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5(1), 47-53.
This chapter reviews the theory of school-based accountability, describes variations across programs and identifies key features influencing the effectiveness and possible unintended consequences of accountability policies.
Figlio, D., & Loeb, S. (2011). School accountability. In E. A. Hanushek, S. J. Machin, & L. Woessman (Eds.), Handbooks in economics: Economics of education (Vol. 3, pp. 383–421). Amsterdam, Netherlands: Elsevier.
This paper discusses common elements of successfully sustaining effective practices across a variety of disciplines.
Fixsen, D. L., Blase, K. A., Duda, M., Naoom, S. F., & Van Dyke, M. (2010). Sustainability of evidence-based programs in education. Journal of Evidence-Based Practices for Schools, 11(1), 30-46.
This is a comprehensive literature review of the topic of Implementation examining all stages beginning with adoption and ending with sustainability.
Fixsen, D. L., Naoom, S. F., Blase, K. A., & Friedman, R. M. (2005). Implementation research: A synthesis of the literature.
The concepts of efficacy and effectiveness are examined from the viewpoints of the traditions and philosophies of health-care research and social program evaluation.
Flay, B. R. (1986). Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Preventive medicine, 15(5), 451-474.
In this report, the Southern Regional Education Board evaluates some 60 internship programs within its states and finds them lacking in a number of ways, including failing to provide real experiences in leadership. It urges policymakers, universities and school districts to create apprenticeships that better prepare aspiring principals for the demands they will face.
Fry, B., Bottoms, G., & O’neill, K. (2005). The principal internship: How can we get it right. Atlanta, GA: Southern Regional Education Board.
To implement RTI for prevention and identification, schools must make decisions about six components that constitute the process. The authors recommendation is that schools employ three tiers, with only one tier separating general and special education.
Fuchs, L. S., & Fuchs, D. (2007). A model for implementing responsiveness to intervention. Teaching exceptional children, 39(5), 14-20.
This study examines the influence of administrator credential programs, on-the-job experiences, and the standards in the development of urban public school principals.
Fultz, M. Assessing the Relationship Between Administrator Preparation Programs and Job Performance.
This report describes how Denver Public Schools hired personnel to coach and evaluate its principals.
Gill, J., (2013). Make Room for the Principal Supervisors. The Wallace Foundation.
This study present results of a comprehensive review of principal leadership assessment practices in the United States. Using the learning-centered leadership framework, it focused on identifying the congruence (or lack thereof) between documented assessment practices and the research-based criteria for effective leadership that are associated with improved school performance.
Goldring, E., Cravens, X. C., Murphy, J., Porter, A. C., Elliott, S. N., & Carson, B. (2009). The evaluation of principals: What and how do states and urban districts assess leadership?. The Elementary School Journal, 110(1), 19-39
With support from The Wallace Foundation, a Vanderbilt University team is developing a tool to monitor and assess the performance of school leaders. The Vanderbilt assessment will differ from existing tools by focusing 100 percent on instructional leadership and examining both principals and leadership teams. The paper, with two companion reports, presents the research behind and conceptual framework for the tool.
Goldring, E., Porter, A., Murphy, J., Elliott, S. N., & Cravens, X. (2009). Assessing learning-centered leadership: Connections to research, professional standards, and current practices. Leadership and Policy in Schools, 8(1), 1-36.
This study draws on data combining survey responses from principals, assistant principals, teachers and parents with administrative data to identify which principal skills matter most for school outcomes.
Grissom, J. A., & Loeb, S. (2011). Triangulating Principal Effectiveness How Perspectives of Parents, Teachers, and Assistant Principals Identify the Central Importance of Managerial Skills. American Educational Research Journal, 48(5), 1091-1123.
This study draws on a range of existing quantitative data resources, including Chicago Public Schools' personnel and test score data, and a biannual survey of teachers and principals to
Hart, H. M., Sporte, S. E., Ponisciak, S. M., Stevens, W., & Cambronne, A. (2008). Teacher and Principal Leadership in Chicago: Ongoing Analyses of Preparation Programs. Research Report. Consortium on Chicago School Research.
This report is a comprehensive and research-based framework outlining the conditions necessary for transformational school leaders to succeed. It offers a framework of conditions that can help districts enable great school leadership.
Ikemoto, G., Taliaferro, L., Fenton, B., Davis, J. (2014)Great Principals at Scale: Creating Districts That Enable All Principals to be Effective. New Leaders
This report examines the issue of school principal candidate standards as evidenced by below-average verbal, quantitative, and analytic scores, as measured by standardized tests.
Keedy, J. L., & Grandy, J. (1999). Trends in GRE Scores in Education Administration: Implications for Principal Preparation Programs. Retrieved from http://files.eric.ed.gov/fulltext/ED436828.pdf
By using data collected for the National Longitudinal Evaluation of Comprehensive School Reform (NLECSR), this article explores the factors that predict CSR model implementation and the ways that CSR model implementation varies.
Kurki, A., Boyle, A., & Aladjem, D. K. (2006). Implementation: Measuring and explaining the fidelity of CSR implementation. Journal of Education for Students Placed at Risk, 11(3-4), 255-277.
The Teacher Education Committee at Northwestern Oklahoma State University approved the development of a competency-based teacher education program. A subcommittee identified and wrote professional education competencies which students should master prior to program completion.
Lehr, M. (1981). Changes in Teacher Education: The Holy Grail of Quality.
No Child Left Behind Act of 2001 ESEA Reauthorization
No child left behind act of 2001. Publ. L, 107-110. (2002)
This report provides an overview of NYCLA’s flagship principal preparation program. Intended to help others involved in principal preparation think through important elements of principal preparation, including candidate selection, developing experiential learning opportunities, and funding, staffing and sustaining the program, the guide shares NYCLA’s successes and lessons learned during the 11 years we have delivered the Aspiring Principals Program in New York City, as well as through our work with various state and district partners nationally to adapt the program.
NYC Leadership Academy (2014). Taking Charge of Principal Preparation-A Guide to NYC Leadership Academy's Aspiring Principals Program. Retrieved from http://www.nycleadershipacademy.org/news-and-resources/tools-and-publications/pdfs/app-guide-full-guide.
This paper describes Auburn University's story of developing an innovative field-based master's level principal preparation program. The program’s goal was to align the program's curriculum and internship experiences with state and other accrediting agency standards, current leadership preparation research, and local educational agency (LEA) partner input and support. 0
Reames, E. (2010). Shifting Paradigms: Redesigning a Principal Preparation Program's Curriculum. Journal of Research on Leadership Education, 5, 436-459.
This book presents information and tools necessary to successfully evaluate all types of educational leaders and improve both individual and organizational performance.
Reeves, D. B. (Ed.). (2008). Assessing educational leaders: Evaluating performance for improved individual and organizational results. SAGE.
In this report, the Southern Regional Education Board outlines critical actions that states, districts, universities and principals themselves should take as part of a systematic plan to address principal succession. The report makes the case for principal succession planning and describes six steps for succession planning that states and districts can implement to ensure they have the right principals for the job.
Schmidt-Davis, J., & Bottoms, G. (2011). Who's Next? Let's Stop Gambling on School Performance and Plan for Principal Succession. Southern Regional Education Board (SREB).
A critical review of reading programs requires objective and in-depth analysis. For these reasons, the authors offer the following recommendations and procedures for analyzing critical elements of programs.
Simmons, D. C., & Kame’enui, E. J. (2003). A consumer’s guide to evaluating a core reading program grades K-3: A critical elements analysis. Retrieved December, 19, 2006.
A recent large-scale evaluation of Reading Recovery, a supplemental reading program for young struggling readers, supports previous research that found it to be effective. In a 4 year, federally funded project, almost 3,500 students in 685 schools found that generally students benefitted from the intervention. Students receiving Reading Recovery receive supplemental services in a 1:1 instructional setting for 30 minutes 5 days a week from an instructor trained in Reading Recovery. In the study reported here, students who received Reading Recovery had effect sizes of .35-.37 relative to a control group across a number of measures of reading. These represent moderate effect sizes and account for about a 1.5 month increase in skill relative to the control group. Even though the research supports the efficacy of the intervention, it also raises questions about its efficiency. The schools that participated in the study served about 5 students and the estimated cost per student has ranged from $2,000-$5,000. These data raise questions about the wisdom of spending this much money per student for growth of about a month and a half.
Sirinides, P., Gray, A., & May, H. (2018). The Impacts of Reading Recovery at Scale: Results From the 4-Year i3 External Evaluation. Educational Evaluation and Policy Analysis, 0162373718764828.
This paper analyzed the results of research on the effects of ability grouping and acceleration on students' academic achievement. Nineteen meta-analyses were met criteria for inclusion for the review. Results were found for improved academic achievement within-class grouping, cross-grade grouping by subject, and grouping for the gifted. No positive effects were identified for between-class grouping. The results were consistent regardless of whether students were high, medium, or low achievers. The study found acceleration appeared to have a positive, moderate, and statistically significant impact on students’ academic achievement.
Steenbergen-Hu, S., Makel, M. C., & Olszewski-Kubilius, P. (2016). What One Hundred Years of Research Says About the Effects of Ability Grouping and Acceleration on K–12 Students’ Academic Achievement: Findings of Two Second-Order Meta-Analyses. Review of Educational Research, 86(4), 849-899.
The present study was conducted to investigate the relationship between training procedures and treatment integrity.
Sterling-Turner, H. E., Watson, T. S., Wildmon, M., Watkins, C., & Little, E. (2001). Investigating the relationship between training type and treatment integrity. School Psychology Quarterly, 16(1), 56.
This article focuses on the systemic implementation features of SWPBS as a means of increasing the accurate adoption and sustained implementation of effective behavioral practices at the individual student, classroom, and school-wide levels. This article describes SWPBS, suggest how SWPBS might be implemented at broader systems levels, and discuss research and practice implications.
Sugai, G., & Horner, R. R. (2006). A promising approach for expanding and sustaining school-wide positive behavior support. School psychology review, 35(2), 245.
This meta-analysis examines the impact of 1st tier reading instruction on reading outcomes for students in grades 4-12 in an Multi-tiered System of Support (MTSS) service delivery model. 37 studies met criteria for inclusion in the meta-analysis. The study finds small, but positive effects for 1st tier reading instruction on comprehension, vocabulary, and indicates minimum evidence for struggling readers maintaining or improving reading comprehension over struggling students receiving typical instruction. Hedges’s g was used calculating effect sizes. Because of the limited number of studies examining phonics/word recognition and fluency instruction, it was not possible these critical instruction areas in this meta-analysis.
Swanson, E., Stevens, E. A., Scammacca, N. K., Capin, P., Stewart, A. A., & Austin, C. R. (2017). The impact of tier 1 reading instruction on reading outcomes for students in Grades 4–12: A meta-analysis. Reading and Writing, 30(8), 1639-1665.
This article summarize changes and challenges that school personnel will face in order to implement The Individuals with Disabilities Education Improvement Act of 2004 (IDEIA).
This book is about the creation and 14 year evolution of a public alternative inner-city high school—New Haven, CT's High School in the Community (HSC). This school lived an idea—empowerment. Students were encouraged to participate in shaping many aspects of their education, teachers were responsible for running the school, and parents invited to help govern.
Trickett, E. J. (1991). Living an idea: Empowerment and the evolution of an alternative high school. Brookline Books.
Intended for state officials involved in the assessment and approval of university and other programs to train future school principals, this report describes five design principles for effective program evaluation.
UCEA and New Leaders (2016). Improving state evaluation of principal preparation programs. Retrieved from: www.sepkit.org
This report represents the first systematic comparison of student outcomes in schools led by the Aspiring Principals Program (APP) graduates after three years to those in comparable schools led by other new principals.
Weinstein, M., Schwartz, A. E., & Corcoran, S. P. (2009). The New York City Aspiring Principals Program: A School-Level Evaluation. NYU Wagner Research Paper, (2011-07).
This study compares the effect size and return on investment for rapid assessment, between, increased spending, voucher programs, charter schools, and increased accountability.
Yeh, S. S. (2007). The cost-effectiveness of five policies for improving student achievement. American Journal of Evaluation, 28(4), 416-436.