Categories for Societal Outcomes
July 10, 2018
The Effect of Voucher Programs on Student Achievement: A Meta-Analysis
News Summary: This meta-analysis examines the effectiveness of school voucher programs for improving student achievement. The research is of special interest for three important reasons; (1) it examines an important policy issue relevant to educators and the public, (2) it is an example of a study designed to replicate previous research on an important topic, and (3) it highlights the importance of examining the cost effectiveness associated with implementing practices in real world settings.
The use of school vouchers as a means to improve the quality of education has been an attractive, although controversial. It has been touted as a way to use public funding to overcome academic deficits in school systems. Enabling parents to exercise choice as to where to send a child to school is enticing. It appeals to the belief that exercising “control” over where your child can go to school will have an impaction the quality of education. The important question is, does this type of structural intervention produce both statistically significant, but more importantly do school vouchers produce socially significant academic gains?
This study tries to answer this question by replicating a previous meta-analysis of school voucher programs by Shakeel, Anderson, and Wolf (2016). The studies included in both meta-analyses required that to be included in the research individual studies must use randomized control trials of school voucher programs reporting quantitative measures of reading and/or math performance. The Wing Institute chose to include this new item to feature the need for replicating research as means to increase confidence in the results and broaden our knowledge base on a topic. The results indicated that, compared to the original study, this meta-analysis obtained smaller effect sizes with larger standard errors. This is not surprising as most replication of original research report smaller effects. The results of this research although somewhat smaller are consistent with the Shakeel, Anderson, and Wolf (2016) study. More importantly, both studies found that although the effects were for the most part positive they were very small ranging from 0.080 effect size on reading to 0.135 effect size on math.
It is important to note these results are also similar to those found in the Yeh, S. S. (2007) research on this topic. Yeh goes beyond reporting on effect size to examine the importance of putting effect size in the context of cost-effectiveness. It becomes quite clear when one asks the question, are school vouchers a cost effective intervention designed to deliver significant change, this intervention is found wanting. Yeh in his research concludes that educators and the public will be better served by adopting a practice such as formative assessment, that has a greater effective size (0.90) and can be implemented at a much smaller cost.
(1) Bennett, M., Banerjee, H. L., Doan, L. N., Geib, T., and Burley, A. (2018). The Effect of Voucher Programs on Student Achievement: A Meta-Analysis. AERA Conference New York, NY. 10.302/1302823.
(2) Shakeel, M., Anderson, K., & Wolf, P. (2016). The participant effects of private school vouchers across the globe: A meta-analytic and systematic review.
(3) Yeh, S. S. (2007). The cost-effectiveness of five policies for improving student achievement. American Journal of Evaluation, 28(4), 416-436.
July 2, 2018
Postsecondary Institutions and Cost of Attendance in 2017-18; Degrees and Other Awards Conferred, 2016-17; and 12-Month Enrollment, 2016-17
News Summary: The purpose of this preliminary report is examine the most recent data on the cost of sending students to college in the Unities States. During the 2017–18 academic year, there were 6,642 Title IV institutions of this total, 2,902 were classified as 4-year institutions, 1,932 were 2-year institutions, and the remaining 1,808 were less-than-2-year institutions. Average tuition and required fees for full-time, first-time degree/certificate-seeking undergraduates at 4-year institutions increased across all institutional controls except private for-profit institutions from 2015-16 to 2017–18. Public institutions reported a roughly 2 percent increase for in-state students (to approximately $8,300) and for out-of-state students (to approximately $18,700). Private nonprofit institutions reported an increase of approximately 3 percent (to about $28,000). Private for-profit institutions reported average tuition and required fees of approximately $16,200 for 2017–18. This represents a decrease of over 1 percent when compared with the inflation-adjusted figure from 2015–16. Approximately 3.3 million students received degrees or certificates at 4-year degree-granting institutions with more than 58 percent obtained a bachelor’s degree.
Citation:Ginder, S. A., Kelly-Reid, J. E., & Mann, F. B. (2018). Postsecondary Institutions and Cost of Attendance in 2016-17; Degrees and Other Awards Conferred, 2015-16; and 12-Month Enrollment, 2015-16: First Look (Provisional Data). NCES 2017-075rev. National Center for Education Statistics.
July 2, 2018
Preparing for Life after High School: The Characteristics and Experiences of Youth in Special Education. Findings from the National Longitudinal Transition Study 2012. Volume 2: Comparisons across Disability Groups. Full Report
News Summary:The United States has committed to improving the lives of students with disabilities for over 40 years. Since the advent of Federal Law PL 94-142 in 1975 that mandated a free and appropriate education for all students regardless of ability and six reauthorizations of legislation, the federal government has emphasized the need to prepare students with disabilities for post-secondary education, careers, and independent living. The federal investment in funding special education services exceeds $15 Billion annually. It is reasonable to ask, are student with disabilities substantially benefiting from these efforts? The National Longitudinal Transition Study (NLTS) provides the most recent data on youth with disabilities and efforts to address their needs. The study used surveys in 2012 and 2013 on a nationally representative set of nearly 13,000 students. The student included were mostly those with an individualized education program (IEP) and expected to receive special education services. The data reveal participation in key transition activities by youth with an IEP and their parents have declined, although they are just as likely to have gone to an IEP meeting. The findings from this report suggest a closer examination of current practices is warranted with a focus on achieving the stated outcomes the laws were designed to remedy.
Citation: Lipscomb, S., Hamison, J., Liu Albert, Y., Burghardt, J., Johnson, D. R., & Thurlow, M. (2018). Preparing for Life after High School: The Characteristics and Experiences of Youth in Special Education. Findings from the National Longitudinal Transition Study 2012. Volume 2: Comparisons across Disability Groups. Full Report. NCEE 2017-4018. National Center for Education Evaluation and Regional Assistance.
May 1, 2018
The National Assessment of Educational Progress (NAEP) has been assessing what American students know and can do in various subject areas since 1969. Subjects include: mathematics, reading, science, writing, the arts, civics, economics, geography, U.S. history, and in Technology and Engineering Literacy (TEL). NAEP generates the Nation’s Report Card every two years summarizing test scores by subject area, grade levels (4th, 8th, and 12th), student demographics, school characteristics, etc. With very few exceptions, the 2017 national results did not show any gains in test scores from previous years. One of the more critical metrics is the percentage of students who score at or above proficiency. Proficiency is the target academic performance benchmark for students. The 2017 results show that few students are at or above proficiency in all subjects. In reading, only 37% of fourth graders, 36% of eighth graders, and 357% of twelfth grader were at or above proficiency. In math, each subsequent assessed grade showed lower percentages of students at or above proficiency (4thgrade at 40%, 8thgrade at 34%, 12thgrade at 25%). Such scores are disappointing given the efforts made towards school improvement.
Citation: Institute of Education Sciences. (2018). The Nation’s Report Card, 2017. NCES 2006-451. National Center for Education Statistics.
April 23, 2018
A Synthesis of Quantitative Research on Reading Programs for Secondary Students
This review of the research on secondary reading programs focuses on 69 studies that used random assignment (n=62) or high-quality quasi-experiments (n=7) to evaluate outcomes of 51 programs on widely accepted measures of reading. Reading performance of students in America’s middle and high schools is one of the most important problems in education. In 2015, the National Assessment of Educational Progress (NAEP; NCES, 2016) reported that only 34% of eighth graders scored at or above proficiency. At the twelfth-grade level only 37% of students scored at or above proficiency. Given the importance of mastering reading for success in school it is important that schools adopt programs to help bridge the gap between current performance and expectations.
The study found programs using one-to-one and small-group tutoring (+0.14 to +0.28 effect size), cooperative learning (+0.10 effect size), whole-school approaches including organizational reforms such as teacher teams (+0.06 effect size), and writing-focused approaches (+0.13 effect size) showed positive outcomes. Individual approaches in a few other categories also showed positive impacts. These include programs emphasizing social studies/science, structured strategies, and personalized and group/personalization rotation approaches for struggling readers.
An important finding was programs providing a daily extra period of reading and those utilizing technology were no more effective, on average, than programs that did not provide these resources. This might not be as surprising as it appears on the surface. If students are struggling in reading, just placing them in a setting to read may only produce additional frustration and failure for those currently struggling with reading.
A few commonalities among programs that achieved positive outcomes are worth noting. One of these factors was that programs with positive outcomes tended to emphasize student motivation, student-to-student and student-to-teacher relationships, and social-emotional learning. An additional factor found in many of the promising programs is individualizing the intervention.
The findings are important suggesting interventions for secondary readers to improve struggling student’s chances of experiencing greater success in high school and better opportunities after graduation. Although, these effect sizes are small, given the large number of participants, smaller effect sizes would be anticipated and still may be of interest to school administrators.
Citation: Baye, A., Lake, C., Inns, A. & Slavin, R. E. (2018, January). A Synthesis of Quantitative Research on Reading Programs for Secondary Students. Baltimore, MD: Johns Hopkins University, Center for Research and Reform in Education.
April 10, 2018
Call for Action to Prevent Gun Violence in the United States of America Interdisciplinary Group on Preventing School and Community Violence
In response to the continuing gun violence in American schools, an interdisciplinary group of 19 scholars are proposing an eight-point plan to prevent future tragedies that have become common place in the nation. This one-page position statement proposes a public health approach to protecting children as well as adults from gun violence involves three levels of prevention: (1) universal approaches promoting safety and well-being for everyone; (2) practices for reducing risk and promoting protective factors for persons experiencing difficulties; and (3) interventions for individuals where violence is present or appears imminent.
Citation: Astor, R. et al. (2018). Call for Action to Prevent Gun Violence in the United States of America. University of Virginia.
April 10, 2018
Discipline Disparities for Black Students, Boys, and Students with Disabilities
The US Government Accountability Office has recently released a new report evaluating the disproportionality in discipline in K-12 grades. The racial and gender gap persists in spite of efforts to remediate. African-American youth, boys, and individuals with disabilities are more likely to receive any type of discipline than are individuals in our sub-groups than would be predicted on the basis of their percentage of the population. In this evaluation, the disproportionality existed even though economic level of the student was controlled for. Previously, it had been argued that the disproportionality was a function of poverty rather than race and gender. This study challenges that argument. These data highlight that as a society we still have a great deal of work to do to overcome racial and gender biases in this country.
Citation: United States Governmental Accountability Office (2018). K-12 education: A guide for schools (GAO publication-18-258). Retrieved from https://www.gao.gov/products/GAO-18-258
March 21, 2018
The Effectiveness of School-Based Mental Health Services for Elementary-Aged Children: A Meta-Analysis
News Summary: This meta-analysis examines the effects of school-based mental health services for elementary school-age children delivered by school personnel. Forty-three controlled trials evaluating 49,941 elementary school-age children met criteria for inclusion in this study. The study used a randomized, between-subjects, controlled comparison or quasi-experimental design using matched samples to minimize selection bias. The study finds school-based mental health services had a small to medium effect size (Hedges g = 0.39) in decreasing mental health problems. The largest effect size was for targeted intervention, (Hedges g = 0.76), followed by selective prevention (Hedges g = 0.67) compared with universal prevention (Hedges g = 0.29). Interventions integrated into student’s academic instruction using contingency management were found to have positive impacts (Hedges g = 0.57), and interventions implemented multiple times per week (Hedges g = 0.50) were also shown to have a notable impact for improving student’s lives. These results are promising considering the normal barriers that impede students from receiving mental health care outside of school and the fact 80% of mental health service are provided in schools by personnel who are readily available and are shown to be effective in addressing student’s mental health needs (Ringeisen, Henderson, and Hoagwood, 2003).
- Targeted Intervention: interventions provided only to students identified as having mental health problems.
- Universal prevention: interventions provided to all students in a classroom
- Selective prevention: interventions provided only to students at risk for mental health problems according to a teacher referral or mental health screening
Citation: Sanchez, A. L., Cornacchio, D., Poznanski, B., Golik, A. M., Chou, T., & Comer, J. S. (2018). The effectiveness of school-based mental health services for elementary-aged children: a meta-analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 57(3), 153-165.
March 8, 2018
What We Know About Literal and Inferential Comprehension in Reading
In 2000, the National Reading Panel identified five practice elements with a sufficient evidence base to be deemed essential for mastery of reading (National Institute of Child Health and Human Development, 2000). These elements consist of systematic teaching of phonemic awareness, phonics instruction, vocabulary, fluency, and exposure to reading comprehension strategies. Of these skill sets, reading comprehension has received far less attention in the literature, but is indispensable for success as student’s progress through the grades and use reading in almost every course. Being able to make effective inferences from materials that a student read is considered central to effective reading comprehension. This meta-analysis of 25 studies evaluates the impact of inference instruction in grades K-12. The study reported that inference instruction had an effect size d=0.58 on general comprehension and d= 0.68 on literal comprehension. These are “moderate to large” effects of instruction on general comprehension and to making inferences for both skilled and less skilled readers. The pattern differed for the literal measure, however, with skilled readers showing almost no gain but unskilled readers showing sizable gains. These findings support work by Daniel Willingham and Gail Lovette titled, “Can Reading Comprehension be Taught”? Their interpretation of the effect of comprehension instruction is that it signals to students the significance of inferential thinking. Willingham and Lovette conclude that practicing inferences does not lead to increases in general inferencing for the following reasons; inferencing depends on the particular text, and whatever cognitive processes contribute to inferencing are already well practiced in oral language as we are constantly drawing inferences in daily conversation.
Citation: Elleman, A. M. (2017). Examining the impact of inference instruction on the literal and inferential comprehension of skilled and less skilled readers: A meta-analytic review. Journal of Educational Psychology, 109(6), 761-781.
Willingham, D. T., & Lovette, G. (2014). Can reading comprehension be taught. Teachers College Record, 116, 1-3
March 2, 2018
Trends in High School Dropout and Completion Rates in the United States: 2014 Report Released
The Institute for Education Sciences (IES) National Center for Education Statistics (NCES) just released Trends in High School Dropout and Completion Rates in the United States: 2014. This annual report provides descriptive data on long-term trends in dropout and completion rates. It also reviews the characteristics of students in these categories including race/ethnicity, sex, socioeconomic status, disability status, immigration status, and outcomes in the labor force. Results show improvement in overall outcomes, but continued and significant disparity among children of different races. The 2014 ACS status dropout rate was lower for 16- to 24-year-olds who were Asian (2.5 percent), White (4.4 percent), and of two or more races (5.0 percent) than for those who were Black (7.9 percent), Pacific Islander (10.6 percent), Hispanic (10.7 percent), and American Indian/ Alaska Native (11.5 percent). There was also significant disparity between individual states, ranging from 2.7 percent status dropout rates in Vermont to 10.6 percent in Louisiana. High School graduation rates showed the same pattern of overall improvement but continued disparity by student race and individual states.
Citation: McFarland, J., Cui, J., and Stark, P. (2018). Trends in High School Dropout and Completion Rates in the United States: 2014 (NCES 2018-117). National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. Washington, DC.