Professional Judgment

All Research

TITLE
SYNOPSIS
CITATION
Professional judgment: A critical appraisal.

Professional judgment is required whenever conditions are uncertain.  This article provides an analysis of professional judgment and describes sources of error in decision making.

Barnett, D. W. (1988). Professional judgment: A critical appraisal. School Psychology Review., 17(4), 658-672.

Psychometric qualities of professional practice.

This chapter is intended to help solve questions concerning how to judge the appropriateness of assessment or measurement decisions and of the information used to make decisions.

Barnett, D. W., Lentz Jr, F. E., & Macmann, G. (2000). Psychometric qualities of professional practice.

Why education experts resist effective practice: Report of the Thomas B. Fordham Foundation

This essay provides examples from reading and math curricula, describes how experts have, for ideological reasons, shunned some solutions that do display robust evidence of efficacy, then examines how public impatience has forced other professions to “grow up” and accept accountability and scientific evidence. 

Carnine, D. (2000). Why education experts resist effective practices (Report of the Thomas B. Fordham Foundation). Washington, DC: Thomas B. Fordham Foundation.

Promoting Open Science to Increase the Trustworthiness of Evidence in Special Education.

The past two decades has seen an explosion of research to guide special educators improve the lives for individuals with disabilities. At the same time society is wrestling with the challenges posed by a post-truth age in which the public is having difficulty discerning what to believe and what to consider as untrustworthy. In this environment it becomes ever more important that researchers find ways to increase special educator’s confidence in the available knowledge base of practices that will reliably produce positive outcomes. This paper offers methods to increase confidence through transparency, openness, and reproducibility of the research made available to special educators. To accomplish this the authors propose that researchers in special education adopt emerging open science reforms such as preprints, data and materials sharing, preregistration of studies and analysis plans, and Registered Reports.

Cook, B. G., Lloyd, J. W., Mellor, D., Nosek, B. A., & Therrien, W. (2018). Promoting Open Science to Increase the Trustworthiness of Evidence in Special Education.

Evidence-based medicine

This journal attempts to fill the chasm by helping doctors find the information that will ensure they can provide optimum management for their patients. 

Davidoff, F., Haynes, B., Sackett, D., & Smith, R. (1995). Evidence based medicine.

Chapter 2 Evidence-Based Education and Best Available Evidence: Decision-Making Under Conditions of Uncertainty.

Decisions always involve a degree of uncertainty because the outcomes are not known.  This chapter explores the sources of evidence that can inform educational decisions.

Detrich, R., Slocum, T. A., & Spencer, T. D. (2013). Chapter 2 Evidence-Based Education and Best Available Evidence: Decision-Making Under Conditions of Uncertainty. In B. G. Cook, M. Tankersley, & T. J. Landrum (Eds.), Evidence-Based Practices (pp. 21-44.). Emerald Group Publishing Limited

Formal mentoring programs in education and other professions: A review of the literature

This paper draws upon a structured analysis of over 300 research-based papers on mentoring across three discipline areas in an attempt to make more valid inferences about the nature and outcomes of mentoring.

Ehrich, L. C., Hansford, B., & Tennent, L. (2004). Formal mentoring programs in education and other professions: A review of the literature. Educational administration quarterly40(4), 518-540.

Will the “principles of effectiveness” improve prevention practice? Early findings from a diffusion study

This study examines adoption and implementation of the US Department of Education's new policy, the `Principles of Effectiveness', from a diffusion of innovations theoretical framework. In this report, we evaluate adoption in relation to Principle 3: the requirement to select research-based programs.

Hallfors, D., & Godette, D. (2002). Will the “principles of effectiveness” improve prevention practice? Early findings from a diffusion study. Health Education Research, 17(4), 461–470.

Misconceptions about data-based decision making in education: An exploration of the literature

Research on data-based decision making has proliferated around the world, fueled by policy recommendations and the diverse data that are now available to educators to inform their practice. Yet, many misconceptions and concerns have been raised by researchers and practitioners. This paper surveys and synthesizes the landscape of the data-based decision-making literature to address the identified misconceptions and then to serve as a stimulus to changes in policy and practice as well as a roadmap for a research agenda.

Mandinach, E. B., & Schildkamp, K. (2021). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation69, 100842.

Evidence-based decision-making: A team effort toward achieving goals

Implementing evidence-based practices requires not only knowledge of various interventions and practices but also professional judgment in selecting and applying an intervention that best meets the needs of the child and the family.  Previous work on decision-making in evidence-based practices has focused on describing evidence-based practices, how the identification of evidence-based practices has affected the field of education (and, specifically, special education), and strategies for implementing evidence-based practices

McCollow, M. M., & Hoffman, H. H. (2020). Evidence-based decision-making: A team effort toward achieving goals. Young Exceptional Children23(1), 15-23.

Evidence-based Pharmacologic Treatment for People with Severe Mental Illness: a focus on guidelines and algorithms.

In this article we discuss guidelines and algorithms as a means of addressing the complexity of pharmacologic treatment of people with severe mental illnesses and disseminating relevant research findings.

Mellman, T. A., Miller, A. L., Weissman, E. M., Crismon, M. L., Essock, S. M., & Marder, S. R. (2001). Evidence-based pharmacologic treatment for people with severe mental illness: a focus on guidelines and algorithms. Psychiatric Services52(5), 619-625.

Demanding Medical Excellence: Doctors and Accountability in The Information Age.

This book reveals how the information revolution is changing the way doctors make decisions. Michael Millenson, a three-time Pulitzer Prize nominee as a health-care reporter for the Chicago Tribune, illustrates serious flaws in contemporary medical practice and shows ways to improve care and save tens of thousands of lives.

Millenson, M. L. (2018). Demanding medical excellence: Doctors and accountability in the information age. University of Chicago Press.

Diffusion of innovations

This book looks at how new ideas spread via communication channels over time. Such innovations are initially perceived as uncertain and even risky. To overcome this uncertainty, most people seek out others like themselves who have already adopted the new idea. Thus the diffusion process typically takes months or years. But there are exceptions: use of the Internet in the 1990s, for example, may have spread more rapidly than any other innovation in the history of humankind. 

Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York, NY: Free Press.

Identifying research-based practices for response to intervention: Scientifically-based instruction

This paper examines the types of research to consider when evaluating programs, how to know what “evidence’ to use, and continuums of evidence (quantity of the evidence, quality of the evidence, and program development).

Twyman, J. S., & Sota, M. (2008). Identifying research-based practices for response to intervention: Scientifically based instruction. Journal of Evidence-Based Practices for Schools, 9(2), 86-101.

Back to Top