Assessment and Evaluation

Test Score Patterns Across Three COVID-19-impacted School Years

Kuhfeld, M.; Soland, J.; and Lewis, K. Test Score Patterns Across Three COVID-19-impacted School Years (2022). Brown University Annenberg Institute, EdWorking Paper No. 22-521. 

The COVID-19 pandemic has been a seismic and on-going disruption to K-12 schooling. Using test scores from 5.4 million U.S. students in grades 3-8, we tracked changes in math and reading achievement across the first two years of the pandemic. Average fall 2021 math test scores in grades 3-8 were .20-27 standard deviations (SDs) lower relative to same-grade peers in fall 2019, while reading test scores decreased by .09-.18 SDs. Achievement gaps between students in low-poverty and high-poverty elementary schools grew by .10-.20 SDs, primarily during the 2020-21 school year. Observed declines are more substantial than during other recent school disruptions, such as those due to natural disasters.

What Does “Below Basic” Mean on NAEP Reading?

White TG, Sabatini JP, White S. What Does “Below Basic” Mean on NAEP Reading? Educational Researcher. September 2021. doi:10.3102/0013189X211044144

The fourth-grade 2019 National Assessment of Educational Progress (NAEP) Reading assessment shows that 34% of the nation’s students perform below the NAEP Basic level. However, because there is no achievement-level description for below Basic, educators and policymakers lack information on the nature of the reading difficulties that these students face. To help fill this gap, we analyze data from the 2018 NAEP Oral Reading Fluency study. We find that, compared with students who perform at the NAEP Basic level and above, students who perform below NAEP Basic level are much more likely to have poor oral reading fluency and word reading skills.

The Problem with Finding the Main Idea

The Problem with Finding the Main Idea (January 2019). Johns Hopkins Institute for Education Policy and Learning First.

This report shows how systemic assessments of student learning that isolate skills like “finding the main idea” encourage teachers to place an unhelpful emphasis on the teaching of these “skills”. Drawing on examples from the United States, the report explains why this approach fails to lead to improvements in student learning. Nevertheless, student assessment can be both aligned with high standards and help to encourage the kinds of effective teaching practice that support student learning. The report concludes by suggesting what a more productive approach to curriculum-aligned student assessment would look like.

The Unique Role of Early Spelling in the Prediction of Later Literacy Performance

Rebecca Treiman, Jacqueline Hulslander, Richard K. Olson, Erik G. Willcutt, Brian Byrne & Brett Kessler (2019) The Unique Role of Early Spelling in the Prediction of Later Literacy Performance, Scientific Studies of Reading, 23:5, 437-444, DOI: 10.1080/10888438.2019.1573242

Researchers examined the predictive value of early spelling for later reading performance by analyzing data from 970 U.S. children whose spelling was assessed in the summer following the completion of kindergarten. The word reading performance of most of the children was then tested after the completion of Grade 1, Grade 2, Grade 4, and Grade 9. A computer-scored measure of post-kindergarten spelling was a significant predictor of later reading performance even after taking into account post-kindergarten phonological awareness, reading, and letter-sound knowledge and pre-kindergarten vocabulary. The results suggest that, by the end of kindergarten, spelling is more than just a proxy for phonological awareness and letter-sound knowledge. Given the information that spelling provides, it should be considered for inclusion when screening children for future literacy problems.

Frameworks for Literacy Education Reform

International Literacy Association (2016) Frameworks for Literacy Education Reform [White paper]. Newark, DE

The central tenet of the white paper is that classroom literacy instruction should be grounded in rigorous, peer-reviewed research — not politics, ideology, or speculation. Rather than settling on a specific reform strategy, the white paper offers frameworks for use in drafting or evaluating reform proposals. The frameworks address four key education sectors: literacy learning and teachers; schools and schooling; student support; and families and communities. For each sector, the white paper offers a list of research-validated approaches to literacy advancement, which is designed to function as a rubric to inform, refine, and assess reform proposals. In addition, each framework includes a detailed list of supporting sources to facilitate exploration into the underlying research base.

Improving Reading Outcomes for Students with or at Risk for Reading Disabilities

Connor, C., Alberto, P.A., Compton, D.L., and O'Connor, R.E. (February 2014) Improving Reading Outcomes for Students with or at Risk for Reading Disabilities: A Synthesis of the Contributions from the Institute of Education Sciences Research Centers, U.S. Department of Education, Institute of Education Sciences, National Center for Special Education Research.

This report describes what has been learned about the improvement of reading outcomes for children with or at risk for reading disabilities through published research funded by the Institute of Education Science (IES). The report describes contributions to the knowledge base across four focal areas: assessment, basic cognitive and linguistic processes that support successful reading, intervention, and professional development.

Don’t DYS Our Kids: Dyslexia and the Quest for Grade-Level Reading Proficiency

Fiester, L. (2012). Don't DYS Our Kids: Dyslexia and the Quest for Grade-Level Reading Proficiency. Commissioned by the Emily Hall Tremaine Foundation in partnership with the Campaign for Grade-Level Reading.

About 2.4 million children across the nation have been diagnosed with learning disabilities — but how successful is the U.S. education system in teaching these students to read? This new report provides a far-reaching overview of the history and progress in understanding and meeting the needs of children with dyslexia, as well as the persisting challenges that must be overcome, to ensure that all students can read proficiently by the third grade. The report also highlights best practices and examples of solutions that are already working in communities. Based on interviews with nearly 30 experts, the report includes a collection of recommended actions for advancing this movement. See Executive Summary.

Developing Kindergarten Readiness and Other Large-Scale Assessment Systems

Snow, K. (2011) Developing Kindergarten Readiness and Other Large-Scale Assessment Systems. Washington, DC: National Association for the Education of Young Children.

The Center for Applied Research at the National Association for the Education of Young Children (NAEYC) has developed new guidance to support states' development and implementation of kindergarten readiness assessment systems.

Informing Writing: The Benefits of Formative Assessment

Graham, S., Harris, K., and Hebert, M. Informing writing: the benefits of formative assessment (2011). Vanderbilt University and the Carnegie Corporation of New York.

This report examines the effectiveness of formative writing assessment and answers two questions: (1) does formative assessment enhance student writing, and (2) how can teachers improve formative writing assessments in the classroom. Writing is a critical literacy component for the achievement of the Common Core State Standards and college and career readiness. Based on the findings of a meta-analysis, authors of this report Steve Graham, Karen Harris, and Michael Hebert provide three recommendations for all schools, including those receiving School Improvement Grants (SIG), and describe examples of classroom application

Learning to Read: Developing 0-8 Information Systems to Improve Third Grade Reading Proficiency

Bruner, C. (2010). Learning to read: developing 0-8 information systems to improve third grade reading proficiency. Des Moines, IA: Child & Family Policy Center.

This resource guide provides background on the importance of third grade reading proficiency, resources and promising practices for developing information systems to address third grade reading proficiency, and recommendations for next steps at both the state and community levels.

Performance Counts: Assessment Systems that Support High-Quality Learning

Darling-Hammond, L. (2010) Performance Counts: Assessment Systems that Support High-Quality Learning. Washington, DC: Council of Chief State School Officers.

A new white paper written by Stanford researcher Linda Darling-Hammond describes what a student assessment system could look like if built from the principles and best practices found in current research and effective programs in the U.S. and high-achieving countries around the world.

Using Student Achievement Data to Support Instructional Decision Making

Hamilton, L., Halverson, R., Jackson, S., Mandinach, E., Supovitz, J., & Wayman, J. (2009). Using student achievement data to support instructional decision making (NCEE 2009-4067). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. Retrieved from http://ies.ed.gov/ncee/wwc/publications/practiceguides/.

This guide offers five recommendations to help educators effectively use data to monitor students' academic progress and evaluate instructional practices. The guide recommends that schools set a clear vision for schoolwide data use, develop a data-driven culture, and make data part of an ongoing cycle of instructional improvement. The guide also recommends teaching students how to use their own data to set learning goals.

Assisting Students Struggling with Reading: Response to Intervention (RtI) and Multi-Tier Intervention in the Primary Grades

Gersten, R., Compton, D., Connor, C.M., Dimino, J., Santoro, L., Linan-Thompson, S., and Tilly, W.D. (2008). Assisting students struggling with reading: Response to Intervention and multi-tier intervention for reading in the primary grades. A practice guide. (NCEE 2009-4045). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. 

This guide offers five specific recommendations to help educators identify struggling readers and implement evidence-based strategies to promote their reading achievement. Teachers and reading specialists can utilize these strategies to implement RtI and multi-tier intervention methods and frameworks at the classroom or school level. Recommendations cover how to screen students for reading problems, design a multi-tier intervention program, adjust instruction to help struggling readers, and monitor student progress.

New Roles in Response to Intervention: Creating Success for Schools and Children

International Reading Association. (2006). New roles in response to intervention: Creating success for schools and children. 

The International Reading Association (IRA) convened a group from the special education and regular education associations to craft a set of fact sheets on the roles of the various professionals and parents who are involved in implementing response-to-intervention (RTI) procedures. The outcome of that effort is a collective set of papers that represent each organization's distinctive constituency and viewpoint regarding RTI.

Recognition and Response: An Early Intervening System for Young Children At-Risk for Learning Disabilities

Coleman, M.R., Buysse, V. & Neitzel, J. (2006). Recognition and Response: An early intervening system for young children at-risk for learning disabilities. The University of North Carolina at Chapel Hill, FPG Child Development Institute: Chapel Hill, NC.

Some young children show signs that they may not be learning in an expected manner, even before they begin kindergarten. These children may exhibit problems in areas such as language development, phonological awareness, perceptual-motor abilities and attention, which are considered precursors of learning disabilities in older children. However, under current state and federal guidelines, these children are unlikely to meet eligibility criteria for having a learning disability. This is because formal identification of a child's learning disability generally does not occur until there is a measurable discrepancy between the child's aptitude and academic achievement, often not until the second or third grade. This report describes a method of addressing those warning signs immediately.

A Language Screening Protocol for Use With Young African American Children in Urban Settings

Washington, J.A., Craig, H.K. A Language Screening Protocol for Use With Young African American Children in Urban Settings. American Journal of Speech-Language Pathology Vol 13, Issue 4, November 2004. https://doi.org/10.1044/1058-0360(2004/033)

Language screenings represent an important tool for early identification of language impairments in young children between 3 and 5 years of age. This investigation examined the utility of a well-established set of assessment measures for screening young African American children. One hundred and ninety-six children participated in the screening. Based upon the outcomes of the screening, 25 children who failed and a random sample of 56 children who passed were administered a larger language and cognitive assessment battery. Sensitivity and specificity of the screening were determined to be high. The number of different words, the Kaufman Nonverbal Scale, and nonword repetition accounted for a significant amount of the variance in performance. The screening is brief, valid, and culturally fair for use with preschool- and kindergarten-aged African American children living in urban settings.

Effective Schools and Accomplished Teachers: Lessons About Primary-Grade Reading Instruction in Low-Income Schools

Taylor, B.M., Pearson, P.D., Clark, K.M., & Walpole, S. (2000). Effective schools and accomplished teachers: Lessons about primary-grade reading instruction in low-income schools. The Elementary School Journal, 101, 121-165.

This study investigated school and classroom factors related to primary-grade reading achievement in schools with moderate to high numbers of students on subsidized lunch. Fourteen schools across the U.S. and two teachers in each of grades K-3 participated. A combination of school and teacher factors, many of which were intertwined, was found to be important in the most effective schools. Statistically significant school factors included strong links to parents, systematic assessment of pupil progress, and strong building communication and collaboration. A collaborative model for the delivery of reading instruction, including early reading interventions, was a hallmark of the most effective schools. Statistically significant teacher factors included time spent in small-group instruction, time spent in independent reading, high levels of student on-task behavior, and strong home communication. More of the most accomplished teachers and teachers in the most effective schools supplemented explicit phonics instruction with coaching in which they taught students strategies for applying phonics to their everyday reading. Additionally, more of the most accomplished teachers and teachers in the most effective schools employed higher-level questions in discussions of text, and the most accomplished teachers were more likely to ask students to write in response to reading. In all of the most effective schools, reading was clearly a priority at both the school and classroom levels.

Beating the Odds in Teaching All Children to Read

Taylor, B., Pearson, P., Clark, K., & Walpole, S. (1999). Beating the odds in teaching all children to read. CIERA Report 2-006. University of Michigan: Ann Arbor.

A study investigated school and classroom factors related to primary-grade reading achievement, using quantitative and descriptive methods. Fourteen schools across the United States with moderate to high numbers of students on subsidized lunch were identified as most, moderately, or least effective based on several measures of reading achievement. A combination of school and teacher factors was found to be important in the most effective schools. Significant factors included: (1) strong links to parents; (2) systematic assessment of pupil progress; (3) strong building communication; (4) a collaborative model for reading instruction, including early reading interventions; (5) time spent in small group instruction; (6) time spent in independent reading; (7) high pupil engagement; and (8) strong home communication. The most accomplished teachers were frequently observed teaching word recognition by coaching as children were reading, providing explicit phonics instruction, and asking higher level questions after reading. In all of the most effective schools, reading was clearly a priority at both the building and classroom levels.

The Nation’s Report Card

The National Assessment of Educational Progress (NAEP) — The Nation’s Report Card. National Center for Education Statistics (NCES), U.S. Department of Education and the Institute of Education Sciences.

The National Assessment of Educational Progress (NAEP), often called The Nation’s Report Card, is the largest nationally representative and continuing assessment of what students in public and private schools in the United States know and are able to do in various subjects. Since 1969, NAEP has been a common measure of student achievement across the country in mathematics, reading, science, and many other subjects. Depending on the assessment, NAEP report cards provide national, state, and some district-level results, as well as results for different demographic groups. NAEP is a congressionally mandated program that is overseen and administered by the National Center for Education Statistics (NCES), within the U.S. Department of Education and the Institute of Education Sciences. The National Assessment Governing Board, an independent body appointed by the Secretary of Education, sets NAEP policy.

"If you don’t like to read, you haven’t found the right book." —

J.K. Rowling