Lesson 1.6

Progress:
Are Schools Improving?

Are schools getting better? The answer may surprise you.

hero image

The last few lessons discussed the evidence that an awful lot of California's students are learning too little in school, especially relative to those in other states and nations.

Despite the scale of the challenges, there is also good news. Two decades ago, it was difficult to credibly identify high-achievement schools in high-poverty and high-minority settings. Today, it is easy to find them. Schools like those in Compton, once seen as a metaphor for disadvantage, prove that children’s destinies are not coldly and totally predetermined by poverty and race or ethnicity.

Yes, school results have improved, but…

Graduation rates have risen. Test scores have kinda flattened.

Over the long run, there is strong evidence that educational achievement has slowly improved all over the world, as both an effect of economic growth and a cause of it. In America, including California, long-term measurable learning results have generally improved for students in all subgroups. Graduation rates are improving. College-going rates have risen. Disciplinary cases like expulsions and suspensions are becoming more rare.

Unfortunately, test scores aren’t necessarily tracking with these improvements. After decades of slow, unequal progress, scores plummeted in the COVID-19 pandemic. The decline reversed years of gains.

As described in Ed100 Lesson 1.1, America's best tool for measuring educational progress is a national program called the National Assessment of Educational Progress (NAEP, pronounced nape). It enables meaningful statistical comparisons over time and place.

Over decades, NAEP scores generally rose, with big gaps among racial and ethnic groups. In recent years, however, scores tipped broadly downward, leaving experts scratching their heads, frowning in concern and sifting the data for exceptions.

 

Poverty plays a huge role in the measurable gaps in student learning. Over the long term, scores rose for students from both richer and poorer families, according to the NAEP results. This graph uses eligibility for the National School Lunch Program (NSLP) to represent income status:

Scores on the NAEP exams matter. They help describe long-term changes in the academic capabilities of America's student body. They quantify differences in academic readiness between groups of students. As discussed in Lesson 1.3, scores like these may even predict the future of the economy.

Squaring the Boredom Triangle

To many people, numerical scores feel abstract and hard to interpret. Reactions to the raw scores generally fall somewhere in the boredom triangle between "uh-huh," "so what?" and "I'm sorry, were you talking to me?"

What are Cut Scores and Scaled Scores?

To give their scores some meaning, the NAEP governing board defines a cut score that it labels as proficient for each test. Students that score above the cut score are proficient. Those below it aren't.

The proficiency cut score for each grade level happens to have been set about ten scale points above the grade beneath it. This is almost certainly the source of a widely-used rule of thumb: a ten-point difference in a NAEP score is said to be equivalent to a year of learning. This is a myth. The scale was never designed to be continuous.

In the Ed100 blog
How can test scores be going up and down?

Cut scores with labels can help make a conversation about test results meaningful, but they deserve skepticism. Students know about cut scores from grades: a score of 79 isn't so different from a score of 80, right? But on a report card one is summarized as a B and the other as a C.

Cut scores that describe proficiency rates for groups of students work in a similar way, exaggerating the significance of tiny differences. As we describe in Lesson 9.6, when a normal distribution (a bell curve) shifts and a cut score stays put, tiny changes can seem like a big deal. A lot depends on where the cut scores have been placed, and how they are described. In 2025, the California State Board of Education agonized over the meaning of words like basic, minimal, and foundational.

Educational improvement is normal. And difficult.

Statistical wobbles and wording changes notwithstanding, the evidence suggests that each successive generation of California's kids has been learning a bit more than those before them… just like kids all over America and all over the world. Slow, widespread improvement in education results is normal. For California's students to thrive, they have to do more than keep up.

How can California improve education systematically? Changing one thing at a time isn't enough. In 2013, California began implementing a set of policies to evolve the system in a coordinated way:

  • Standards: California's academic expectations were overhauled with the adoption of the Common Core State Standards, discussed in Lesson 6.1.
  • Assessments: To support these new standards, the state rolled out new state tests, discussed in Lesson 6.5.
  • Accountability System: The state dumped its old academic accountability system, the Academic Performance Index (API), in favor of a more sophisticated performance dashboard approach. As Lesson 9.7 explains, it took years to make the California School Dashboard useful, and the COVID-19 pandemic made the transition even harder.
  • Resources: The state replaced a highly inequitable system of school funding with a fairer one by adopting the Local Control Funding Formula (LCFF), explained in Lesson 8.5.
  • Federal Law: At the end of the Obama administration, in 2015, the US Congress replaced the No Child Left Behind Act (NCLB) with the Every Child Succeeds Act (ESSA). A muscular law, NCLB had required school districts to show continuous improvement in student test scores, or take politically difficult actions. ESSA substantially removed this federal pressure. Learn more in Lesson 7.2.

In 2018, a project known as Getting Down to Facts II coordinated research into the effects of all of this interrelated change. Based on a national comparison titled A Portrait of Educational Outcomes in California, students’ academic achievement improved a bit faster in California than in other states, but with big gaps.

What is a student subgroup, and why does it matter?

A key function of school accountability systems like the California School Dashboard has been to highlight differences in results among student subgroups. For example, if there are a significant number of students of a specific ethnicity in a school or district, the California School Dashboard can focus on the results for just that subgroup. Differences in subgroup scores can suggest where a school or district ought to focus its attention. Like it or not, these differences also deliver a bit of "shame" motivation for schools to remember all of their kids when evaluating their success.

Schools that "beat the odds" demonstrate that all kids can learn, with the right support

But shaming isn't the only reason to look at subgroup scores: they can also show reasons for pride, and for learning, because some schools beat the odds.

Schools that beat the odds are important because they show that the kids are not the problem. They prove that, given the right support, every child can learn. They provide evidence that investing in kids really can make a difference, even where it seems hard. They transform the suspicion that "those kids can't learn" to "those kids won't learn unless..."

It's an important difference.

What are the ideas, approaches, programs, interventions, investments, and inspirations that can lift California’s student achievement, boost economic growth and make a crucial difference in children’s lives and America’s future?

Answering that question is the focus of the lessons ahead. But first, let's back up a little. Education isn't all about scores, or even about economic competition. What is it for? And has our view of education's purpose changed over time?

Updated June 2025

Quiz

Which ONE of the following statements is TRUE?

Answer the question correctly and earn a ticket.
Learn More

Questions & Comments

To comment or reply, please sign in .

user avatar
Darla Williams June 11, 2025 at 3:00 pm
How can we help black and Latino students? There scores are always low.
user avatar
Jeff Camp - Founder June 13, 2025 at 1:06 pm
Don't despair! In the aggregate, scores by group seem stuck, but individual schools and districts achieve better or worse results depending on how they prepare teachers, use time, and select and deploy learning materials. The Dashboard makes it possible (though tedious) to find exceptions.
user avatar
Jeff Camp May 6, 2019 at 1:39 pm
For a 2019 list of schools that are beating the odds in Los Angeles County check this list of BTO schools.
user avatar
Carol Kocivar June 18, 2018 at 7:57 am
Does a recession have an impact on student progress?
Two recent studies take a look at the impact of the Great Recession and student achievement.
They come to similar conclusions: Cuts in education funding matter. And they seem to matter most for low income students.

The Impact of the Great Recession on Student Achievement: Evidence from Population Data
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3026151

Do School Spending Cuts Matter? Evidence from the Great Recession
https://works.bepress.com/c_kirabo_jackson/35/download/
user avatar
Steven Davis June 11, 2018 at 4:00 pm
Please add data here and throughout on special needs kids!
user avatar
David Siegrist1 November 15, 2017 at 8:29 am
And Asian stydents’ academic performance?
user avatar
Lisette October 3, 2017 at 1:05 pm
Could it be that schools are so concentrated on teaching our children how to pass these standardized tests rather than concentrate on their long-term goal of a child's education?
user avatar
May 3, 2017 at 11:29 am
Too much restriction and policy on how school should use the funding to education the students.
user avatar
Jeff Camp - Founder April 28, 2015 at 1:43 pm
The charts in this page are visited again in Lesson 9.6, where we make an important point: "By the nature of statistics, if a cut-off point stays put while a curve moves, metrics can exaggerate the scale of the change if the cut point is anywhere close to the steep part of the curve. Education statistics are loaded with metrics derived from cut-off scores."
user avatar
tonyammarquez April 28, 2015 at 1:39 am
I'd like to know who is in charge of evaluating and\orregulating the tests that are referred to in Ed100?
user avatar
Jeff Camp - Founder April 28, 2015 at 10:59 am
Thanks, Tony. Ed100 refers to many tests (there are a lot of them, explored in lesson 9.3!) In this lesson (1.6) the focus is on the NAEP tests. The NAEP tests are overseen by an appointed, independent governing body of 26 members. http://nces.ed.gov/nationsreportcard/about/ The members I have met have been passionately committed to the work of giving America a meaningful, useful barometer of student learning throughout the country, and have understood the statistical challenges of doing this work properly. These tests are NOT the ones that everyone has to take -- they are administered only on a "sample" basis as a tool for understanding what's really happening.
user avatar
sylviambee April 7, 2015 at 11:38 am
My son is academically advanced compared to me at that age. Of course there are some similarities and differences that contribute to this matter. My son attends public school, I attended private, Catholic schools for 9 years. I earned a BA before my son was born, and completed a Masters program before he was 11. My mom earned her BA when I was 13. Both my parents were immigrants and had to learn English, only my son's father was an immigrant and had to learn English. My parents were required to volunteer at my school, but usually outside the classroom. My husband and I volunteered inside and outside of the classroom. I was a stay at home mom when my son was in grades 2-6, my parents worked full-time. I had babysitters and Was a latch-key kid by age 8. My son has always been picked up from school, and only until this past year does he walk to a nearby after-school site. There are really so many factors leading to the reasons why my son is academically advanced compared to my experiences.
user avatar
francisco molina August 12, 2019 at 11:52 pm
Absolutely agree with you, I had a similar experience with my children and . I believe strongly that when exist more presence and participation of the parents at the school everything works better.
user avatar
jenzteam February 27, 2015 at 6:57 am
I'm not a huge fan of test scores, however I do acknowledge that they are needed to track progress. That said, I also believe that students should also be given opportunities to demonstrate their knowledge in other ways besides a standardized test. The focus of districts is always on scores, not on the overall education experience and how it is preparing kids for the real world. I don't TEST my employees - I watch how they interact, work collaboratively, and contribute to the overall health of the company. I look at their interpersonal relationships with their colleagues and their commitment to developing their skills. Educational systems would benefit from using a business model if they want to prepare students for real world work environments.
user avatar
tonyammarquez April 28, 2015 at 1:43 am
I'm glad you said that very good point!
user avatar
Justice Landes February 1, 2024 at 4:12 pm
Even if we only use the standardized tests for statistics and district evaluations or what have you, making other kinds of 'tests' feel just as significant to students can help them feel confident in their strengths and celebrate diversity (which would help them learn the standardized content as well!).
user avatar
Sherry Schnell January 22, 2015 at 9:31 am
A big part of helping high-poverty students succeed is to eliminate (or ameliorate) the impact of poverty on these children - i.e. stable housing and electricity, nutritious and dependable food, quality childcare outside of school hours, reliable transportation to school, etc. Is this really the job of the school or is it the responsibility of other public institutions? In my opinion, schools should be responsible for "educating" and we need to step up other programs to deal with poverty.
user avatar
Jeff Camp - Founder January 22, 2015 at 9:22 pm
Thanks, Sherry -- most of the topics that you touch on here are examined in more depth in chapter 2, which focuses on students and what they bring with them (for good or ill) that affects their learning. Efforts to integrate school with "wraparound services" are explored in lesson 5.7, on "community schools".
user avatar
Lauren Dutton March 10, 2011 at 7:06 am
Indeed, throughout California there are shining examples of outstanding "beating the odds" public schools. Located directly in some of our state's most under-served communiies, they are doing whatever it takes to ensure that their students are on the path to success in college and in life. In turn, these schools are demonstrating that ALL students can succeed at high levels and deserve our highest expectations. It is up to us as adults to figure out how to ensure that these are not isolated examples but that we learn from and scale these approaches.

There are many examplars, but as the post mentions KIPP is one strong example with 12 schools in the Bay Area and Los Angeles. Check out the comprehensive Mathematica study on their national results here: http://www.kipp.org/mathematica
©2003-2025 Jeff Camp
Design by SimpleSend

Sharing is caring!

Password Reset

Change your mind? Sign In.

Search all lesson and blog content here.

Welcome Back!

Login with Email

We will send your Login Link to your email
address. Click on the link and you will be
logged into Ed100. No more passwords to
remember!

Share via Email

Get on Board!
Learn how California's School System works so you can make a difference.
Our free lessons are short, easy to read, and up to date. Each lesson you complete earns a ticket for your school. You could win $1,000 for your PTA.

Join Ed100

Already a member? Login

Or Create Account