You Earned a Ticket!

Which school do you want to support?

Lesson 9.3

Tests:
Standardized Measures of Student Learning

How can this test be too easy and too hard?

hero image

Standardized tests have become unfashionable. In 2020, when the Covid-19 pandemic prompted many tests to be canceled outright, many breathed a sigh of relief. Good riddance, right?

Well… maybe. It is important to acknowledge how extraordinarily successful these tests have been. This lesson explores how tests are designed, how they work, and how they are used. It reviews the most important tests in use in California's education system, and summarizes conflicting points of view about changing them.

Standardized tests quickly measure students’ knowledge and skills in ways that allow for comparisons and support decisions. Because testing often works as a way of measuring skills, its history extends back to pharaohs, emperors, generals, and captains of industry. Because testing doesn’t always work, and because it has often been misused, that history is somewhat checkered.

Testing for Economic Success

As discussed in Ed100 Lesson 1.3, an education system that works well drives economic success — not just for the individual, but for the whole economy. That's a pretty powerful reason for an education system to use tests.

Individuals have a related, but narrower reason to care about tests. Students and parents obsess over (especially the SAT / ACT) because they are so powerfully connected to college access, and thus to job choices.

Historically, standardized tests have been used as a tool for identifying the best-prepared candidates for jobs and opportunities — and for efficiently "weeding out" the rest. In the last few decades, however, the purpose of testing has broadened. Among other things, test results serve as diagnostic tools for school leaders and teachers to choose how to spend their time. They also serve to identify where students are falling behind — a necessary step to overcome wishful thinking and do something about it.

California’s testing system has changed

California's battery of standardized tests has changed over time. From about 2002 until 2013, the foundation of the state’s testing system was the STAR tests, also known as the California Standards Tests or CSTs. These were classic one-size-fits-all fill-in-the-bubble tests based on California's state standards.

In response to the 2008 recession, the federal government provided significant funding to sustain public education. It also provided some incentive funding: specifically, through the competitive Race to the Top grant program, states were encouraged to do something long talked about: revise, harmonize and improve their grade level educational standards. In 2014 many states, including California, transitioned to a set of standards called the Common Core.

New standards required new tests. Because good tests are difficult to develop, states banded together. California and many western states joined the Smarter Balanced Assessment Consortium (SBAC); the other large consortium is known as PARCC. Not all states are officially in a consortium. In 2018 the Hewlett Foundation commissioned a report, Whatever Happened to All Those New & Better State Tests, to take stock of how the dust had settled. The review concluded that the PARCC tests are less rote than SBAC, but both are substantially better than the tests used in non-consortium states.

Sources: Illustration from Education First, High-Quality Assessment Project; research cited in chart includes two studies by the RAND Corporation on quality of state tests, AP and other common summative assessments (2011 and 2012), as well as research by the Fordham Institute (2016) and HumRRO (2016). Click image for more.

California's tests, collectively known as the California Assessment of Student Progress and Performance (CAASPP), are similar to those used in other SBAC member states. The CAASPP tests are administered on computers, and they adapt to the skills of each test-taker in order to take less time to determine a score.

The CAASPP system of tests includes tests in English and Math as well as the California Science Test (CAST), which debuted in 2017.

Which test
can best
assess
success?

Critics of standardized testing argue, in part, that it is a poor use of time. Some students find the tests dull, though computer-based adaptive tests are shorter and less vulnerable to this problem. Some argue that standardized testing is a degrading intrusion that squeezes the soul out of learning and teaching.

High Stakes Tests or Low Stakes Tests?

Standardized state tests are sometimes described as high-stakes tests. This description implies a sense of risk to students if they do poorly. In fact, students have no great reason to cheat on the CAASPP tests. Quite the contrary: it can be difficult to persuade students even to bother taking state tests seriously.

Teachers and administrators have slightly more reason to feel pressure than students do, if only for the sake of reputation. The growing focus on test scores has placed pressure on teachers and administrators that led to cheating scandals among the adults. If educators or school leaders do not believe that tests are a valid measure of learning, incentives based on test scores can create temptations.

What are the CAASPP tests?

California's Smarter Balanced tests, the CAASPP, are administered at the end of the school year in grades 3-8 and 11

California's state assessments are delivered toward the end of the school year in English and math for grades 3 to 8 and for 11th grade. (Curious what the tests look like? Try it!)

In early summer, students and their parents receive reports that show their scores. The reports visually indicate whether the student's score is near grade level expectations, above it or below it, and by how much. Here's a part of a 2019 sample report for Language Arts for a fictitious fifth grader:

The report includes prior year scores, which can help understand whether the student is generally keeping pace with grade level expectations, falling behind, or advancing.

Find much more information about the CAASPP tests here: startingsmarter.org. These tests are used as part of the California School Dashboard, which we introduce in Ed100 Lesson 9.7.

Adaptive Tests: the Goldilocks Ideal

The CAASPP tests are 'adaptive.' Administered online, they present each student with questions of varying difficulty to assess their level in as few questions as possible.

In the past, students were all given the same test, on paper. Inevitably, the questions would bore some students while frustrating others.

Administering tests on computers was a big change. It enabled the consortium to design tests that adapt to the skills of the test-taker. An adaptive test like CAASPP presents each student with a different version of the test, drawing questions that vary in difficulty (and score value). Ideally, each student takes a "Goldilocks" version of the test. Not too hard, not too easy: just right. This allows the test to more successfully evaluate each student's "level" in fewer questions and with higher certainty than with paper tests.

What are Alternate Assessments?

To meet the needs of students with disabilities, California also provides computer-based "alternate assessments" (CAA) aligned with the Common Core Standards. The goal: Ensure that students with significant cognitive disabilities achieve increasingly higher academic outcomes and leave high school ready for post-secondary options. (These assessments replaced the CAPA tests.) Watch the video to learn more. (Spanish version here).

Despite critics, tests are here to stay

Critics such as education commentator Diane Ravitch argue that standardized tests take too much time and lead schools to focus too narrowly on the subject areas that are tested. (In education jargon this is known as “narrowing the curriculum.”) Class time for art (see Lesson 6.8 The Arts), music, and even science has been squeezed because teachers and school leaders feel pressure to ensure that students score well on tests of math and English.

Annual testing for all students is a key priority of many civil rights organizations. By requiring universal participation, these tests reinforce the idea that education has to work for all students. Universal participation also reduces the temptation for schools to omit the scores of students that are less prepared.

It is legal for parents to "opt out" of California's state-administered tests. Fortunately, very few do so. Access to some federal funding is contingent on the participation of at least 95% of students. The rationale for requiring this high participation rate is to avoid the temptation for schools or districts to “hide” students that might not score well.

Public support for annual testing remains strong and broad. In surveys, about two-thirds of respondents support annual testing. About half of teachers support it, too. In response to the criticism that testing has focused only on math and English, California added assessments in science and undertook new changes in standards for the visual, performing and media arts.

Goodbye, High School Exit Exam (CAHSEE)

For many years, California required high school students to pass the California High School Exit Exam (CAHSEE) to qualify for a diploma. A one-size-fits-all bubble test, CAHSEE was very easy for most students. Still, for some it was the one thing that held them back from graduating. In 2015, the exam was suspended, and in 2017 it was abandoned for good.

The effects of exit exams have been extensively researched. For some students, there is evidence that CAHSEE served its intended role as a kick in the pants. But this effect was outweighed by its unintended role as a catalyst for students to give up on high school entirely.

Hello, CAASPP!

When high school students take the CAASPP test, they have a personal reason to care about their score. Through the Early Assessment Program (EAP), scores on CAASPP provide colleges with evidence of students' readiness for college-level work without taking remedial courses. (For more, see Lesson 9.4.)

The Real High-Stakes Tests: SAT and ACT

Will a student do well in college? If you could only know one fact about the student to predict his or her college fate, what should it be? Grade point average? SAT score? ACT score?

The best predictor of a student's success in college is his or her grade point average in high school...

According to research from the College Board (the maker of the SAT) the best single predictor of a student's success in college is not his or her SAT score. It's his or her grade point average in high school. The makers of the ACT exam agree, and so does independent research.

So why not punt the test and rely on grades alone? Because the combination works even better. Colleges give significant weight to standardized test scores in admitting students because they help predict student success in college.

Grade point averages and SAT/ACT test scores don't measure the same things. Some marvelous students are horrible test-takers. Some marvelous test-takers are horrible students. Succeeding on a test requires overcoming anxiety and distraction, and being able to quickly shift from one question to the next. Succeeding in a class requires an ability to apply oneself to deliver academic work.

...but the prediction is even better when combined with standardized test scores.

Students can significantly improve their SAT/ACT scores with practice and help. Money makes a difference: Test-prep coaches can help them focus on questions they miss and understand the material more deeply. Psychiatrists can help them learn to manage their stress and anxiety. It works, and families with money spend big bucks to give their kids every shot at success — a topic explored in depth by Paul Tough in his book The Years That Matter Most.

SAT/ACT scores can have an influence on college access in ways that aren't obvious. In a self-sorting effect, some students who actually might be quite successful at a "stretch" college don't risk applying if they think their scores are too low, or that they can't afford the test. By requiring the SAT or ACT as part of the application, colleges lose some applicants. Fee waivers are available for both the SAT and the ACT for students who qualify for free or reduced-priced meals.

Because of the unequal impact these tests can have on college access, in 2020 the academic senate of the University of California convened a task force to study whether to get rid of them. To the surprise of many, the task force recommended keeping them.

In fact, test scores are better predictors of success for students who are Underrepresented Minority students (URMs), who are first-generation, or whose families are low-income… One consequence of dropping test scores would be increased reliance on HSGPA in admissions. The STTF found that California high schools vary greatly in grading standards, and that grade inflation is part of why the predictive power of HSGPA has decreased since the last UC study.

The COVID-19 pandemic created unequal barriers to SAT and ACT testing. With fewer testing sites and limited seating, students from lower-income areas faced particular barriers to test, retest, and potentially improve their scores. The National Association for College Admission and Counseling (NACAC) has called for colleges to reexamine their policies in the wake of the pandemic and beyond.

Other measures of student performance

As a broader, more engaging alternative to standardized testing, some have proposed that students should demonstrate their competency by producing a “portfolio” — the high school equivalent of an undergraduate thesis project. Students negotiate a research topic with advisors, and produce multi-disciplinary work that demonstrates their knowledge and abilities in several subject areas. Their portfolios are graded against a set of "rubrics" that incorporate state standards. The state of Vermont went farthest in formally adopting this strategy, and in the process demonstrated many of its challenges. Portfolio assessment remains uncommon, and the term has fallen somewhat out of favor. If your child is working on a "senior project" or a "senior thesis" this may be an echo of the portfolio idea.

Class Grades: Rubrics are not cubes

Standardized tests aren't the only thing that matter, of course. Most of the work that students do in class or as homework is assigned and graded by a teacher. How do teachers express what counts, and how do they decide on grades?

A rubric is a tool that teachers use to explain what they expect from students when they make an assignment. Rubrics are usually organized into columns that describe what counts. For example, a report might be worth 100 points total: up to 50 points for the quality of the research, 30 for the quality of the writing and 20 for the quality of the presentation. The rows of the rubric describe expectations for different levels of quality — for example what sort of research is most important, and what length should the paper be?

Most teachers create rubrics in a word processing program, distributing them to students on paper or as PDF documents. Online rubric tools exist, too, some of them not entirely terrible. Creating a good rubric is not easy; it requires significant forethought to clearly explain what you expect from students. Teachers: if you have a favorite tool, please leave a comment.

Of course, the results that really matter are long-term, and have little to do with scores. Real success in education is determined by the life path options that a student is able to access as a result of that education. Those options are the subject of the next lesson.

Next Steps

Parent leaders (ahem, such as Ed100 participants and PTA leaders) play a vital role in demystifying these tests. Work with your principal to organize a meeting at your school to go over the new tests and the California standards. A good resource to start with is this infographic, which answers frequently asked questions.

One of the best ways to understand a test is to try it out yourself. Here are some practice tests:

Tips for talking to your child about assessments
Source: California State PTA

Ask Your Child:

What areas do you think you should particularly focus on this year, based on your test results? What do you see as your strengths to build on?

Ask Your Teacher:

How will these tests results be used to guide instruction this year?
What can we do at home that will help our child learn and be successful?
How are other important subjects assessed?

Download and Share:

PTA fliers with more tips in English and Spanish

Updated Sep 2017
Oct 2017
March 2019
Oct 2019
Feb 2020
April 2020
December 2020
June 2021

Quiz

Which standardized test does California rely on most to assess student learning?

Answer the question correctly and earn a ticket.
Learn More

Questions & Comments

To comment or reply, please sign in .

user avatar
Carol Kocivar June 14, 2022 at 8:13 pm
Cal State joined the University of California in ending its use of an admissions test for freshmen. Now the system is creating a new set of eligibility criteria, the first change since 1965. The plan is to focus on student high school grades and life experiences.
March 2022
https://calmatters.org/education/higher-education/2022/03/csu-entrance-requirement/
user avatar
Carol Kocivar June 5, 2022 at 4:16 pm
MIT brings back a test that, despite its reputation, helps low-income students in an inequitable society. The Atlantic

"But the income-related disparities we see in SAT scores are not evidence of an unfair test. They are evidence of an unfair society. The test measures differences in academic preparedness, including the ability to write a clear sentence, to understand a complex passage, and to solve a mathematical problem. The SAT doesn’t create inequalities in these academic skills. It reveals them. Throwing the measurement away doesn’t remedy underlying injustices in children’s academic opportunities, any more than throwing a thermometer away changes the weather."

https://www.theatlantic.com/ideas/archive/2022/04/mit-admissions-reinstates-sat-act-tests/629455/
user avatar
Carol Kocivar May 15, 2022 at 2:47 pm
The Federal civil service adopted standardized testing in 1883. Are there lessons for education today? https://fordhaminstitute.org/national/commentary/federal-civil-service-adopted-standardized-testing-1883-are-there-lessons
user avatar
Jeff Camp - Founder March 14, 2022 at 12:47 pm
California's major public college systems have halted the use of SAT and ACT as factors in admission decisions. This lesson will be updated to reflect the change.
user avatar
Alan Ham July 23, 2020 at 10:29 am
I think that test scores shouldn't determine a student because a student can be do poorly on tests but have great grades at school. This would ruin students for the college admissions.
user avatar
Jeff Camp October 9, 2018 at 3:28 pm
Grade inflation is a real thing, but it's been a little hard to prove. Once again, North Carolina's outstanding education data systems (see lesson 9.5) have allowed for an unprecedented examination of what's going on. According to study author Seth Gershenson, grade inflation has had an unequal pattern: "it’s gotten easier to get a good grade in more affluent schools, but not in less affluent ones."
user avatar
Carol Kocivar January 14, 2018 at 9:36 am
A new study from Stanford "suggest that looking at levels of student outcomes are a poor measure of school effectiveness." Instead: Look at student growth over time as measured by standardized tests to see how well a school is doing."

Stanford CEPA
user avatar
Lisette October 4, 2017 at 12:35 pm
This CAASPP test sounds quite interesting!
user avatar
Jeff Camp - Founder April 16, 2017 at 10:27 pm
"Portfolios" -- Many colleges degree programs require students to complete a thesis or other significant, long-range, self-selected project. Some high schools also include a "portfolio" project as a required part of the high school senior experience. EdSource reports that this approach is currently part of the program at Oakland International High School and over 30 other high schools participating in the California Performance Assessment Collaborative. Projects like these are challenging for teachers and administrators because they are so varied and personalized -- how can you grade them fairly and effectively? What expectations and supports can you provide to teachers and students? But I must admit that I am a huge fan, and many teachers are enthusiastic about them, too. An assignment like this stands in sharp contrast to forgettable, workaday academic homework. Most portfolio projects lead students to do academic work that is, if nothing else, at least memorable to them.
user avatar
Caryn-C September 15, 2017 at 8:24 am
Each of my kids has been required to participate in Genius Hour or a "Passion Project", spanning grades from elementary to high school. From a parent perspective, it is awesome for self-motivated students. The experience is incredibly variable depending on the guidance teachers contribute during the process. There are certain aspects that Google requires that often fail to be communicated. Number one is that their employees are allowed to work on Genius Hour if they can show that it will enhance the business. There's a direct focus--this isn't just "find something you want to learn about". The parameters for a third-grader (at least mine!) are much too broad.
user avatar
Jeff Camp February 27, 2017 at 5:12 pm
In 2016 twenty-five states required students to take the SAT or ACT in 11th grade. In 2017 California's state education leaders shut down a waiver request by Long Beach Unified to use the pencil-and-paper SAT in place of the computer-adaptive CAASPP test for high school math and language arts. Among reasons for denying the waiver request: the SAT is non-adaptive (and therefore of no use for assessing low-performing students); it is not accessible to students with disabilities; and it is not aligned with the College and Career Indicator planned for the California State School Dashboard.
user avatar
Carol Kocivar October 27, 2016 at 2:38 pm
Interested in learning more about performance assessments? Check the Performance Assessment Resource Bank (PARB), a free online resource for K-12 teachers, administrators, and policy makers.
https://www.performanceassessmentresourcebank.org/
user avatar
Carol Kocivar June 22, 2016 at 5:05 pm
Resources for Parents
The California Department of Education has guides to help interpret the California Assessment of Student Performance and Progress (CAASPP) student score report.
Available in English, Spanish, Armenian (Eastern), Chinese (simplified and traditional), Hmong, Korean, Pilipino (Tagalog), Punjabi, Russian, and Vietnamese.
.
http://www.cde.ca.gov/ta/tg/ca/caasppssreports.asp
user avatar
A Patel May 10, 2016 at 9:18 am
Perhaps its just me but I don't feel that all the questions on a CAASPP test are quite clear. It takes a minute or 2 just determine what is asked and addition time to solve and execute the problem. Will students grade 3-5 be allowed to have paper and pencil during testing to work out the problem. How many actually questions are there in an average test for Grade 3-5? What if the child is prone to wrist pain? Using a mouse to answer every single question just doesn't seem feasible if there are over 20 questions on the test.
user avatar
Roxana Marachi September 15, 2015 at 3:47 pm
Please see the following Open Letter to the CA State Board of Education on Release of [False] SBAC Scores: http://eduresearcher.com/2015/09/08/openletter/
If EdCamp colleagues or anyone else may have compelling responses to the 10 Critical Questions about Computerized Assessments and SmarterBalanced Test Scores, please share: http://eduresearcher.com/2015/07/06/critical-questions-computerized-testing-sbac/
The Critical Questions have yet to be answered by the CDE or SmarterBalanced and are important for all in the education community to be asking. The marketing around the tests has been impressive, but unfortunately there are serious structural barriers that don't allow for meaningful interpretation of the [invalid] scores. Feedback on the 10 Critical questions and specific points in the Open Letter are welcomed.
user avatar
Carol Kocivar - Ed100 February 17, 2015 at 4:18 pm
The High School Exit Exam may be on its way out. Legislation has been introduced to suspend it:
SB-172 Pupil testing: high school exit examination: suspension.
This bill would suspend the administration of the high school exit examination and would remove the high school exit examination as a condition of receiving a diploma of graduation or a condition of graduation from high school for each pupil completing grade 12, for the 2016–17, 2017–18, and 2018–19 school years.
You can track this legislation here:
http://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=201520160SB172
user avatar
francisco molina August 13, 2019 at 3:47 am
Wow! I am really impressed with all your information. BTW, Do you know where o how a District Superintendent could be evaluated or qualified for his /her work?
©2003-2024 Jeff Camp
Design by SimpleSend

Sharing is caring!

Password Reset

Change your mind? Sign In.

Search all lesson and blog content here.

Welcome Back!

Login with Email

We will send your Login Link to your email
address. Click on the link and you will be
logged into Ed100. No more passwords to
remember!

Share via Email

Get on Board!
Learn how California's School System works so you can make a difference.
Our free lessons are short, easy to read, and up to date. Each lesson you complete earns a ticket for your school. You could win $1,000 for your PTA.

Join Ed100

Already a member? Login

Or Create Account