Share This
If you think others need to see this, share it on one of the sites below by clicking on the button.
Facebooktwitterredditpinterestlinkedinmail

Imagine that people who wanted to become a math teacher had to take a test to determine how well they understood mathematics. Sounds reasonable. However also imagine that this test was both ludicrously hard and assessed topics that had little to do with what teachers actually teach. Not so great.

Well unfortunately, this test exists and in California we call it the CSET (California Subject Examinations for Teachers). It’s supposed to ensure that math teachers have sufficient content knowledge but instead acts more like a misinformed gatekeeper. To show you an example of what I mean, check out these two problems below from the Algebra and Number Theory subtest:
 

Problem 1

 
Problem 2

Here’s your reality check: if you can’t solve problems like these, then you can’t pass the test and you won’t be able to teach math from 6th grade through calculus. I don’t know about you, but I know two things when I see these problems:

  • I have no clue how to solve either of them.
  • These problems are MUCH closer to something you’d see in a college level Linear Algebra class than anything in high school.

 
With this in mind, let me take a step back. The CSET has three subtests which have names that seem reasonable enough (click on the test names to see more practice problems):
1. Algebra and Number Theory
2. Geometry, Probability, and Statistics
3. Calculus and the History of Mathematics
 
If you want to teach middle school mathematics, you only need to pass the first and second tests. If you want to teach high school mathematics, you have to pass all three. I was a math major at the University of California, Los Angeles (UCLA) and I took the first and second tests about three years after I graduated. They were by FAR the hardest math tests I had ever taken. Most of the content was college level mathematics, and a lot of it I had never seen in high school or college. So this entire test hangs on the assumption that if you know how to do this math, you must know all the math that came before it. That would be like giving kids a Geometry final and having that grade represent all earlier classes.

When I first took the first practice test ahead of the actual test I got something like 4 out of 32 right on my first try! It took me two weeks with the answers AND explanations to fully understand how every problem was solved.

So think about what this means: there are potential educators who have solid content knowledge of middle and high school level mathematics yet are not able to pass these tests… and conversely, people could pass these tests yet still not know the mathematics they’d actually teach!
 

Conclusion
I’m fortunate. I studied and studied and passed the tests on my first try. However, I’m still bitter about it over 15 years later. How many people would make great secondary math teachers who deeply understand the content they would actually need to teach, yet can’t pass this test?

I’m all for ensuring that math teachers understand what they teach, but this test does not do that. Why are we not assessing the content knowledge teachers actually need? How do we go about revising these assessments?

If you’ve had similar experiences with these tests or one for where you live, please let me know in the comments. If you think I’m missing something, I’d also appreciate reading about that too. Thanks.


Share This
If you think others need to see this, share it on one of the sites below by clicking on the button.
Facebooktwitterredditpinterestlinkedinmail


Follow Me
Keep the conversation going. Follow me on the social media sites below.
Facebooktwitterpinterestlinkedinrssinstagram

38 Comments

  1. Yes! Thank you for posting this. Very difficult. I was fortunate that the District Math Coach was helping current teachers and substitute teachers study for this test, but it took me 3 times to pass subtest 1, and 2 times for subtest 2.
    I took both tests together the first time and that was a huge mistake. Take them separately.

    • Yeah, I was very happy that I passed both of them, but I never took subtest 3 because I knew nothing about the history of math and was very rusty with my calculus.

      • Test 3 is actually easier than the first 2. It’s limited only to calculus so it doesn’t cover the waterfront, and the history of math questions were not that daunting.

      • Exam III only covers Calculus. The History of Mathematics was dropped in 2017.

        Exam I covers Number Theory, Linear Algebra, and Abstract Algebra which are college level subjects. But high school teachers need to know more than their students so that teachers are able to know and relay the underlying reasoning of why the high school mathematics concepts are true.

        Exam II covers Euclidean Geometry and Probability at a high school level (with a few higher level questions…but this test can be passed by a strong high school student.). Teachers need to be able to understand how and why these subjects are important and having a higher level of understanding helps the teacher know what to tell the students.

        • Two thoughts:
          – Small miracle that they dropped history of math
          – I think it’s all in the details of what “teachers need to know more than their students” means. I would MUCH rather teachers have deeper knowledge of content they might actually teach than broader knowledge on something they’ll never use. The reality is that they could pass the CSET AND STILL not know what they actually need.

  2. This. Is. Insane. I fully support the notion that anyone teaching math at any given grade level needs to be proficient 2 grade levels ahead of that, but in the case of this test, I would think the state could break it down a bit further than that. 6-12 is a big range. I grew up in California but moved to Texas where I went to middle & high school as well as college, earning my degree and 1-8 math certification (which allows you to teach Algebra 1 at the junior high level). I passed my HS (8-12) certification test in 2013 after 11 years of teaching 4th, 5th, 8th and Algebra I. I also tutored through Algebra 2 at the time. Back then the test was ~10% 8th grade material, 33% algebra I, 14% Geometry, and the other 43% of the test covered Algebra 2 through Calculus (and possibly beyond). Having never taken calculus, I knew I could most likely get at least a 60% with my every day math knowledge, but I needed to find another 20% within the rest of that test to pass with the required 80%. I did have to study in advance but not extensively and I passed on my first try.
    Although I have that certification I would never accept a job teaching PreCalculus let alone Calculus. I don’t have a firm enough grasp of the material beyond those courses to do the students justice. Would junior high students benefit from having a teacher who can master the material through algebra or geometry, rather than all the way through…whatever these questions are asking about? I only got 9 right and I’m a darn good Algebra teacher & instructional coach.

    • What I think is worth reflecting on is that “Algebra” is being broadly defined. For example, the kind of algebra on this test is college level and not anything like what is taught in middle or high school.

  3. I had a similar experience with the Utah certification test. I entered teaching through an alternative route and, though I had taken all of the required math coursework, I was grossly unprepared for the certification test. I remember praying and telling God that he needed to work a miracle because if I didn’t pass, I was going to quit teaching. I passed by three points. The ironic thing was that I still didn’t really have the deep understanding of the content I was teaching that would have helped me and my students most. Things like why a negative a negative times a negative equals a positive, why anything to a zero power equals one, and the fact that the Pythagorean Theorem can be visualized as actual squares – these understandings transformed my teaching but came only after years of quality professional development after I earned my license. I think there is value in learning advanced math like Linear Algebra. However, I think it would be wise for math teacher education programs to require fewer of these courses and to offer and require more depth on the 6-12 content knowledge.

  4. To avoid these tests, and because I have a California clear credential in biology, I spent nearly $10,000 and took 48 units of math to earn a subject matter authorization in math (with a 4.0), and I am still limited in what I can teach .. essentially algebra, geometry. Pretty pathetic.

    • I feel ya Marcia. I found out that even though I was a math major in college, only one of my classes would count towards subject matter competency. I did not want to spend that kind of money or time to go that route and would have probably changed professions instead.

  5. I live in Illinois. I didn’t major in math and got an additional endorsement. Its the only test I’ve ever thought I failed, and contained almost nothing that I would ultimately teach. I took it before finishing my course work so I knew I was a little unprepared but the questions above brought back the feeling. I studied with my friend who did engineering at Northwestern and he found them hard with a higher level of math than I had. There were few sample questions so I mostly knew I couldn’t do things but wasn’t even clear what they were. I didn’t even read answer choices for many questions because there was no point–I couldn’t make anything of the question. I finished first in a room of several hundred people (most taking other tests; there were 1-2 others taking math content) because there were so many things I guessed on. Ultimately, I did pass on my first try…by 1 point.

    I wish the test had more to do with subject matter we’d teach. They could even have some sort of specialist test for people who will teach especially advanced math. Oh, and there was no statistics whatsoever (guess what I teach). It felt like the point was to make me feel like I wasn’t good enough honestly.

    • Right?! It’s like what’s the point of making an absurdly hard test that doesn’t actually measure what we’d need. We’d have a riot if we did that to our students but somehow it’s ok to do to potential teachers?

  6. Aspiring math teacher here. I have learned so much from your blog and videos — thank you!

    For some of the non-California readers, maybe worth clarifying that with a Foundational level authorization (“middle school math”) one can teach through and including Algebra 2/Elementary Stat at any K-12 grade level (including at high schools). The “high school math” authorization allows the holder to teach courses beyond that.

    Some Alg 2 content is not too far off from the CSET example Problem 2 in your post.

    In my opinion, the big disconnect arises from the fact that the Foundational authorization doesn’t align with current middle school curriculum. Few (hardly any?) public middle schools in California offer Alg 2 or Statistics!

    What would you think of something like the following:

    Adjust the Foundational authorization to cover only, say, through Alg I/Geometry.
    Pre-existing Foundational-level authorization holders could continue to teach through Alg 2/Stat.
    CSET I and II would cover algebra (including basic linear algebra)/number theory/probability+basic stat/geometry/basic trig.
    CSET III would cover calculus and the abstract algebra/higher-level linear algebra/higher level statistics topics, etc.

    • I think that the bigger concern for me would be to better align the test so that passing the test meant that you had the kind of deep conceptual understanding of the content you’d teach. As it is, you could pass this test and still be wildly underprepared to teach your math classes.

  7. I took all 3 math CSET’s in the summer of 2015, and was actually very relieved that subtest 3 had been recently redesigned to remove the history of math, so it only includes calculus. As far as subtest 1 algebra and number theory, I remember my study book said there would only be a maximum of something like 3-4 questions regarding rings and fields (like the sample questions you posted), so unless you had recently studied it in college, your time would be better spent studying the other topics, as one could still pass the subtest while getting all of the ring and field questions wrong assuming you did very well on the other topics. What great advice! *sarcasm*
    While I do believe that including these ring/field questions is unreasonable, this does bring to mind two issues. First is the lack of K-12 teachers that studied math in college. Considering the last two high schools I taught at, I would say only ~25% of the math teachers had any STEM related degree (let alone pure math). I’ve heard multiple teachers tell students that they “loved math in grade school but college math was too hard.” What kind of a growth mindset does that demonstrate to our students, if the teachers in role model positions gave up when things got tough? That honestly frustrates me even more than parents normalizing how it’s okay to be “bad at math!”
    The second issue is how to redesign the current CSET, or some other form of subject matter fluency, so that it is more closely aligned with the actual content. Personally, I would happily forsake some of the CSET multiple choice, and start making teachers work on some problem based lessons or open middle problems! A lot of those problems are just as challenging, but relate a lot more than asking about the properties of a ring or field!

    • There’s a lot to unpack here. First, when I took the CSET, it was 2004 or 2005 and there were literally zero test prep books at the time. It was just after the switch away from the MSAT and I was on my own. Glad to see that the history of math section is gone. No tears will be shed for that.

      I don’t share your take on math teachers without math degrees. I think this is really complex but there could be lots of reasons at play. I have used essentially NOTHING from my UCLA college math classes in life or even in teaching. So, while I’m grateful that having a math degree has opened doors for me, I kinda wished I had studied something more useful. Maybe we should be looking at the reality that many college math professors have no formal training as educators and that this could be a bigger issue.

  8. Robert,

    Your problem 1 (actually problem 9 from the sample materials at http://www.ctcexams.nesinc.com/TestView.aspx?f=HTML_FRAG/CA_CSET211_PrepMaterials.html) has all the issues you mention, and more:
    Answer A is correct because it shows that multiplication in this setting is not commutative.
    Answer C is ALSO correct because it shows that there is no zero element.
    Answer D needs revision. Is it introducing matrix A twice? Is there a typo? Is it intentionally written that way, so as to assess the test-taker’s ability to ignore answers that are part gibberish? Is it part of a ploy to condition test takers to ignore questions that are part gibberish, so that they’ll miss a later answer that is correct by merit of being part gibberish? It’s unnecessarily exhausting. By my count, at least half the answers to this item need to be changed.

    They did it again with #17 on the same prep materials, with answers A and D both being correct.

    When I took the CSET–it must have been about the same time you did, give or take a couple years–I left with the feeling that some questions on the real test had the same issues.

    Maybe your statement “It took me two weeks with the answers AND explanations to fully understand how every problem was solved” is testament to the quality of your math preparation at UCLA; I know people who’ve studied a lot longer for the CSET with less to show for it. Still, I would like to see a test with more relevant content on it–perhaps, a question that asks the test-taker to draw conclusions about student thinking. Maybe take excerpts from Error Patterns in Computation and ask what the “student” is doing. Tough to do this in a multiple choice format, though.

    I’ve raised my concerns to the CSET folks, who thanked me for my input. If anything comes of it, I likely won’t find out for exam security reasons.

  9. LOL, there is so much to unpack in one comment. I could speculate on a lot of it, but I’ll just say that it doesn’t change my thoughts that there needs to be major rethinking around the CSET. The part at the end reminds me of that stereotypical spy comment of “I could tell you, but I’d have to kill you.”

  10. I wholeheartedly agree with you, and I’m only trying to pass the CSET subtest II for a multiple subject credential. Nothing that I studied was on the exam, and I studied a lot!! I have worked as a sub and curriculum sub, and there is not a student I’ve encountered that could do the math section of the subtest. Wonder why California has 14,000 open teaching positions?

    • Yeah, my gripe is not about it being hard but rather being irrelevant. For example, we could make a really hard test where teachers need to know a handful of methods to solve a problem, but it’s super naive for people to think “Let’s make this test about really advanced stuff and assume that they will know everything that came before it.”

  11. Thanks for the post! I am an aspiring teacher with the EnCorps STEM program, transitioning from 15 years in startups to teach math. I am slated to take all 3 math CSETS in December, roughly a week apart.

    I am looking for the best prep materials now and all advice is welcome! I will dig around your site for more, but would appreciate any consolidated wisdom you could pass my way.

    Thanks!

    • Honestly, I’m not sure. I took this test when it was brand new in around 2004 or 2005 and at the time, there were literally zero study guides, websites, study groups, etc. I went through the entire practice set and made sure I understood all of them and then took the list of things they said were potential topics and studied those. I did not enjoy that process.

  12. I am studying for CSET I and II at the moment. I never liked math, then a college professor during my Multiple Subjects Masters program helped me learn to love math and now all I want to teach is Math. But these tests are in the way.

  13. Fellow Bruin here, Theater 1997!

    I’m in a teacher intern program and have private school experience teaching social studies, but not math. Ironically, because of the pandemic’s impact on testing facilities, I’m teaching 7th grade math without having taken the CSETs. All the feedback I’m getting, from my practicum supervisor to my principal to the parents of students, is overwhelmingly positive. I’m delivering conceptual lessons in a way that is reaching students and getting better all the time.

    And I am terrified of the CSETs.

    I’ve been studying on and off for the CSET Math Subtest I for about a year. I’m getting to a point where I think I’ll get about 70%-75% of the multiple choice questions, but unless I’m getting a mathematical induction question on the constructed response I’m sunk. I’ll be taking Subtest I for the first time in a couple weeks and I’m pretty much positive I’ll fail it and am going to chalk it up as a needed experience in order to prepare better for next time. Fortunately I have until the end of my intern program to pass I and II, but I’m 100% on board with you that these tests are a big part of why there is such a shortage of math teachers in California schools, to no benefit in terms of teacher competence or student performance.

    I’ve heard there are some efforts underway to reform these tests, and I really hope they’re not just window dressing.

    • Nice. I’m class of 2000, math here. The problem with reforming these tests is the gatekeeping. If you pass, then you have other issues to move on to. If you don’t pass, then the powers that be can too easily blame it on the test taker.

      It absolutely sucks.

      I remember talking to a university math professor who was on a commission to make a CSET equivalent for math coaches. She said something like how the test for them needed to be harder than the CSET. I was like, “Have you seen the CSET?” and then showed her some practice problems which also obliterated her.

      There’s this disconnect. Few really get how ridiculous this is.

      • Awesome! I wonder if you were in some classes with my wife: she is Astronomy 2000. We are a true north/south campus relationship!

        I taught social studies before coming to math, and I totally recognize the problems with getting reform through. The incentives are all out of whack, as you note: the gatekeeping function benefits those who have actually passed the test, because they benefit from the low supply of available math teachers. Politicians who are responsible for writing the laws can point to their “high standards” for teacher qualification, and could be punished for “lowering standards”. There just isn’t sufficient incentive for the people who are actually responsible for the system to change it. The people who suffer are those on the ground responsible for seeing students are taught, and of course the students themselves.

        I’m not a political animal, so I don’t know how to work the system for change. I sure hope someone figures it out.

        One note: the other math teachers in my department didn’t have to take the CSET. They met the requirements for teaching through their credentialing program at Sonoma State. So at least there is

  14. I’m studying for them now. I got 49% the first practice test. 80% the second run through with a different practice test. Then there is a practice test on the UC Davis site, that seems to have every difficult question imaginable. Even the ones I think I understand I end up getting wrong. Why are the practice tests so different from one-another? Do the actual tests vary that greatly in difficulty level? I’m concerned.

    • I can’t answer the question about why the practice tests are different other than the reality that there is a lot of math you could be tested on, so they’re giving you variety. But I do remember taking weeks with the practice test answers to understand WHY I got them wrong.

      I’m pretty sure I could not pass the CSET if I took it right now.

    • I’ve noticed the same thing: prep materials are wildly varied in quality. I wonder if some of them are based on earlier tests that are less difficult. One teacher prep website I signed up for is using videos that look to be at least 15 years old, and I know the tests have been updated since then.

      I STRONGLY recommend checking out Laura Rickhoff’s prep materials. Some of it is free, but she does sell very complete prep packages. A number of my fellow interns have sworn by her material, and these are non-math majors who have managed to pass the CSET. I’m using them and I’m definitely feeling more confident. There is just sooooooo much to get through.

  15. 15th year science teacher here looking into taking the CSET I and II to add to my credential portfolio (with recent RIFs at my district, nobody seems safe these days!). Any suggestions on how best to study for these two exams? I’ve known people that recently took it and also languished over how difficult it was. I’ve considered going the lengthier and more costly route taking courses through UC Riverside, but frankly, I don’t have the time. I’d love to hear any of your thoughts.

    • I just commented above on the same topic: a couple of math interns in my cohort, who didn’t have an academic math background, used Laura Rickhoff’s prep materials and managed to pass. They’re very thorough and conceptual, plus including a lot of the test-taking strategies. Unfortunately, the test seems designed to require these strategies due to time requirements – several of the problems are incredibly complex computationally, so you need shortcuts.

      So ridiculous, but isn’t that the topic we are discussing?

      • Honestly, I’m not sure. I took these tests so long ago (like 2004) that there were literally no study materials created yet and it sucked. Hope it goes/went well.

        • It did! I took the test a couple weeks after I posted that comment, and was notified Friday that I passed! It must have been by the skin of my teeth, or I got really lucky on some of the guesses, but one way or another I am past that gate. Now on to Subtest II and finishing my intern credentialing program.

          It really is sad how much of a hurdle this is: we need good math teachers, not good math test takers.

Leave a Reply