I am continually amazed by how otherwise intelligent people can act so stupidly when they are arguing about something they like or don’t like.
Standardized testing is almost universally loathed by students, parents, teachers, and principals. Of course, the simple reason is that
No one uses it how it’s supposed to be used!
But this article is about an otherwise intelligent school board member who doesn’t understand how do to things and why we do the things we do… plus he doesn’t even bother to attempt to learn about the things he’s rambling on about before rambling on about them.
Here’s the article: When an adult took standardized tests forced on kids
The first bit talks about the person who took the test. The sad part is that he took it because he’s actually on the school board of the town. This saddens me for reasons that will become apparent later.
Apparently this person manages the budget of a large organization, yet can’t see how math is important. He has a bachelor of science degree and two masters and can’t read effectively. This says a lot about something…
Let’s look at some specific points.
“It might be argued that I’ve been out of school too long, that if I’d actually been in the 10th grade prior to taking the test, the material would have been fresh. But doesn’t that miss the point? A test that can determine a student’s future life chances should surely relate in some practical way to the requirements of life. I can’t see how that could possibly be true of the test I took.”
It can be argued that, but it isn’t. No one who actually understands the entire point of these tests would argue that.
Let me say this very carefully. These tests are NOT to test real world knowledge and abilities. These tests are NOT to test practical life skills.
These tests are designed very carefully. It usually takes about 30 months to write the material for these tests. The material goes through several committees, client review, multiple copy editors, psychometricians, and content specialists.
They are designed to test the student’s knowledge of the curriculum. That’s all. There is NOTHING ELSE that these tests should be used for… but we’ll get to that in a second.
If I’d been required to take those two tests when I was a 10th grader, my life would almost certainly have been very different. I’d have been told I wasn’t ‘college material,’ would probably have believed it, and looked for work appropriate for the level of ability that the test said I had.
BTW: That’s a link to 2nd grade tests… not the tenth grade tests. Journalism fail.
If you manage the budget for a major company and still can’t handle basic algebra, maybe you aren’t college material. However, through hard work you made it through college anyway. There are WAY more factors on success rates in college than test scores. With socioeconomic status being the main one and parent’s influence being the next.
That being said, in terms of success in college, the two biggest predictors from standardized tests are literacy skills and mathematics skills.
But let’s look at something here. I don’t know of a single person, ever (having been a high school teacher, college counselor, and college assistant registrar) who has ever been told “You aren’t college material.” That’s a fundamental lie. And it is a very disingenuous think to say.
Go ahead, go to your local high school and ask the counselor if they have ever told a student that they are not college material. It’s these people’s job to encourage students and support them.
Colleges are there for education. They will never say “You aren’t college material”, now they might say, “Your test scores indicate you need some help in math or literacy and we have some classes that you can take to help with that.”
Education is not an either-or thing. It is a large range of opportunity and training.
“It makes no sense to me that a test with the potential for shaping a student’s entire future has so little apparent relevance to adult, real-world functioning. Who decided the kind of questions and their level of difficulty? Using what criteria? To whom did they have to defend their decisions? As subject-matter specialists, how qualified were they to make general judgments about the needs of this state’s children in a future they can’t possibly predict? Who set the pass-fail “cut score”? How?”
This is about the most depressing thing in the whole article. Presumably this idiot had to do some measure of research for his two masters degrees. Yet, he can’t be bothered to pick up the phone and call the state education department who could tell him this information in about five minutes.
First of all, this has nothing to with a student’s “entire future”. Again, education is a life long thing and some people are good at it and some aren’t. Some people are good test takers, some are not. Some people will be massively successful with and without college and education. Some people will fail miserably even with a college education… like this guy.
Now, the details. “Who decided the kind of questions and their level of difficulty?” The state did. The people who write the test wrote items and gave them an estimated difficulty. Then the client reviewed them and made changes if needed. Then a committee put together of teachers and content experts in that state reviewed the items… and made changes. Then everyone (except the committee) did it again.
As to what kind of question, you might ask your teacher why they teach what they teach. It’s called a ‘curriculum’ and most states mandate the curriculum for every course and every student in the entire state. A school board member doesn’t know this? sigh…
“Using what criteria? To whom did they have to defend their decisions?” Same answer. The client and the client committees are the ones to whom the decision is defended. I’d be willing to bet that the curriculum was developed by dozens of educators and content experts from the state. In many states, the curriculum must be approved by the entire state school board and either the governor or the state legislature.
“As subject-matter specialists, how qualified were they to make general judgments about the needs of this state’s children in a future they can’t possibly predict? Who set the pass-fail “cut score”? How?”
Let’s see, I’m a subject matter expert for a testing company. I’ve been living and breathing my field of study for over 20 years. I have over a hundred college hours in science and another 30+ in education. I have taught at middle school, high school and adult learner levels. I have been in this industry for three years and have been put in charge of the science portion of two state projects and a national project. Let’s just say that I know what I’m talking about.
“Future”? Another disingenuous comment. For most kids, the next level of education is… next year. These tests are specifically designed to test how student’s have learned the current coursework. Again, these are NOT for life skills or anything else… just the current curriculum.
“Who sets the pass fail cut score?” Another call to the state education office and you would learn that setting cut scores is a highly technical process that for most tests takes between 3 days and a full week, with a large committee of educators and non-teacher subject matter experts. The whole show is run by a couple of people with doctorate degrees in a subject called psychometrics. That’s the science of statistical analysis of test results.
This not just someone saying ‘the cut score is here’.
“I can’t escape the conclusion that decisions about the [state test] in particular and standardized tests in general are being made by individuals who lack perspective and aren’t really accountable.”
Which is plainly a steaming pile of horse cookies to anyone who keeps up with the news in education. The decisions are being made with the help of advisory committees full of professional educators, subject matter experts, and statisticians. Accountable? Seriously? Again, you just aren’t paying attention.
There you have it. A concise summary of what’s wrong with present corporately driven education change: Decisions are being made by individuals who lack perspective and aren’t really accountable.
No, there you have it, a guy who has no clue what’s going trying to explain why everything is wrong. This is so typical it’s not even funny.
Those decisions are shaped not by knowledge or understanding of educating, but by ideology, politics, hubris, greed, ignorance, the conventional wisdom, and various combinations thereof. And then they’re sold to the public by the rich and powerful.
All that without so much as a pilot program to see if their simplistic, worn-out ideas work, and without a single procedure in place that imposes on them what they demand of teachers: accountability.
Hmm… this guy has never heard of field testing of items. He obviously has no clue about the large body of scientific research that is conducted every year for the last few decades on education assessment.
I assure you, no one in my industry is rich and powerful.
Finally, as I said before, anyone who uses standardized test results given to students to hold teachers accountable is a moron. These tests can only be used to hold one person accountable for their education: students.
If you use a toaster oven to cook a Thanksgiving turkey, it is an exercise doomed to failure. Using tools for purposes they were never intended for is a failure of the person, not the tool.
You want to hold teachers accountable, then give THEM the tests.
The stupidity of the current test-based thrust of reform has triggered the first revolt of school principals.
Winerip writes: “As of last night, 658 principals around the state (New York) had signed a letter — 488 of them from Long Island, where the insurrection began — protesting the use of students’ test scores to evaluate teachers’ and principals’ performance.”
Of course, when you use a tool improperly, then you have failed on an epic scale.
Let’s face it. Some kids, no matter what you do with them, will never ever learn. It’s not the teachers’ fault, but someone has to be blamed and no one will ever blame students.
The article concludes
My school board member-friend concluded his email with this: “I can’t escape the conclusion that those of us who are expected to follow through on decisions that have been made for us are doing something ethically questionable.”
He’s wrong. What they’re being made to do isn’t ethically questionable. It’s ethically unacceptable. Ethically reprehensible. Ethically indefensible.
You are absolutely correct. It is entire unethical to use a tool for a purpose it was never designed for. But, since you people won’t hold the students accountable for learning, someone has to be to blame so the teachers and principals get it.
This concludes your lesson. I would encourage you (and everyone reading this) to do a modicum of research into the standardized assessments in your state. If you have general questions, I may be able to help. If I can’t, I can probably find out how to find the information for you.
I’ll say one last thing about people who think that we don’t need advanced math skills or science skills. You are all absolutely correct, most people don’t use math every day. Everyone uses science principles almost everyday, but I digress.
The point is, if you were only educated at an elementary level, then what would happen that one time you actually do need the quadratic equation? You wouldn’t even have the basis to understand it.
My boss says that content is dead. You can find out anything on the internet, but with an elementary level education, how can you know what you are looking at it is even correct?
Yes, you can learn anything, if you can search for it. But if you don’t even know what to search for? How can you do anything, when you don’t know what exists?
What’s even scarier is thinking about all the critical decisions people make every day. Everything from voting, to medicine, to dangerous actions (like cooking). How can someone with only a elementary level of education function in our modern world?