Saturday, April 11, 2009

Chicago Parents Guide to Testing

Posted August 20th, 2007 by fairtest in

  • Parents, do you believe that either the Iowa (ITBS) or the high school TAP tests alone accurately measure your child's abilities?
  • Do you believe that, if your child works hard enough, he orshe should be able to "pass" the ITBS or TAP?
  • How much do you really know about the ITBS and TAP tests, on which so much of your child's future depends?

This booklet was written especially for Chicago Public School parents bytheLSC Summit, a coalition of Chicago parent and school reform groups togetherwith FairTest, a nationally-recognized organization specializing in issues of student testing.

ITBS refers to the Iowa Tests of Basic Skills given to 3rd. through 8th. grade students in the Chicago Public Schools (CPS).

TAP refers to the Tests of Achievement and Proficiency given to CPS 9th and 11th graders.

The ITBS and TAP tests are published by Riverside Publishing Company.

Parents, you need to know that...

  • The ITBS/TAP do not test many important educational areas.
  • There are many other educationally sound ways to assess children'd learning.
  • ITBS/TAP Test scores do not tell you what students know or are able to do; they only tell you how your child compares to other students.
  • Half the ITBS/TAP test-takers will always score below average.
  • ITBS/TAP tests use obscure or tricky questions to sort and rank students.
  • The margin of error of ITBS/TAP test results is too great to use those results alone to make important educational decisions and a violation of the rules for using these tests.


Overemphasis on ITBS and TAP tests may lower the quality of your child's education
Just as you may be a good driver even if you do not know the way to the airport, children may be good students in reading and math and still choose wrong answers to ITBS/TAP questions. There is a lot more to reading and math than multiple-choice questions-- such as those on ITBS/TAP tests-- can measure.

Also, ITBS/TAP tests do not test writing, science, social studies, the arts, or other areas of state and district educational standards. Multiple choice tests cannot test most higher-level thinking skills. They do not test skills students need to get into college or qualify for a job.

These tests cannot determine if a student can write a research paper or a short story, use history as a context for understanding current events, construct tables and charts to show the results of a science experiment or interpret those results, discuss the differences in poetic writing styles, or debate important issues. They don't test problem-solving, decision-making, judgment, social skills, or citizenship.

In other words, they do little to test your child's ability to function and succeed in their real-world environment.

Schools may be forced to "dumb down" education when these tests are overemphasized.
Overemphasis on ITBS/TAP tests encourages schools to "teach to the test," that is, to spend lots of instructional time having students practice how to answer questions like those on ITBS/TAP tests. Many educators believe that teaching to these tests results in inferior teaching and a weakened curriculum which do not serve our children.

Research shows that students make stronger long-term achievement gains when the emphasis is on improved teaching methods which engage and challenge children and not on multiple-choice or short-answer testing.

But CPS schools are being pressured to narrow the curriculum and spend weeks in test-preparation activities. The CPS summer school bridge functions largely as a test-coaching program.

High-achieving school systems do not narrowly teach to tests like the ITBS or TAP. These schools offer their children a rich, challenging curriculum which prepares them for college and career.

Research shows that teaching practices in high-minority classrooms are affected more by these tests which emphasize low level thinking and knowledge.

"Much of the work assigned to Chicago students fails to go beyond reproduction of information, such as filling in blanks with vocabulary words....if students are exposed only to such assignments, it is unlikely they will learn to succeed in the more demanding intellectual challenges posed by the modern workplace and by civic and personal affairs."

From Report Astract for The Quality of Intellectual Work in Chicago Schools: A Baseline Report Consortium on Chicago School Research, November 1998

There are better, more educationally sound ways to assess children's learning.
Isn't the road test you take behind the wheel of a car, which is a practical performance test, a better indicator of how well you can drive than any pencil-and-paper exam? Many educators believe that this kind of performance-based test provides much better information about what students know and are able to do than the ITBS/TAP tests by themselves.

There are better ways to assess student learning and school quality. For example, many CPS teachers are using portfolios -- collections of student work-- to assess student learning in subjects all across the curriculum.

Effective student assessment can include observation, samples of student work, essays, lab experiments, public presentations and exhibitions, group projects focused on solving real-world problems, and the kinds of quizzes and tests teachers already use.

Experts agree that tests such as ITBS and TAP are used properly only when they are used as one piece of information in a comprehensive system of assessment.

ITBS and TAP tests have significant limitations.
ITBS/TAP test scores do not tell you what students know or are able to do; they only tell you how your child compares to other students.

The ITBS/TAP tests are norm-referenced tests. This means that they are designed to sort and rank students on a curve.

Norm-referenced tests like the ITBS and TAP are not made to measure if students have learned what they have been taught in their school's curriculum. ITBS/TAP test scores can only tell you how you child compares to a national reference group.

This is a bell-shaped "normal" curve. Questions on norm-referenced tests are carefully selected to produce a score curve like this, in which only a few students score very high, only a few students score very low, and most students score in the middle. These tests are also designed so that half of the students taking the test will end up below the middle score – which is called the "average" – and half will end up above. This guarantees that half of the students will always score "below average" on such tests.

Half the ITBS/TAP test-takers will always score below average.

The ITBS and TAP tests do not have a "passing" grade. They are not the same as the written test you take to get a driver's license. On that test, it is possible for everyone to get enough answers right to pass, if they learn the information. But ITBS/TAP tests are made so that one-half of the students in the nation who take them always score below average. On other words, one half of those students will always score below the grade equivalent (GE).

ITBS/TAP tests use obscure or tricky questions to sort or rank students.
If the driver's test were used to sort or rank people, it would have to include some questions not everyone would get right. It might ask, "How do you get from Union Station to O'Hare Airport?" or "What is the chemical composition of diesel fuel?," facts which are not taught in the standard drivers' education classes and which are not relevant to good driving.

To sort or rank students, ITBS/TAP tests also include some questions which are designed to sort kids out. A close look at these kinds of questions shows that they may have more than one answer which many people would consider correct.

For example:Children often select "old". The test maker says the right answer is "wise". This kind of question could trip up many students, including those from cultures strongly identifying wisdom with age.

The margin of error of ITBS/TAP test results is too great to use those results alone to make important educational decisions.

Test scores are an estimate, they are not exact. Every test has a margin of error. Different versions of the test, the number of questions on the test, simple mistakes like filling in the wrong bubble, or even a child's mood on a given day can affect his or her score.

This margin of error is one reason that the Riverside Publishing Company tells school districts not to use the ITBS/TAP test scores as a single basis for making decisions like grade retention. "Single basis" means a situation where a certain test score must be reached or a student will be held back, regardless of other factors. One wrong answer on these tests can make the difference in whether your child is promoted or retained.

The way CPS uses the ITBS/TAP tests to make important decisions about students is a violation of the rules for using these tests.

The lead author of the ITBS for Riverside Publishing Company, H.D. Hoover, recently said that "a single test should never be used as the sole basis to make decisions such as promotion and retention."

CPS signed an agreement with Riverside Publishing Company to use the ITBS and TAP tests. This agreement states that CPS will not label students based on a single test score.
The ITBS and TAP test manuals state clearly that it is inappropriate to use ITBS results to decide to retain students at a grade level. Using ITBS/TAP tests to make such high-stakes decisions also violates the measurement profession's Standards.

Experts agree that other information including teacher and parent input must be considered when making to such an important decision as retaining a student.

Research has shown repeatedly that grade retention – holding students back for another year in the same grade – does not work and actually harms students. These studies show that after a couple of years, students who were retained do less well than similar students who were not retained. There are few educational practices proven to be as damaging to students as retention.

Retention also hits hardest on low-income and minority children. Ernest House, a noted educational researcher, stated, "Chicago would not have its retention program if its student population were not 89% minority. By contrast, a survey of fifteen Chicago suburban school districts indicated that (they) retained fewer than one percent of their students. It is the inner city with large minority populations where these harmful programs are implemented en masse."
So CPS is using an inadequate measure – the ITBS/TAP – as the basis for carrying out a policy which has been proven to damage children – grade retention.

What is better than retention? Real, long-term improvements in student achievement occur when schools provide supports to children as soon as they begin to fall behind, regularly assess programs for their effectiveness, offer early childhood education, use resources to attract more qualified teachers, lower class size, fund better materials, and provide more high-quality teacher training and support.

Parents, now that you know more about the ITBS/TAP tests, what can you do?
Ask your Local School Council to hold a school-wide discussion on the topic of the ITBS or TAP tests and how they are used in the Chicago Public Schools.

Find out more about the legal issues related to retained children by calling the Chicago Lawyers' Committee for Civil Rights Under Law, 312/630-9744

Call or write to the Riverside Publishing Company to ask them to discontinue CPS use of these tests until CPS complies with the rules.

Learn more about this topic by calling any of the sponsoring organizations.

No comments: