Item Development

Ballard & Tighe recently conducted a series of successful item writing workshops to create test items for the new IPT testing system. Following NCLB requirements, these test items concentrate on Academic English and cover reading, writing, listening, and speaking skills.

Throughout the month of February 2004, experienced teachers and other educators convened at the Kellogg West Conference Center on the Cal Poly Pomona campus in Southern California to write test items based on specifications developed by the Ballard & Tighe assessment team. The workshops were led by Ballard & Tighe’s director of assessment, Dr. Sari Luoma, together with expert item writing specialists from across the United States. Participating educators were given training on item writing and the skill definitions in the test specifications, after which they worked in grade-span specific groups to write test items under the guidance of item writing specialists. The following series of workshops was arranged:

Writing Test Workshop - February 1
Representing all content areas and grades, teachers wrote multiple-choice questions to assess students’ grammar and knowledge of written conventions. They also wrote writing prompts to elicit students’ productive writing capabilities.

Speaking Test Workshop - February 7-8
Working collaboratively, teachers developed picture specifications and hundreds of items to assess students’ English speaking proficiency. Among other things, the items created will require students to make predictions, express opinions, read equations, explain graphs, and discuss processes.

Listening Test Workshop - February 14-15
With guidance from item writing specialists, educators worked to develop a substantial range of items to test English learners’ listening proficiency. Along with the test items, item writers developed numerous picture specifications, dialogues, word problems, and other passages. Sources for generating items included passages played from audio CDs; the final version of the Listening Test will require students to listen to audio text.

Reading Test Workshop - February 21-22
Aided by item writing specialists, item writers - most coming with experience from previous workshops - generated items to test reading comprehension, graphic understanding, and vocabulary in context. Item writers also took the opportunity to edit and compile reading passages and create graph and picture specifications for the test.

Review Process
To ensure national representation and unbiased items, the newly created items underwent three careful reviews; one by grade-level teachers across the United States, one by members of a Bias/Sensitivity Panel, and one by language acquisition and testing experts.

Field Testing
After the careful item development and review process, the items were field tested in numerous schools across the United States. The data from the field testing was analyzed in the summer of 2004, after which the first forms of the IPT test were constructed.

Download February 2004 Newsletter reporting item-writing progress for the IPT Testing System.