Third International Mathematics and Science Study. Technical Report. Volume I: Design and Development.

The Third International Mathematics and Science Study (TIMSS) developed and administered tests and questionnaires in three student populations to document the quality of mathematics and science education in 45 participating countries. Study design, instrument development, and research procedures were achieved through a complex collaborative process. This volume of the technical report focuses on study design and development. Each chapter addresses a critical issue in development. Documentation of TIMSS implementation and analytic procedures will be presented in a future volume. Chapters are: (1) "Third International Mathematics and Science Study: An Overview" (Michael O. Martin); (2) "Development of the TIMSS Achievement Tests" (Robert A. Garden and Graham Orpwood); (3) "The TIMSS Test Design" (Raymond J. Adams and Eugenio J. Gonzalez); (4) "Sample Design" (Pierre Foy, Keith Rust, and Andreas Schleicher); (5) "Development of the TIMSS Context Questionnaires" (William H. Schmidt and Leland Cogan); (6) "Development and Design of the TIMSS Performance Assessment" (Maryellen Harmon and Dana L. Kelly); (7) "Scoring Techniques and Criteria" (Svein Lie, Alan Taylor, and Maryellen Harmon); (8) "Translation and Cultural Adaptation of the Survey Instruments" (Beverley Maxwell); (9) "Field Operations" (Andreas Schleicher and Maria Teresa Siniscalco); (10) "Training Sessions for Free-Response Scoring and Administration of Performance Assessment" (Ina V. S. Mullis, Chancey Jones, and Robert A. Garden); and (11) "Quality Assurance Procedures" (Michael O. Martin, Ina V. S. Mullis, and Dana L. Kelly). Three appendixes present acknowledgments, TIMSS test blueprints, and survey operations forms. (Contains 13 figures, 71 tables, and 8 appendix tables.) (SLD)