Search

"Methods and Procedures in PIRLS 2016" documents the development of the Progress in International Reading Literacy Study (PIRLS) assessments and questionnaires and describes the methods used in sampling, translation verification, data collection, database construction, and the construction of the achievement and context questionnaire scales. In particular, "Methods and Procedures" documents the numerous quality assurance steps and procedures implemented by all those involved in the PIRLS 2016 assessments, including the TIMSS & PIRLS International Study Center, IEA Amsterdam and IEA Hamburg, Statistics Canada, and the National Research Coordinators and their teams in the participating countries and benchmarking entities. This report contains four sections and fourteen chapters. Section 1, Instrument Development, contains the following chapters: (1) Developing the PIRLS 2016 Achievement Items (Ina V. S. Mullis and Caroline O. Prendergast); and (2) Developing the PIRLS 2016 Context Questionnaires (Martin Hooper and Bethany Fishbein). Section 2, Sampling, contains the following chapters: (3) Sample Design in PIRLS 2016 (Sylvie LaRoche, Marc Joncas, and Pierre Foy); (4) Estimating Standard Errors in the PIRLS 2016 Results (Pierre Foy and Sylvie LaRoche); and (5) Sample Implementation in PIRLS 2016 (Sylvie LaRoche and Pierre Foy). Section 3, Data Collection Procedures, contains: (6) Survey Operations Procedures in PIRLS 2016 (Ieva Johansone); (7) Translation and Layout Verification for PIRLS 2016 (David Ebbs and Erin Wry); (8) Quality Assurance Program for PIRLS 2016 (Ieva Johansone and Erin Wry); and (9) Creating the PIRLS 2016 International Database (Sebastian Meyer, Mark Cockle, and Milena Taneva). Section 4, Reporting, contains: (10) Reviewing the PIRLS 2016 Achievement Item Statistics (Pierre Foy, Michael O. Martin, Ina V. S. Mullis, and Liqun Yin); (11) PIRLS 2016 Achievement Scaling Methodology; (12) Scaling the PIRLS 2016 Achievement Data (Pierre Foy and Liqun Yin); (13) Using Scale Anchoring to Interpret the PIRLS and ePIRLS 2016 Achievement Scales (Ina V. S. Mullis and Caroline O. Prendergast); and (14) Creating and Interpreting the PIRLS 2016 Context Questionnaire Scales (Michael O. Martin, Ina V. S. Mullis, Martin Hooper, Liqun Yin, Pierre Foy, Bethany Fishbein, and Jenny Liu). [Individual chapters contain references.]