Search

Scotland, traditionally, has high levels of confidence in teachers. Fairness and justice are key concepts in policy and practice in Scottish education. For more than 100 years, the high-stakes assessment system in Scotland, with the Scottish "Higher" qualification at its heart, has been crucial to that sense of opportunity and justice. However, in 2019-2020, public confidence in high-stakes assessment in Scotland, as in other United Kingdom countries, was dented. In Scotland, the COVID-19 pandemic meant that schools were closed, teachers provided online learning opportunities for pupils working at home and, for the first time in 130 years, it was not possible to run national examinations. To ensure that learners were not further disadvantaged, alternative approaches to gathering evidence for qualifications were instigated. However, these results were challenged as socially unjust and the results that had been nationally moderated were replaced by results based on locally moderated teachers' professional judgement. As Scotland looks to qualifications beyond COVID-19, trust must be re-built. This article reports on a participative research project that sought to understand public perceptions of standards and fairness across a range of key communities following this experience. Drawing on both qualitative and quantitative data, we analyse factors which affected trust in National Qualifications under the pandemic. The evidence suggests that when considering what matters for qualifications to be trusted, technocratic solutions are likely to be rejected by stakeholders. Understanding and responding to what led to the mistrust of qualifications in Scotland will be crucial to inform its future qualifications system.

The theoretical literature on the meaning of qualification standards depicts a variety of definitions. Some definitions describe properties of examinees, whilst others rely on cohort-level or system-level characteristics. Different definitions can be compatible or contradictory. In this study, stakeholders' views of the meaning of qualification standards in Scotland were collected, using focus groups (82 participants) and a questionnaire (918 participants). Almost 60% of questionnaire participants responded that standards tell us about performances on the assessment (criterion-referencing) and approximately 40% responded that they tell you about an underlying ability (construct-referencing). Few participants considered that maintaining statistical grade distributions every year were important. Discrepancies in views raise questions regarding how an examination board manages the political and technical process of maintaining public confidence in standards. Based upon this Scottish case, the authors argue that social settlements regarding qualification standards are a social contract, and a solely technocratic view of standards is conceptually inadequate. [ABSTRACT FROM AUTHOR]

In a context of increasing demand for quality and equity in education and a sharp focus on accountability, classroom teachers are also expected to support and improve learning outcomes for pupils in response to their individual needs. This paper explores three issues: how teachers understand assessment in relation to their students' learning, the curriculum and their pedagogical choices; how teachers' capacity to use assessment to improve students' learning can be developed through career-long professional learning (CLPL); and how teachers' learning can be implemented and sustained in schools, both locally and nationally. In considering these issues, recent thinking about learning and assessment and CLPL are considered alongside empirical evidence from the development and implementation of assessment processes and approaches to professional development in Scotland. The paper emphasises the importance of a dynamic framework of CLPL that recognises the individuality of teachers' learning needs and the consequent need for tailored professional learning opportunities with different combinations of support and challenge at school, local and national levels.

Scotland, in common with many other countries internationally, has paid considerable attention to the development of assessment for learning. Currently, schools in Scotland are engaged in a major programme of curriculum and assessment reform, entitled Curriculum for Excellence. As part of the reform process, there is concern amongst practitioners, researchers and policy-makers about "consistency" and "standards". In this article, we explore international issues of consistency and standards through a Scottish lens. In particular, we focus on how standards, and the idea of consistency of judgements and standards, are understood and applied in practice. We draw on international research and policy, and reflect on how that evidence relates to the findings from a recent government-funded research project in Scotland, "Assessment at Transition". We conclude by identifying what the different communities need to do to help build an integrated, assessment-capable system that will be sustainable in the longer term.

In many European languages, the words "assessment" and "evaluation" are synonymous, but in English the two terms are used differently. Educational "assessment" is learner-focused and part of professional pedagogy, relating directly to the accountability of practitioners and schools to learners and their families. Educational "evaluation" is understood to be a parallel and linked process, relating to the quality of national policy and of provision and practice in establishments, part of accountability to the wider public. In Scotland, assessment policy has been focused on aligning "assessment for learning" and "assessment for accountability" for nearly a decade and policy guidance has been based on the principle that formative and summative uses of information can apply as well to system evaluation as to school-based assessment. Self-evaluation has been increasingly emphasized, promoting better understanding of the role of continuous review in supporting and improving education. In theory, the two processes of assessment and evaluation should align without difficulty as "intelligent accountability" and together should act as a powerful driver for improved educational outcomes. However, achieving alignment in practice, which requires good professional relationships and mutual trust in different communities of practice, as well as shared understanding and expectations, has proven to be very hard to achieve. This article will show the progress that has been made with alignment; indicate where there have been difficulties and why; and suggest that several important factors need to be acknowledged if alignment is to be achieved. (Contains 2 figures and 1 table.)

This article takes the form of a case-study, outlining the progress of policy and practice in Scotland towards the introduction of Assessment for Learning in pre-school and schools for children aged 3-14. The period described comprises the launch of 5-14 curriculum and assessment guidelines in the early 1990s, a review and consultation on assessment in pre-school and 5-14 by HM Inspectorate of Schools, the recent assessment development programme, Assessment is for Learning (AifL), initiated in 2002, and the publication by the Scottish Executive Education Department (SEED) of a set of curriculum and assessment policy documents for education 3-18 in November 2004. The assessment guidelines published in 1991 put considerable emphasis on professional practice in assessment as part of learning and teaching, promoting what would now be recognized as "assessment for learning". However, curriculum guidelines for English language and mathematics and new arrangements for national testing in reading, writing and mathematics were published at the same time. These commanded considerable professional and public attention, so that curriculum content and measurement of attainment levels, rather than the quality of assessment practice in classrooms, became the main focus of schools' planning and action. The increasing emphasis on standards, target-setting and accountability in the mid- to late 1990s ensured that measurement, rather than assessment for learning, remained the main priority. Recognition on the part of ministers that assessment and testing arrangements were not working well for learners, teachers or policy-makers led to the 1999 review and consultation. This once again asserted the importance for learning and achievement of good professional practice in classroom assessment. At the same time, the emphasis in policy more generally was shifting towards establishing a culture of self-evaluation in local authorities and schools. The Assessment is for Learning development programme has sought to bring together these various threads in a coherent national system of assessment. It aims to promote excellence in professional assessment practice, the primacy of teachers' judgements and sound arrangements for local quality assurance of those judgements, to ensure consistency. For national monitoring of attainment, there will be a cycle of sample surveys rather than a collection of data for all schools and pupils. The programme has also sought to take account of research on the management of change to ensure that the new system is developed collaboratively with stakeholders and put into effect in all Scottish schools.

Describes the use of the partial credit form of the Rasch model in the analysis and calibration of a set of writing tasks in which assessment scales and criteria were adapted to suit each task's specific demands. Potential applications of the partial credit model in language testing are discussed. (Author/CB)