Search

Teachers' language assessment literacy (LAL) refers to teachers' ability to perform assessment-related tasks. Despite the significant role of language assessment literacy in English language teaching and learning, many teachers reported to have an inadequate ability to perform assessment-related tasks because of the lack of assessment training programs that prepared them for the tasks. This study aimed at investigating the existing assessment training programs to develop EFL teachers' LAL. A systematic literature review was conducted to observe trends in how assessment training programs were carried out in the past decades. PRISMA model was used for identifying, screening, and selecting. Twenty-eight studies published between 2012 and 2022 were reviewed. The results reveal that the assessment training models comprised theoretical and practical components of language assessments. The results also show that the methods for delivering the content are collaborative and reflective practices. The findings of this study should be considered in the design of EFL teacher training programs on assessment.

Writing is hard for students who are learning English; they often find it challenging to transform what is on their mind in writing. Therefore, this study examined the relationship between the writing test and assessment writing through argumentative writing. Data was analyzed using the correlation test to determine the close relationship between independent and dependent variables. This study involved 100 students from the Department of English Education at the University of Riau, Indonesia. The results showed that the writing test and assessment writing was closely related, as evidenced by the influence and significance between the writing test and assessment writing, which was tested through argumentative writing. The results revealed that the writing test and assessment writing have similar results. Overall, both variables are equally important and related.

We examined how Learning Analytics literature represents participants from diverse societies by comparing the studies published with samples from WEIRD (Western, Industrialized, Rich, Democratic) nations versus non-WEIRD nations. By analyzing the Learning Analytics studies published during 2015-2019 (N = 360), we found that most of the studies were on WEIRD samples, with at least 58 percent of the total studies on WEIRD samples. Through keyword analysis, we found that the studies on WEIRD samples' research topics focused on self-regulated learning and feedback received in learning environments. The studies on non-WEIRD samples focused on the collaborative and social nature of learning. Our investigation of the analysis tools used for the studies suggested the limitations of some software in analyzing languages in diverse countries. Our analysis of theoretical frameworks revealed that most studies on both WEIRD and non-WEIRD samples did not identify a theoretical framework. The studies on WEIRD and non-WEIRD samples convey the similarities of Learning Analytics and Educational Data Mining. We conclude by discussing the importance of integrating multifaceted elements of the participant samples, including cultural values, societal values, and geographic areas, and present recommendations on ways to promote inclusion and diversity in Learning Analytics research.

Background: Mid-semester evaluations are gaining traction as a means to gather evaluation data for formative purposes. However, it is not clear if course coordinators who conduct these evaluations are adequately equipped with evaluative knowledge and skills to guide them through their evaluative processes. Objectives: This study is a meta-evaluation of course coordinators' mid-semester evaluative practices in a Higher Education institution language centre and the extent to which their evaluative practices are attuned to RUFDATA for its preparatory design framework in the evaluative process and Utilization-Focused Evaluation (UFE) for its sets of principles with regards to uses and users and how these impact on the design and use of the evaluation. Research design & subjects: Data was gathered using meta evaluative mixed methods from three groups of participants consisting of course coordinators, academics who taught on their courses and their learners. Results: The results imply that whilst most course coordinators who participated in the study conducted mid-semester evaluations and that their evaluative practices contained some elements from the frameworks, it is problematic to align their evaluative practices and processes against these tools due to the challenges that they encountered in their evaluative processes. Conclusions: As important agents of evaluations in mid semester evaluations, it should be noted that course coordinators are not trained evaluators and conducting evaluations does not constitute a major component of their professional duties and roles. This study has implications for higher education policies and practices, commissioners, and users of evaluations.

Purpose: This study introduces a policy with great strategic significance and far-reaching impact by analyzing the background, measures, and future development trends of teacher evaluation reform in China. Design/Approach/Methods: This study primarily conducts a policy text analysis of the section on teacher evaluation of the "Overall Plan for Deepening the Reform of Educational Evaluation in the New Era". Findings: The "Overall Plan for Deepening the Reform of Educational Evaluation in the New Era" was drafted to enhance the quality of Chinese teachers and address many problems in teacher evaluation. It comprised four sections: teachers' professional ethics, teaching effectiveness, evaluation models and methods, and honorary titles. The policy has distinctive features such as the high status and authority of the issuing body, a holistic and systematic nature, and an orientation toward practical issues. This article proposes three major policy foresights: promoting implementation through the force of political trends, giving schools autonomy in teacher evaluations, and implementing progressive reforms. Originality/Value: This study conducted a specialist analysis of the policy in combination with the real scenario and institutional environment of Chinese teacher evaluation, which could encourage international peers to better understand Chinese teacher evaluation policies and promote policy learning and dissemination internationally.

There has been an increasing demand for healthcare analytics skills and competence by healthcare organizations. Although many universities have established programs and courses on healthcare analytics, most of these curricula have been designed for information systems (IS), information technology (IT), or analytics students. It is unclear how these curricula would fit the needs of healthcare professionals who have little IT knowledge and background yet also need analytics for their clinical or administrative job roles. This research reports on the design of an executive MBA course intended for an audience of healthcare professionals. The learning objectives, topic coverage, software tools, and assessment methods are presented along with students' perceptions of these aspects of the course. Several important lessons learned are shared and future directions are proposed, which can help other educators design similar healthcare analytics courses for professional audiences.

Prospective graduate students' noncognitive attributes are commonly evaluated as a part of a holistic review of their admission applications. Yet it is difficult to determine which noncognitive attributes are considered by those who evaluate graduate admissions applications and what approaches they take to measure applicants' noncognitive attributes. It is even less clear to what degree prospective graduate students understand how they are evaluated for graduate admissions and how the evaluation of their noncognitive attributes factor into admissions decisions. Drawing on surveys of graduate enrollment management (GEM) professionals and prospective graduate students in the United States, our study investigated the noncognitive attributes prospective graduate students and GEM professionals deem important to success in graduate school and the application components each group believes demonstrate those attributes. Results suggest that some alignment exists between the perspectives of prospective graduate students and GEM professionals on the noncognitive attributes most important for completing a graduate program of study. We share recommendations for improving the agreement between prospective graduate students and GEM professionals including the need for more explicit and transparent communication about how graduate admissions applications are evaluated, which is of particular importance as admissions processes forgo the consideration of applicants' race.

Assessment is an important component of learning which aims to determine student achievement in learning. However, the pandemic has changed how assessment is carried out, prompting teachers to look for new strategies in carrying out mathematics learning assessments under any conditions, whether in normal conditions or during a pandemic. This study described the strategies used by high school mathematics teachers in assessing mathematics learning during the pandemic towards the post-pandemic period. This type of research is descriptive exploratory research with a qualitative approach. The subjects in this study were three mathematics teachers, three principals, and three vice principals from a public senior high school in Yogyakarta City, Indonesia. Qualitative data were collected by means of questionnaires, interviews, and documentation. The collected data were analyzed qualitatively according to Bogdan and Biklen. The results of the study reveal that the mathematics teacher's strategy for carrying out assessments during a pandemic includes: i) determining the appropriate online assessment platform that suits the needs; ii) assessment based on student participation; iii) using various of online assessment methods; iv) prioritizing academic integrity and honesty in the assessment implementation; and v) carry out the management and reporting of data on the results of the assessment in accordance with established procedures.

Aware of the various issues involved in assessing learning, but also of the difficulties encountered in classroom practice of this pedagogical act, we set out in this article to explore and analyze the assessment practices of secondary school mathematics teachers and the conceptions they underlie. The study was conducted from a systemic perspective. We therefore targeted three aspects in our study: the conceptual, the institutional, and the docimological. Analysis of the attitudes declared by a random sample of mathematics teachers enabled us to confirm that pedagogical, and in particular cognitive, issues do not represent a priority for them in assessment practices. They focus more on the organizational aspect of examinations, with a remarkable lack of concern for docimological considerations to give credibility to the assessments carried out.

Adaptive online learning can be realized through the evaluation of the learning process. Monitoring and supervising learners' cognitive levels and adjusting learning strategies can increasingly improve the quality of online learning. This analysis is made possible by real-time measurement of learners' cognitive levels during the online learning process. However, most of the currently used techniques for evaluating cognitive levels rely on labour-intensive and time-consuming manual coding. In this study, we explore the machine learning (ML) algorithms and taxonomy of Bloom's cognitive levels to explore features that affect learner's cognitive level in online assessments and the ability to automatically predict learner's cognitive level and thus, come up with a recommendation or pedagogical intervention to improve learner's acquisition. The analysis of 15,182 learners' assessments of a specific learning concept affirms the effectiveness of our approach. We attain an accuracy of 82.21% using ML algorithms. These results are very encouraging and have implications for how automated cognitive-level analysis tools for online learning will be developed in the future.

This study aims to evaluate the online measurement and evaluation course in teacher training programs during the COVID-19 process. In the study, we sought answers to two primary research questions: What are the opinions of teachers and school administrators regarding their measurement and evaluation competencies? Does the online "measurement and evaluation" course have the qualities of an effective program in the "antecedents, transactions, and outcomes" dimension? We structured the research into two phases within a multistage evaluation design framework. The findings show that there were problems and positive aspects in all dimensions of the program. For example, adapting teacher training programs developed before COVID-19 to distance education processes was challenging. In distance education, some practices contradict the modern teaching and assessment approach. Such problems were reflected in teachers' acquisition of measurement and evaluation competencies. The achievement test we applied to the observed groups also confirmed these findings. For this reason, responsible organizations should not ignore the fact that we cannot renounce distance education. During program development, they should reconsider how the teachers will acquire measurement and evaluation competencies and how we will measure and evaluate in distance education.

The importance of enhancing social and emotional skills in educational settings has gained prominence, with many countries and organizations embracing the Social and Emotional Learning (SEL) framework to equip individuals with the tools needed for shaping a self-identity, emotional regulation, goal achievement, empathy, nurturing relationships, and responsible decision-making and overall well-being. In this paper, we aim to connect the globally acknowledged Collaborative for Academic, Social, and Emotional Learning SEL framework with international policies that underscore the importance of social and emotional skills in the school context. To accomplish this goal, we first provide a brief overview of the key components of the SEL framework. Subsequently, we explore two significant educational policies within the European context. The first policy is the World Health Organization Health Promoting Schools initiative. We present its objectives, a WHO-affiliated program example, the promoted and assessed competencies of students, and its results, connecting its framework with the CASEL SEL approach. The second focus is the Organisation for Economic Co-operation and Development Study on Social and Emotional Skills, describing its developmental process and the assessment framework. Finally, we describe the alignment of SEL with these European educational policies and illustrate their role in advancing and improving the evaluation of SEL initiatives in educational environments.

Increasing community awareness and knowledge about environmental problems is the primary goal of environmental education. This study explores the best practices of the Youth for Environment in Schools--Organization (YES-O) in selected schools in the National Capital Region, Philippines. A qualitative study involving interviews and focus group discussions directed the collection and analysis of data. The study discovered that the implementation of the YES-O program was successful due to the following best practices: (a) personal advocacy, (b) resource availability, (c) flexibility, (d) integrated school efforts, (e) participatory approach, and (f) monitoring and evaluation strategies, which were all supported by the emerging themes. Meanwhile, capacity building and strong networks emerged as important themes supporting the YES-O program implementation in secondary schools. The schools can continue their practices to sustain the implementation of the program. However, schools should take into account certain indicators that require improvement to enhance their performance. These may include strengthening their networking, linkages, and partnership strategies to better engage and synergize environmental education given the mandated programs, projects, and activities of the YES-O program implementation.

As universities shifted to online education with the onset of the Coronavirus Disease 2019 (COVID-19) pandemic, both pedagogy and assessment patterns across disciplines underwent a change, with a shift towards collaborative digital assessments. In this context, using qualitative and quantitative methods for data collection from an assessment conducted for 55 students who worked in groups to create YouTube videos on pre-selected modules, our analysis reveals that this assessment tool had a significant impact on peer learning, motivation and group dynamics. Students were more motivated to learn and share their learning, and they could also successfully engage in recognising and addressing group dynamics, thereby cultivating more than just subject knowledge. This finding aligns with existing scholarship and the paper adds to research about pedagogy and assessment via digital education in the Indian context, which is still upcoming.

The teaching of English First Additional Language (EFAL) in South Africa is gradually changing from the traditional style because of the devastating effects of the COVID-19 pandemic. Efforts are being made to stimulate learners' interest in learning which include using information communication technology (ICT) in the form of e-learning to enhance understanding. The outbreak of the coronavirus disease (COVID-19) was a major challenge as it compelled teachers to engage in online teaching -- even those who were never trained in the use of technology. A qualitative research method in the form of semi-structured interviews was used to collect data from 15 EFAL teachers who were purposefully selected on the basis that they used e-learning to supplement their face-to-face teaching. I found that the integration of e-learning to the traditional physical contact style was essential in improving the teaching of EFAL. The majority of participants, however, highlighted that they still encountered challenges related to heavy workload and efforts to complete items listed in the work programme. Inadequate training of teachers on e-learning, a lack of resources and poor connectivity also acted as barriers to the full implementation of blended learning, which considerably improves learners' performance.

This paper reviews 38 studies conducted between 2015 and 2022 on collaborative assessments in open-distance and e-learning (ODeL) contexts, focusing on the benefits, types, challenges, and strategies to improve collaborative assessments. This qualitative review aims to investigate collaborative assessments within the ODeL comprehensively. The objectives encompass thoroughly exploring theoretical foundations and empirical evidence to illuminate the pedagogical implications and effectiveness of collaborative assessment methodologies. Employing a systematic literature review approach, various scholarly articles, research papers, and educational studies were scrutinised to synthesise the current landscape. The review shows that effective communication, feedback, and appropriate technology are critical factors in promoting successful collaborative assessments, which can result in improved engagement, motivation, and better learning outcomes. However, challenges such as scheduling difficulties, technology challenges, group dynamics, and assessment quality may arise. Using social constructivism, this paper addresses criticisms of collaborative assessment in the ODeL context, identifies types of collaborative assessments, and presents strategies for implementation and addressing challenges. Based on these findings, recommendations are presented to educators, urging the integration of collaborative assessment methods into open distance and e-learning frameworks, accompanied by pedagogical support and training to optimise their efficacy and promote enriched learning experiences. The paper concludes by suggesting future research areas and recommendations for educators and instructional designers seeking to implement collaborative assessments in ODeL environments. Collaborative assessments can contribute to collaborative learning, providing students with a sense of community, engagement, and responsibility. [This paper was presented at the International Conference on Educational Technology and Online Learning held on 23-26 June 2022 at Ören, Burhaniye, Turkey.]

Teachers perceive student engagement in many ways, and do not necessarily align engagement strategies they employ with their own conceptualization of this construct. This situation is worsened in online learning of which popularity has grown since the emergence of the COVID-19 global pandemic. We explored perceptions of student engagement in online learning, both synchronous and asynchronous, using semi-structured in-depth interviews with K-12 teachers (N=13). We referred to different dimensions (behavioral, emotional, social, and cognitive) and contexts (student, peers, class, school, and home). Findings suggest that student engagement in online learning has unique characteristics: It is mostly behavioral, particularly task-centered; it relates to student-, class-, and home contexts; and teachers take responsibility on- and act upon issues related to it.

A computer science camp for pre-collegiate students was operated during the summers of 2022 and 2023. The effect the camp had on attitudes was quantitatively assessed using a survey instrument. However, enrollment at the summer camp was small, which meant the well-known Pearson's Chi-Squared to measure the significance of results was not applied. Thus, a quantitative analysis method using a multinomial probability distribution as a model of a multilevel Likert scale survey was used. Exact calculations of a multinomial probability model with likelihood ratio were performed to quantitatively analyze the results of questionnaires administered to participants in two cohort groups (combined N=17). Probabilities per Likert categories were determined from the data itself using Bayes theorem with a Dirichlet prior. Each cohort functioned as part of a homogenous sample, thus allowing cohorts to be pooled. Post-test revealed significant changes in participants' attitudes after camp completion. Using this technique has implications for studies with small sample sizes. Using exact calculation of the multinomial probability model with the use of likelihood ratio as a statistical test of evidence has advantages: a) it is an exact value that can be used on any size sample, although it offers a quantitative analysis option for small sample size studies; b) depends only on what was observed during a study; c) does not require advanced calculation; d) modern spreadsheet and statistical package programs can calculate the analysis; and e) likelihood ratio employed in Bayes theorem can update prior beliefs according to evidence. Utilizing small sample size quantitative analysis can strengthen insights into data trends and showcase the importance of this quantitative technique.

Background: Formative assessment is an essential element for improving teaching and learning in the classroom. During the COVID-19 pandemic and national lockdown, educators were confronted with the need to adapt to online assessment. South African educators also experienced challenges that made online formative assessment difficult. Aim: This study explores the experiences of intermediate-phase educators using online tools to enact formative assessment in the teaching and learning of social sciences. This research included a narrow spectrum of socioeconomically diverse schools. Setting: Data were obtained through interviews with a sample of six diverse intermediate-phase educators teaching social sciences from one district in the Gauteng North province. Methods: This research adopted a generic qualitative approach. Themes were derived from the data and five subthemes were identified to report the findings. Results: The results of this study identified factors that prevented the implementation of online formative assessment in the intermediate phase. The data also identified online tools that educators used for online assessment in their classrooms and some barriers. These barriers hindered the participants' ability to provide an interactive and stimulating learning experience for their students. Conclusion: Despite challenges, which included a lack of training and support, as well a lack of trust in their abilities, the participants demonstrated a willingness to incorporate technology in their teaching and assessment. The study highlights the need for ongoing professional development and improved infrastructure and accessibility to support the use of information and communications technology (ICT) in education. Contribution: Based on educators' perceived willingness to make use of ICTs for formative assessments, and their ability to even identify some useful tools themselves, findings contribute to the field of policy implementation related to teaching with technology at this level.

Nearly all multidimensional models of communication competence have pragmatic competence at their core. Proper assessment of second language (L2) pragmatics makes many demands on L2 teachers, both in terms of understanding the construct and in language test development. Therefore, being assessment literate helps teachers in developing effective tests geared toward educational outcomes. Despite the importance of assessment literacy (AL) for pragmatics, the field is still under-researched. Mindful of this fact and the significance of pragmatics in L2 learning and assessment, this study adopted the Common European Framework of Reference (CEFR) model of pragmatic competence to examine Iranian L2 teachers' AL for L2 pragmatics and linked the results to the Sociocultural Theory (SCT) for formulating theory-informed answers to the problems in the teachers' assessment of L2 pragmatics. Group interviews were run with 67 participants and then qualitative and quantitative content analyses were performed. The paper discusses the identified problems in the assessment of L2 pragmatics and offers recommendations for raising L2 teachers' AL for L2 pragmatics.

The main objective of this study is to revise and validate the assessment of self-presentation skills of middle school students. The assessment is based on existing self-assessment scales and adaptively modified for a more accurate assessment of middle school students' self-presentation skills. Considering the characteristics of middle school students and teachers' assessment, we have reconstructed and adjusted the dimensions of the original assessment. This paper includes background research, scale design and innovation, scale testing, and scale reliability and multiple validity verification. In order to further verify the effectiveness and reliability of the tool, this study added the application of content validity and factor analysis on the basis of previous studies. The results of this study are intended to compensate for the limitations of current teacher assessment for middle school students' self-presentation. At the same time, this study also provides a basis for the development of middle school students' self-presentation skills integrated training programs.

Interweaving my thinking with childhood stories of schooling, familial narratives, and experiences as a teacher alongside children, this article makes visible how my pedagogical approaches and desires for children to experience belonging shape my intentional work to recraft marginalizing curricula and assessment practices. In sharing my learning, unlearning, and continued growth, I endeavor to prompt a rethinking of how we, pre-service teachers, fellow educators, and school leaders, support children's life-making and wellbeing on school landscapes and offer approaches for all children to be centered as knowledge holders.

Pedagogy and assessment practices have always been the two pertinent domains of the EFL world, and there is a voice, which supports swapping the attention from teacher-centered to student-centered. Studies are available to research the two practices separately but researching them, with the view that they complement each other, as an integrated approach seems to be very limited, especially in Najran University context. Therefore, this study aims to explore learners' perceptions of teachers' employment for the practices focused on student-centered pedagogy and assessment in the EFL classroom. In addition, it correlates the participants' responses with their gender and specialization. The survey-descriptive approach was used to achieve the study objectives. The study tools, a questionnaire and a semi-structured interview were applied to a stratified sample of 200 participants. The results show that the study sample medially perceived the teacher's employment of pedagogy practices focused on students. The assessment practices focused on students were highly perceived by the respondents. Moreover, the variables of gender and specialization did not have any influence on the respondents' answers to the questionnaire. Finally, the content analysis of the semi-structured interview reveals that the majority of the interviewees approved that student-centered pedagogy and assessment practices play a positive role in improving their classroom efficacy. In light of the current results, recommendations and implications are suggested.

This research investigates impediments to the successful implementation of Communicative Language Teaching (CLT) in Saudi English as a Foreign Language (EFL) classrooms. Going beyond typical discussions on teacher training and curriculum development, the study explores entrenched resistance stemming from traditional teaching methods among teachers and students. The examination system, emphasizing rote memorization and grammar, poses a significant obstacle to CLT's communicative goals. Sociocultural factors, including a conservative view of education and perceived threats to Arabic identity through English acquisition, contribute to the resistance. Conclusively, the research highlights the interconnectedness of these challenges, proposing that transforming English assessment methods could gradually reshape student perspectives and boost motivation for communicative language acquisition. The study advocates pragmatic solutions such as curriculum adjustments aligned with cultural norms, comprehensive teacher training, and adaptations to the testing system to evaluate real-life language use. These strategies aim to cultivate an environment conducive to CLT adoption in Saudi EFL classrooms, moving beyond theoretical considerations to actionable steps. The research underscores the need for ongoing exploration through future studies, assessing the long-term impact of these strategies on learner attitudes and language acquisition outcomes. It emphasizes a sustained commitment to refining language education practices in Saudi EFL contexts and beyond.

In the evaluative phase concerning the practicality of language acquisition, the Communicative Language Teaching (CLT) methodology has emerged as the preeminent standard in educational paradigms. Nevertheless, the import of integrating CLT becomes particularly salient within the framework of language adoption as a medium of communication. The application of a communicative approach to the learning and evaluation of English, specifically for young English as a Foreign Language (EFL) students, confronts distinct challenges. These challenges, if not effectively navigated, present a potential hazard to the realization of desired educational outcomes and have the capacity to hinder academic performance. Consequently, this undermines the efficacy of the approach vis-à-vis its envisioned impact. In light of this, the present study endeavors to scrutinize prospective challenges that may exert an adverse influence on communicative language assessment in the context of young EFL learners. Moreover, the study seeks to proffer viable solutions to mitigate these challenges based on empirical findings. The primary objective of this research is to engender awareness regarding the inherent difficulties associated with the implementation of the communicative approach. The research further furnishes actionable and efficacious measures conducive to both EFL education and the overall learning experience of young students. A pivotal aspect for the proficient application of the communicative approach as an assessment technique for young learners lies in the meticulous execution of assessment tasks.

This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential. This investigation involved a rigorous process including expert involvement to ensure content validity, as well as the application of statistical tests for assessing internal consistency and reliability. Factor analysis also revealed two significant domains, "Quality of Content" and "Quality of Expression", which further enhanced the construct validity of the evaluation scale. The results from this investigation robustly affirm the reliability and validity of the developed rubric, thus marking a significant advancement in the sphere of AI chatbot performance evaluation within educational contexts. Nonetheless, the study simultaneously emphasizes the requirement for additional validation research, specifically those entailing a variety of tasks and diverse AI chatbots, to further corroborate these findings. The ramifications of this research are profound, offering both researchers and practitioners engaged in chatbot development and evaluation a comprehensive and validated framework for the assessment of chatbot performance.

Emerging technologies are transforming educational practices, but successful integration requires improving the quality and efficiency of learning. New technology emerges in hype cycles but adoption and performance lag over time. A strategy development framework is needed for decision-makers to understand the complex interaction of all the factors to consider when making new technology investments. The research explores how strategy development occurs through the dynamic interaction of strategy with learning, and technology integration. It analyses the key elements of a strategy map for learning with technology and how they influence each other within the overall strategy map. The research design integrated the different cycles of Design Science Research (DSR) with a modified Delphi Technique in two phases of research. During the first research phase, Delphi panel members were interviewed to understand current challenges and practices in learning with technology. The results of the literature review and thematic data analysis from the interviews were used to create a hypothetical strategy map and a strategy development framework, as an artefact, as part of the DSR process. This framework was shared with Delphi members in the second phase of research, and they were requested to evaluate the framework for its fit and utility in similar contexts of learning with technology. The feedback contributed to the refinement of the artefact and highlighted the key operational focus areas for learning with technology. The key operational focus areas identified were the need to increase the basic technology literacy of students and educators, continuous professional development in terms of online pedagogy, and the need for principles in terms of multimedia design. Other focus areas were an online design blueprint and an improvement in learning and teaching experiences through efficiencies and productivity of ed-tech technologies. This study contributes a strategy development framework for educational technology which enhances theories around the analytical and conceptual processes when planning and implementing new emerging technologies in learning. Analytical processes include external and internal analysis and a SWOT analysis of aspects related to learning with technology. Other key outcomes of the study include a hypothetical strategy map for learning with technology which aligns business objectives to a financial, customer, internal business process and learning and growth perspective.

Validation is needed for any newly developed model or framework because it requires several real-life applications. The investment made into e-learning in medical education is daunting, as is the expectation for a positive return on investment. The medical education domain requires data-wise implementation of e-learning as the debate continues about the fitness of e-learning in medical education. The domain seldom employs frameworks or models to evaluate students' performance in e-learning contexts. However, when utilized, the Kirkpatrick evaluation model is a common choice. This model has faced significant criticism for its failure to incorporate constructs that assess technology and its influence on learning. This paper aims to assess the efficiency of a model developed to determine the effectiveness of e-learning in medical education, specifically targeting student performance. The model was validated through Delphi-based Expert Judgement Techniques (EJT), and Cronbach's alpha was used to determine the reliability of the proposed model. Simple Correspondence Analysis (SCA) was used to measure if stability is reached among experts. Fourteen experts, professors, senior lecturers, and researchers with an average of 12 years of experience in designing and evaluating students' performance in e-learning in medical education participated in the evaluation of the model based on two rounds of questionnaires developed to operationalize the constructs of the model. During the first round, the model had 64% agreement from all experts; however, 100% agreement was achieved after the second round, with all statements achieving an average of 52% strong agreement and 48% agreement from all 14 experts; the evaluation dimension had the most substantial agreements, next to the design dimension. The results suggest that the model is valid and may be applied as Key Performance Metrics when designing and evaluating e-learning courses in medical education.

Student success is increasingly tied to equity-minded policies and practices that ameliorate postsecondary achievement gaps. Educational disruptions over the past few years continue to reshape the education landscape and have continued to illuminate racial and socioeconomic inequities at higher education institutions, deepening the digital divide and diminishing persistence rates. As calls for "success for all" echo across college and university campuses nationally, many institutions are focused on increasing student completion through improved onboarding, credentialling and degree pathways, and advising, all of which is grounded in student-focused teaching, learning, support, and assessment. Ensuring equitable student success becomes, therefore, a central focus of education at all levels, particularly in terms of uncovering ways to support students from racial and ethnic minority backgrounds and socioeconomically underserved populations. This endeavor is crucial if we are to address the needs of today's ever-evolving and increasingly diversified student populations. Transformation is best supported by starting with a universally understood student-centered mission that determines the creation of a student experience with equitable outcomes and educational value. How success is defined impacts policies and practices, and ultimately affects student outcomes. Student success can be defined as a "holistic phenomenon" that embraces the multiple dimensions of personal development in tandem with the multiple goals of higher education. Identifying the central principles or critical features of learning experiences that are most likely to embrace and implement a comprehensive definition of "equitable student success" can move higher education closer to realizing its intended outcomes.

Although graduate academic institutions implement diverse annual review processes, their overall intent is focused on ensuring continuous improvement of program quality (National Institute for Learning Outcomes Assessment, 2020). Through program review processes, university leaders (e.g., department chairs, program leads) analyze student performance and department procedures to inform future actions and policies. This mixed-methods case study examined an online campus's program review structure. Specifically, a description of how administrative faculty (i.e., department chairs and associate department chairs) reported their program's strengths, challenges, and future directions and the collaborative scholarly interactions that resulted from these sessions are discussed. Findings from all study participants revealed that administrative faculty perceived program review processes as beneficial and provided a unique opportunity for collaboration across diverse university programs.

In Vietnam's 2018 Literacy Education Curriculum Guideline, creative writing is a new requirement, emphasized for its goals of developing primary students' language competencies, critical thinking, and problem-solving. This new requirement offers teachers an opportunity to help students enhance their writing competencies and presents a challenge, as it requires them to have specific competencies, professional development, and specific guidelines. When it comes to the current situation of creative writing instruction in primary schools, it has many limitations and requires improvement. While instructional materials significantly influence teachers' instruction by establishing suitable educational objectives, methodologies, and contents, the coverage of contents on creative writing instruction in some reference materials is very limited, leading to confusion among teachers and ineffective practices in actual classrooms. Therefore, an in-depth analysis of some key reference documents is crucial to come up with suggestions to improve the quality of creative writing instruction in primary schools, which is the focus of this study. The findings revealed some problems with possible suggestions for the four following issues: (1) approaches for creative writing for primary students, (2) approaches for assessing students' creative writing competencies, (3) time allocation for creative writing instruction, and (4) contents on creative writing instruction in Vietnamese Textbooks.

This research reports the implementation of an evaluation instrument of the slope concept in high school students. The design of this study was based on four dimensions: Skills, Properties, Uses and Representations (SPUR model; Thompson & Kaur, 2011) and on three conceptualizations: constant ratio, behavior indicator and trigonometric conception. This work adopts a qualitative approach to analyze the students' productions and a quantitative approach when obtaining the percentages of the student's responses. The general objective of the work is to evaluate the effect produced by a group of tasks designed with the SPUR model on the slope concept in high school students. The results show that students have traditional conceptualizations of the slope as a constant ratio and trigonometric conception. However, these conceptualizations emphasize more procedural aspects than conceptual ones. This finding could partially explain why students can solve certain tasks of procedural nature but not conceptual tasks that usually require a multifaceted view of the slope.

Post-secondary institutions are required to complete a variety of quality assurance activities including external program review, a process of inviting external reviewers from outside the institution to provide constructive feedback on all aspects of an academic program. While external program reviews have been completed for decades, there has been little work to ensure that meaningful change occurs as a result. Assessment of outcomes at the department level are limited and research specifically considering external academic program review as a primary quality assurance activity is scant. Each of these limitations is even more significant when considered at the institutional level. From our experience, there is minimal consideration in research or practice to ensure that external review recommendations have an impact on educational planning at the institutional level. To help address this concern, in this paper we describe an approach involving secondary research and thematic document analysis that can be leveraged to enhance institutional decision-making processes by uncovering institutional themes evident across external reviews. We suggest that our approach may be helpful for other higher education institutions striving to make sense of program review recommendations from an institutional perspective.

There is a current debate about the extent to which ChatGPT, a natural language AI chatbot, can disrupt processes in higher education settings. The chatbot is capable of not only answering queries in a human-like way within seconds but can also provide long tracts of texts which can be in the form of essays, emails, and coding. In this study, in the context of higher education settings, by adopting an experimental design approach, we applied ChatGPT-3 to a traditional form of assessment to determine its capabilities and limitations. Specifically, we tested its ability to produce an essay on a topic of our choice, created a rubric, and assessed the produced work in accordance with the designed rubric. We then evaluated the chatbot's work by assessing ChatGPT's application of its rubric according to a modified version of Paul's (2005) Intellectual Standards rubric. Using Christensen et al.'s (2015) framework on disruptive innovations, our study found that ChatGPT was capable of completing the set tasks competently, quickly, and easily, like a "magic wand". However, our findings also challenge the extent to which all of the ChatGPT's demonstrated capabilities can disrupt this traditional form of assessment, given that there are aspects of its construction and evaluation that the technology is not yet able to replicate as a human expert would. These limitations of the chatbot can provide us with an opportunity for addressing vulnerabilities in traditional forms of assessment in higher education that are subject to academic integrity issues posed by this form of AI. We conclude the article with implications for teachers and higher education institutions by urging them to reconsider and revisit their practices when it comes to assessment.

The study aims to assess online assessment practices in a public university, addressing questions about self-efficacy levels, tools used, challenges faced, and proposed solutions. The chosen methodology employs a cross-sectional survey design, collecting both quantitative and qualitative data from 50 instructors in Türkiye through a convenience sampling method. Results indicate a moderate level of self-efficacy among participants, with challenges identified in monitoring student progress objectively and incorporating alternative assessment techniques. The study highlights a preference for summative assessments, particularly assignments, projects, and quizzes. Discussions and e-portfolios are less favored. The instructors addressing challenges in online assessment employ various precautions across assessment tools, processes, assessors, and the Learning Management System (Canvas). The strategies include enhancing question quality, favoring higher-order thinking skills, utilizing diverse assessment tools, and implementing precautions like item banks. During the assessment process, precautions involve considerations for exam duration, informing students, and encouraging professional development. In the Learning Management System, instructors rearrange options, enforce single answers, and seek assistance for technical challenges. To ensure internal validity, teachers have opted for measures to prepare questions according to lesson achievements, improve communication with students, and use different measurement tools. Findings resonate with the Technological Pedagogical Content Knowledge (TPACK) model, showcasing the integration of technological, pedagogical, and content knowledge to enhance online assessments' reliability and validity. The findings suggest a need for professional development to enhance instructors' competencies in addressing challenges and promoting a more balanced use of assessment methods in online education.

This study conducts a bibliometric analysis to map the research trends and intellectual landscape surrounding the development of scientific literacy assessments in educational contexts from 2019 to 2023. Scientific literacy, which encompasses the ability to comprehend, evaluate, and apply scientific knowledge, has emerged as a crucial competency in science education. However, existing assessment tools often prioritize factual recall over deeper conceptual understanding and critical thinking abilities. To address this gap, there is a need for innovative assessment approaches that holistically evaluate students' scientific literacy across multiple dimensions. Through a systematic analysis of 185 relevant publications from the Scopus database, this study investigates the numerical distribution of literature by year, document type, journal, author, institution, and country. Additionally, it explores the prominent themes, evolving topic trends, and emerging clusters within the scientific literacy assessment research domain. Bibliometric techniques, including citation analysis, coauthorship networks, and keyword co-occurrence mapping, are employed to provide a comprehensive perspective. The findings reveal a steady increase in publications focused on scientific literacy assessments, reflecting the growing recognition of this research area. The analysis identifies highly influential journals, articles, authors, and institutions actively shaping the field. Furthermore, it highlights key research themes, such as secondary education, teacher professional development, and information literacy. However, the integration of scientific literacy assessments with artificial intelligence remains an underexplored area, presenting opportunities for future research.