Search

Abstract Adsorption-based direct air carbon capture and storage (DACCS) is an emerging approach to mitigate climate change by removing CO2 from the atmosphere. Recent studies show separately that thermodynamic and environmental performance strongly depend on regional ambient conditions and energy supply but neglect regional CO2 storage potentials. To assess DACCS performance holistically, a detailed global analysis is needed that accounts for the interplay of regional ambient conditions, energy supply, and CO2 storage potential. Hence, we present a novel method for the optimal siting of DACCS plants derived from optimising a dynamic process model that uses global hourly weather data and regionalised data on electricity supply and CO2 storage potential. The carbon removal rate (CRR) measures the climate benefit and describes the speed at which a DACCS plant generates net negative emissions. First, we assume that CO2 storage is possible everywhere. For four electricity supply scenarios, we show that the optimal siting of DACCS significantly increases the CRR when comparing the best and worst locations in each scenario: For a DACCS plant with a nameplate capture capacity of 4 kt CO2 y−1, the CRR can be increased by 63% from 2.16 to 3.53 kt CO2 y‑1 when using photovoltaic, and by 39% from 2.95 to 4.1 kt CO2 y‑1 when using wind power. Assuming a carbon-free electricity supply, the CRR varies between 3.17 and 4.17 kt CO2 y‑1 (32%). Second, we significantly narrow down optimal locations for DACCS considering regional CO2 storage potential through CO2 mineralisation. Overall, accounting for the interplay of regional DAC performance, energy supply, and CO2 storage potential can significantly improve DACCS siting.

Abstract The urgency to restore landscapes to counteract deforestation, soil degradation, and biodiversity loss has resulted in a global commitment to landscape restoration. Many frameworks and tools have emerged for the design and implementation of restoration activities. The frameworks tend to focus on selected dimensions of sustainability, with the majority focusing on the ecological. Current frameworks miss a balanced assessment of (planned) interventions taking into account also the social dimension relating to participation and ownership as well as improvement of livelihoods. The objective of this review is to assess current frameworks for identification of strength and weaknesses and to derive an integrated Forest Landscape Restoration (FLR) assessment framework model that shall help overcome current limitations. Applying systematic literature review, a total of 22 frameworks are selected and analyzed in-depth applying qualitative content analysis. Our review finds that frameworks vary with respect to their focus and restoration objectives. They also differ in relation to spatial and temporal scale, degree of stakeholder participation, consideration of ecological and social dimensions, monitoring and evaluation approaches, as well as provisions for exit strategies. Findings are summarized in form of an integrated FLR assessment framework, comprising six interlinked components: stakeholder participation, customization, time and scale of application, social-ecological balance, monitoring, evaluation and learning, and exit strategy. The proposed framework facilitates design and implementation of context specific interventions, balancing the nexus of social and ecological dimensions of FLR and acknowledges the need to also include reflection on learnings and planning of an exit strategy for long-term success. Graphical Abstract

Abstract Background The first crucial step towards military hospitals performance improvement is to develop a local and scientific tool to assess quality and safety based on the context and aims of military hospitals. This study introduces a Quality and Safety Assessment Framework (Q&SAF) for Iran’s military hospitals. Methods This is a literature review which continued with a qualitative study. The Q&SAF for Iran’s military hospitals was developed initially, through a review of the WHO’s framework for hospital performance, literature review (other related framework), review of military hospital-related local documents, consultations with a national and sub-national expert. Finally, the Delphi technique used to finalize the framework. Results Based on the literature review results; 13 hospital Q&SAF were identified. After reviewing literature review results and expert opinions; Iran’s military hospitals Q&SAF was developed with 58 indictors in five dimensions including clinical effectiveness, safety, efficiency, patient-centeredness, and Responsive Management (Command and Control). The efficiency dimension had the highest number of indictors (19 indictors), whereas the patient-centered dimension had the lowest number of indices (4 indictors). Conclusion Regarding the comprehensiveness of the developed assessment framework due to its focus on the majority of quality dimensions and important components of the hospital’s performance, it can be used as a useful tool for assessing and continuously improving the quality of hospitals, particularly military hospitals.

Abstract Detecting digital face manipulation in images and video has attracted extensive attention due to the potential risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have been employed and have exhibited remarkable performance. However, the performance of such detectors is often assessed on related benchmarks that hardly reflect real-world situations. For example, the impact of various image and video processing operations and typical workflow distortions on detection accuracy has not been systematically measured. In this paper, a more reliable assessment framework is proposed to evaluate the performance of learning-based deepfake detectors in more realistic settings. To the best of our acknowledgment, it is the first systematic assessment approach for deepfake detectors that not only reports the general performance under real-world conditions but also quantitatively measures their robustness toward different processing operations. To demonstrate the effectiveness and usage of the framework, extensive experiments and detailed analysis of four popular deepfake detection methods are further presented in this paper. In addition, a stochastic degradation-based data augmentation method driven by realistic processing operations is designed, which significantly improves the robustness of deepfake detectors.

This paper focuses on the evaluation of the operational effect of a pumped storage plant in a new power system. An evaluation index system is established by selecting key indicators from the four benefit dimensions of system economy, low carbon, flexibility, and reliability. The evaluation criteria are based on the values of indexes for pumped storage plants that have already been put into operation. Using this method, the operational effect of pumped storage plants with different installed capacities, regulation durations, and conversion efficiencies are comprehensively evaluated and analyzed. The calculation results show that the operation effect of a pumped storage plant with high regulation performance and high comprehensive conversion efficiency is better, indicating that the established index system and evaluation method can comprehensively and truly reflect the positive benefits brought by a pumped storage plant to a new power system. This study can provide a practical reference for the early planning and decision making of pumped storage in a new power system.

Food systems rely on natural resources for production causing their depletion. Sustainability assessment can encourage farms and agri-food companies to improve sustainability performances. Sustainability assessment frameworks and tools differ in their purposes, scope, methods of application, and required time for execution; however, most of them do not fit with value chains, or they do not cover all sustainability dimensions. Our objective is to propose a holistic framework to assess sustainability at agri-food value chains level. The proposed framework combines the Sustainability Assessment of Food and Agriculture systems (SAFA) (El Hage, 2012) [1] and The Agri-food Evaluation Framework (TEEB) [2]. It incorporates the concepts of Socio-Ecological Systems, Assemblage, and Social Practices. It integrates system dynamics by emphasising human and natural capital stocks and their users. We explain in detail the methodological steps we followed to construct and to apply this new framework to two case studies in Italy and France. The new framework was applied to real-life case studies and has shown its effectiveness and demonstrates its potential for widespread use in similar scenarios.

This article aims to identify the variables that determine wellness tourism destination competitiveness using a case study in Thailand. This study outlines a suggested competitiveness framework for wellness tourism destinations based on the viewpoint of wellness tourism clusters. The study’s model illustrates the different categories and components and their relationship to competitiveness. Thirteen in-depth qualitative interviews were conducted with leading experts in wellness tourism. Thematic and content analysis was used to examine the interview data using the Nvivo 12 programme. The study identified seven emerging themes that encompass factors that affect a wellness tourism destination’s competitiveness. These factors include the destination’s environment, the area’s policy and strategy to facilitate travelling and wellness tourism, infrastructure and capability to support wellness tourism, human-made resources and culture of wellness tourism, strategy and structure for healthcare services, potential for developing innovation and cooperation to build collaborative strengths and proactive marketing. The participants’ descriptions show the existence of a comprehensive framework for assessing the competitiveness of wellness tourism destinations in the Thai wellness tourism market. The concept elucidates the dynamic complexity of wellness tourism destination competition, which is believed to guarantee success for both individual stakeholders and society.

The concept of smart cities has gained significant attention due to the potential of smart cities to optimize city services and enhance citizens’ quality of life. Cities are investing in digital transformation to become smarter, sustainable, and resilient. Therefore, there is a need to build a comprehensive and holistic model to assess smart city initiatives. This paper aims to develop a model that can capture the maturity of smart city adoption across various functional domains. These domains are divided into focus areas that capture different dimensions of a smart city and grouped into seven groups: ICT, economy, environment, social, resources, services, and governance. Each focus area has a set of maturity levels that describe the capabilities and outcomes of the city at different stages of development. To develop the model, the focus areas were extracted from the literature based on 16 models that have been reviewed. Assessing these models helped in identifying gaps and building the foundation of the model. Using the information extracted from the literature, a focus area model was designed and developed. The model development included seven main phases, which were: scope, design, populate, test, deploy, and maintain. The current paper validates the proposed model using the Delphi method, which involves the participation of a panel of sixty field experts. The experts evaluated the model’s correctness and completeness based on their experience and provided feedback. This feedback was used to revise and finalize the model. The smart city maturity model provides a framework for benchmarking, planning, and improving smart city initiatives. Cities can use the model to measure their performance and evaluate their weaknesses and strengths. The model is also the most comprehensive in terms of the scope of the focus areas included, and the results show that the model has a high level of accuracy and consistency and can effectively assess smart city adoption.

Abstract Background Mode effects, the variations in item and scale properties attributed to the mode of test administration (paper vs. computer), have stimulated research around test equivalence and trend estimation in PISA. The PISA assessment framework provides the backbone to the interpretation of the results of the PISA test scores. However, an identified gap in the current literature is whether mode effects have affected test score interpretation as defined by the assessment framework, and whether the interpretations of the PBA and CBA test scores are comparable. Methods This study uses the 2015 PISA field trial data from thirteen countries to compare test modes through a construct representation approach. It is investigated whether item facets defined by the assessment framework (e.g., different cognitive demands) affect item difficulty comparably across modes using a unidimensional two-group generalized partial credit model (GPCM). Results Linking the assessment framework to item difficulty using linear regression showed that for both maths and science domains, item categorisation relates to item difficulty, however for the reading domain no such conclusion was possible. In comparing PBA to CBA in representations across the three domains, maths had one facet with a significant difference in representation, reading had all three facets significantly different, and for science, four out of six facets had significant differences. Modelling items labelled “mode invariant” in PISA 2015, the results indicated that in every domain, two facets showed significant differences between the test modes. The graphical inspection of difficulty patterns confirmed that reading shows stronger differences while the patterns of the other domains were quite consistent between modes. Conclusions The present study shows that the mode effects on difficulty vary within the task facets proposed by the PISA assessment framework, in particular for reading. These findings shed light on whether the comparability of score interpretation between modes is compromised. Given the limitations of the link between the reading domain and item difficulty, any conclusions in this domain are limited. Importantly, the present study adds a new approach and empirical findings to the investigation of the cross-mode equivalence in PISA domains.

This paper explores Ghana’s two-decade journey in developing a digital land information system (LIS), exemplified by Ghana Enterprise Land Information System (GELIS) and Enterprise Land Information System (ELIS). Despite advancements by Ghana’s Lands Commission, manual processes persist and coexist with digital ones. Our study uses a qualitative approach to assess the effectiveness of the LIS implemented in Accra. This study found that Accra’s LIS is highly aligned with clear institutional mandates, roles, and responsibilities, as well as the availability of laws and policies to support analogue-to-digital conversion. Furthermore, a robust approach to protecting the data, operating system, and software underpins the system. Subsequently, the integration of a digital LIS has enhanced service delivery and accountability. Nonetheless, Accra’s LIS is still at the beginning of a comprehensive learning and development curve. Sustaining the LIS requires furtherance in the implementation plan, funding, law implementation, ICT strategy, divisional integration, work processes, data quality, and communication strategy. These findings will inform the next steps of improvement for Accra’s LIS and guide its nationwide scaling, contributing to discussions on technology acceptance dynamics in predominantly analogue environments.

This dataset contains expert assessments of the cybersecurity skills required for six job profiles in Europe, as determined via surveys responded by cybersecurity experts from academia and industry. The data can be used to identify educational needs in the cybersecurity sector and compare against other frameworks.The six cybersecurity-oriented job profiles used in the surveys are: General cybersec auditor; Technical cybersec auditor; Threat modelling engineer; Security engineer; Enterprise cybersecurity practitioner; Cybersecurity analyst. Data—i.e. expert assessments—was collected via surveys, targeted at European experts in cybersecurity from academia and industry. Respondents characterised the skills needed to perform in six job profiles using the CSEC+ framework: a cybersecurity skills framework prepared as a spreadsheet where cybersecurity skills must be ranked in a Likert scale from 0 (irrelevant) to 4 (advance knowledge needed). Metadata requested included the type of organisation of the respondent (Large company, SME, Academic/Research, Public administration, Other) and the country of origin.There were three data-collection phases: (1) an initial phase, used also to refine later larger-scale processes, carried out in Oct 2021–Jan 2022 and resulting in 13 expert assessments from four EU countries; (2) a second phase implemented as an online service broadcast to a larger audience, carried out in Mar–Apr 2022 and resulting in 15 assessments from eight European countries; (3) and a third phase, allowing direct online input and distributed in PC and mobile form, carried out in Sep–Oct 2022 and resulting in 32 assessments from ten European countries.The raw data gathered was stored and processed via spreadsheets, computing statistical information (mean, stdev) on how much each cybersecurity skill and area was deemed necessary to perform in each job profile. This is visualised as a heatmap where colour intensity symbolises value, and circle diffusion symbolises spread. Processed data further includes visualisations on how the area of origin of the respondent (academia, as in “producer of education”, vs. industry, as in “consumer of education”) influences the responses. This is shown as bar plots, where whiskers represent confidence intervals used for statistical-significance tests.This data can serve as basis to understand the educational needs for the cybersecurity sector in Europe. It can be reused for comparison against frameworks, other than CSEC+, to assess the need of education in specific cybersecurity sectors such as human security. Furthermore, the Qualtrics survey template (included) is a ready-made solution for replication studies.

The rapid increase in the global population is contributing to the urgent challenges we face in ensuring the sustainability of our planet. This demographic shift, which gained momentum in the 1990s, is closely linked to a surge in natural disasters, both in terms of their frequency and severity. The quest for resources and improved quality of life, including the need for housing and essential services, has compounded these challenges. With the world’s population projected to double by 2050, and approximately two-thirds of this population expected to reside in urban areas, we are facing a complex web of interconnected issues that will significantly magnify the impacts of climate change-induced disasters. It is imperative that we build resilient cities capable of withstanding and adapting to these changes. However, the growing complexity of urban services and the necessity for integrated management raise questions about the preparedness of these resilient cities to comprehend and address the multifaceted challenges posed by climate change. In response to these critical concerns, this study endeavors to address the intersection of resilience and climate change. We propose the development of a Smart Resilient City Assessment Framework, comprising two core components: resilience re-evaluation and smartness evaluation. Each component consists of eight essential steps. The culmination of these steps results in a semi-quantitative index that accurately reflects the city’s position regarding resilience and smartness in the face of climate change-related disasters. To demonstrate the framework’s practicality and suitability, we present results from a hypothetical scenario focusing on water supply management, a critical aspect of climate change adaptation. The framework equips city managers with the necessary tools to re-evaluate their cities’ resilience, evaluate their capacity to address climate change-induced challenges, and make informed decisions on integrating resilience and smart solutions to pave the way for a more sustainable and climate-resilient future.

The Water-Energy Nexus (WEN) provides a comprehensive concept for the cooperative management of resources. Although the WEN system in cities is intricately connected to socioeconomic activities, relationship between WEN and economic systems remains understudied. This study introduces a tri-dimensional Nexus Pressure Index (NPI) to assess the pressure on WEN system. Gross Domestic Product (GDP) per capita and city tiers in the urban agglomeration were used to assess the relationship between the characteristics of WEN and economic system. We conducted a case study of 296 cities in China and 1330 counties in the United States from 2012 to 2019. During the 9 year study period, on average, pressure on WEN system have relieved by 22% in China and 27% in the United States, measured by NPI. Cities with most ideal characteristics (low pressure in all dimensions) rank merely in the middle of all eight classes, with GDP per capita 74% and 85% of the highest-GDP-per-capita class in China and the US respectively. Well-performing WEN system does not yield best economic outcomes. High water pressure correlates with better economic performance in the US, while high-energy-pressure cities had GDP per capita about 50% and 70% of the class with highest GDP per capita in China and the US, respectively, suggesting stronger economic constraints from energy stress. Urban agglomeration analysis revealed a negative relationship between WEN and economic performance. NPI in emerging cities is 0.6–1 lower than NPI in regionally-central cities in China, while 0.2–0.5 lower in the US. These results underscore the contradiction between preferred WEN characteristics and higher economic performance, and underpin the resource curse hypothesis at city-level in the two considered giants. A sustainable approach to harmonize WEN and economic system is in urgent need.

High-quality urban parks are considered an integral part of health resources as they can deliver diverse ecosystem services. However, the quality of parks is not always similar, resulting in different levels and values of the services provided. A systematic and complete assessment frame of urban park quality is limited. From the perspective of landscape architecture and design, this study aims to propose a comprehensive assessment framework of urban park quality based on six dimensions (planning and design, cultural services, complete and various facilities, landscape planting, landscape management, and landscape ecology), consisting of 27 indicators with different weights by using the objective and subjective weighting method. Taking the city of Chengdu, China as a case study, 100 urban parks are studied via field investigation and scored using methods that consist of a category count, existence score, field measurement, experts score, and photo review and recheck (13,589 images). The results reveal the spatial distribution and differences in park quality, including six quality dimensions and five districts, and the proportion of the existing quality elements in 100 parks. Based on the results, the spatial areas (Barren area, Low-quality area, Medium-quality area, and High-quality area) are identified, which leads to the establishment of the improvement strategies of spatial equity regarding multi-quality parks. The results can help improve the assessment index system of urban parks, guide the landscape planning and design of urban parks for sustainability, as well as provide a reference for future environmental and social equity development, so as to provide insight and reference for decision-makers and designers considering the landscape planning and design of parks.

The various social, political, environmental, and economical mega-trends together with the rapid rise of digitalization are shaping cities worldwide including the way that citizens and products move within the urban environment. New mobility services are popping up which are showing the path toward more on-demand and personalized mobility patterns. The transformation of the urban mobility environment though constitutes a great challenge for policy-makers, as little is known about the impact of these trends on the city’s current mobility environment while the assessment of the future state of a mobility system can be considered a quite complex process taken its multi-parametric and multi-dimensional nature. This paper aims to simplify this process by presenting a coherent multi-actor consequence analysis framework as a tool for assessing future mobility scenarios which was developed in the framework of the H2020 SPROUT. This paper presents in detail the main components of this framework together with the list of key performance indicators used for assessing the performance in terms of sustainability of future mobility scenarios as well as indicative results from its use by the city of Padua.

BackgroundThere is an increasing emphasis on the importance of comprehensive primary healthcare (CPHC) in improving population health and health equity. There is, therefore, a need for a practical means to determine how comprehensive regional primary healthcare organisations (RPHCOs) are in their approach. This paper proposes a framework to provide such a means. The framework is then applied to assess the comprehensiveness of Australian RPHCOs. MethodsDrawing on a narrative review of the broader literature on CPHC versus selective primary healthcare (SPHC) and examples of international models of RPHCOs, we developed a framework consisting of the key criteria and a continuum from comprehensive to selective interventions. We applied this framework to Australian RPHCOs using data from the review of their planning documents, and survey and interviews with executive staff, managers, and board members. We used a spidergram as a means to visualise how comprehensive they are against each of these criteria, to provide a practical way of presenting the assessment and an easy way to compare progress over time. ResultsKey criteria for comprehensiveness included (1) focus on population health; (2) focus on equity of access and outcomes; (3) community participation and control; (4) integration within the broader health system; (5) inter-sectoral collaboration; and (6) local responsiveness. An examination of Australian RPHCOs using the framework suggests their approach is far from comprehensive and has become more selective over time. ConclusionThe framework and spidergram offer a practical means of gauging and presenting the comprehensiveness of RPHCOs, and to identify gaps in comprehensiveness, and changes over time.

This article discusses on a working study from a research on the usage of a game-based learning assessment framework as a standard guideline to assess undergraduate students' understanding and performance towards ubiquitous computational thinking properly. The objective of this research is to construct an appropriate game-based learning assessment framework to learn ubiquitous computational thinking and to determine the importance of the game-based learning approach. The methods in conducting this research study are a mixed method research with Delphi methodology approach. The game-based learning assessment framework was constructed based on results gathered by literature reviewing papers and afterward questionnaires as an online survey given to experts from game development and computer science fields by phases to answer and validate. The results gathered according to phases were performed using thematic analysis and descriptive statistics respectively. The expected results of this study are that the game-based learning assessment framework is able to assess undergraduate students’ understanding and learning performance towards ubiquitous computational thinking and also able to align and incorporate into computing curriculum.

Çalışmanın amacı, bir tutarlılık değerlendirme çerçevesi geliştirmektir. Çalışmanın ilk aşamasında ilgili alanyazın taranmış ve metin tutarlığının değerlendirilmesine yönelik 15 çalışmaya ulaşılmıştır. 8 çalışmada ölçeklerin, kalan 7 çalışmada ise tema başlıklarının kullanıldığı tespit edilmiştir. Bu çalışmalardaki değerlendirme kriterleri karşılaştırılmış, kategorilere ayrılmış ve ortak değerlendirme kriterleri belirlenmiştir. Değerlendirme ölçütlerinin belirlenmesinde metin yazma süreçlerine odaklanan çalışmalardan yararlanılmıştır. Yapılan analize dayalı olarak konu, ana fikirler ve yardımcı fikirler, işlev, üst metin ve metin türüne uygun dil kullanımı, bağlantılar ve geçişler, içerik organizasyonu ve başlıktan oluşan 7 boyutlu bir değerlendirme çerçevesi oluşturulmuştur. Bu değerlendirme çerçevesinin metin yazarlarına ve değerlendiricilere rehberlik etmede yararlı bir araç olacağı umulmaktadır.

Science, technology, engineering, and mathematics (STEM) occupations are projected to grow over two times faster than the total for all occupations in the next decade. This will require reskilling and upskilling those currently in the workforce. In response, many universities are deliberately developing academic programs and individual courses focused on providing relevant skills that can be transferred to the workplace. In turn, developers of such programs and courses need ways to assess how well the skills taught in their courses translate to the workforce. Our framework, Course Assessment for Skill Transfer (CAST), is a suite of conceptual tools intended to aid course designers, instructors, or external evaluators in assessing which essential skills are being taught and to what extent. The overarching aim of the framework is to support skills transfer from the classroom to the workplace. This paper introduces the framework and provides two illustrative examples for applying the framework. The examples show that the framework offers a customizable structure for course facilitators and evaluators to assess the skills taught, learned, and retained based on their needs and the resources available to evaluate the quality and usefulness of course offerings in higher education.

Mobility as a Service (MaaS) and, more recently, electric Mobility as a Service (eMaaS) have increasingly been put forward to meet the economic, social, and environmental challenges linked to mobility. First, however, monitoring and evaluating such a scheme’s performance is crucial, mainly through the definition of appropriate indicators. In this study, a standardised methodological approach is presented for the assessment of an eMaaS scheme. In addition, this methodological approach contains a range of innovative Key Performance Indicators (KPIs). The proposed KPIs refer to the evaluation of the scheme based on four pillars: (a) society, (b) users, (c) operators, and (d) internal operation. The methodology for evaluating the proposed KPIs includes identifying the available sources for data collection. For example, data can be collected through questionnaire surveys, focus group discussions, and the system’s central dashboard. An appropriate set of indicators to evaluate a system from various perspectives is necessary to assess an eMaaS scheme in real-life conditions. Furthermore, the evaluation of the overall operation of the scheme will contribute to drawing valid conclusions (e.g., user acceptance, economic viability) for the implementation of eMaaS in urban areas.

Organic food processors are guided by the European Council (EC) legislation for developing their products. However, the choice of processing technology remains relatively large. To help processors choosing a technology in line with organic principles, the partners involved in the European project ProOrg have designed an assessment framework which has been tested in real conditions on the processing of organic apples in purees at a pilot scale. The assessment concerned the addition of a grinding step before heating. The effect of grinding was then evaluated on environmental, nutritional and sensory criteria. Sixteen indicators were selected to assess these three aspects and rated on a 5-points scale from much worse to much better. Nine of them obtained a higher score with the grinding step added, meaning that the quality was better. The overall score of the puree with grinding was higher than the reference (without grinding) for the three performed trials. The assessment framework was successfully applied to this case study but some improvements were proposed in order to enhance its robustness and to facilitate its comprehension and application. The assessment framework should be an interesting tool for organic food processors.

The 2019 European Open Data Directive identifies geospatial data as data that could have a major impact on human activities (high-value data, HVD) and advocates its provision as open data (OD), i.e., without barriers to access and re-use. Although Croatia has implemented OD policies to support the provision of open data, many geospatial data are still not available, or if available, their level of openness ranks Croatia lower than Slovenia and Serbia on some ranking lists. Benchmarking tools have proven to be a powerful tool in identifying barriers in OD. This paper, therefore, benchmarks the level of openness and provision of geospatial HVD in Croatia, Slovenia and Serbia, using the extended and modified Global Open Data Index methodology (GODI Plus). It is expected that this will provide an answer to the status of OD policies and government engagement in OD in Croatia and identify good OD practices among the three countries analyzed. Furthermore, the results will be a baseline benchmark for future HVD analyses. The results reveal low data openness for Croatia and Serbia, high data openness for Slovenia, and a low level of government engagement in all three proposed countries.

Urban areas are increasingly vulnerable to the effects of climate change. Stormwater Green infrastructure (SWGI) is seen as an approach to increase the climate resilience of urban areas, because they can buffer precipitation changes brought on by climate change. However, SWGI features themselves need to be resilient to climate change to be able to contribute to the resilience of cities. Thus, we aimed to develop a SWGI resilience assessment framework that could be used to identify challenges and to inform decisionmakers’ efforts to enhance resilience. We developed a resilience assessment framework based upon a resilience matrix approach to recognize effective resilience categories for SWGI by reviewing the literature on critical functionality and barriers to implementation and operation. These categories for SWGI included policy, design, maintenance, economic factors and social factors that influence SWGI functionality. We then identified specific aspects under each category that could be used for assessing SWGI resilience, recognizing that SWGI has critical functionalities and factors controlling its viability. Unlike other SWGI assessment frameworks that are focused on ecosystem services as a final outcome, we worked from a socio-ecological perspective in order to include socio-economic and policy factors and design and planning aspects that affect service provision. Developing a resilience assessment framework is critical for management because it can reveal the specific challenges facing SWGI resilience that have traditionally been overlooked, such as maintenance and social factors. This specific framework can also lead to efficient planning and management by identifying interrelations and hierarchical relationships of categories that influence resilience. Application of this framework will rely upon expert input to connect broad dimensions with specific indicators for SWGI to local priorities in resilience planning.

Treated wastewater is expected to constitute an essential part of the urban water cycle as an additional water resource in water-scarce or densely populated regions in the future. As decisions on the implementation of water recycling measures should always consider local conditions, the project ‘MULTI-ReUse: Modular treatment and monitoring for wastewater reuse’ has developed a comprehensive sustainability assessment tool, designed to support decision-makers in examining the technical feasibility, economic viability, ecological compatibility and social acceptance of alternative service water supply solutions at local level. This article describes the structure of this sustainability assessment tool and its underlying multi-criteria assessment approach based on 23 evaluation criteria. Already in the development phase, the tool was tested in a German and a Namibian case study. Both case studies are presented with a special focus on the technologies used and the results of the analysis with the sustainability assessment tool. Case study testing proved that the tool is applicable in various environmental and societal settings with widely differing climatic conditions, limited resource availability, for varying feed water qualities and water quality requirements. The comprehensive, straightforward assessment approach enabled the local users to identify the most sustainable supply system or strategy for their decision case. HIGHLIGHTS The paper presents a multi-criteria assessment approach based on 23 evaluation criteria that can be used to assess the technical feasibility, economic viability, ecological compatibility and social acceptance of alternative service water supply solutions at local level.; Assessment results from two different case studies comparing different solutions for industrial and agricultural water reuse are presented.;

Against the background of drastically rising global water demand and increasing pollution and overexploitation of regional water resources, the demand-driven water supply of households and industry is of central importance. Water reuse and desalination are seen as key technologies to overcome potential regional and local water shortage. In the joint projects funded by the German Federal Ministry of Education and Research (BMBF) ‘Future-oriented Technologies and Concepts to Increase Water Availability by Water Reuse and Desalination (WavE)’, evaluation approaches for analysing innovative technologies and concepts are being developed and assessed. All evaluation methods and criteria used were selected based on the decision situation at hand and the decision-makers preferences. Based on the analysis of six multi-criteria evaluation concepts used in selected WavE projects, this paper presents a general approach for comparative multi-criteria evaluation of water reuse systems consisting of prerequisites, minimum requirements, evaluation criteria (qualitative, semi-quantitative or quantitative) and a final aggregation of results. Exemplary sets of criteria for the application in a more industrial, municipal and/or international context are presented as an aid for the application of holistic evaluation approaches for (process) concept and technology selection in the context of water reuse and desalination. HIGHLIGHTS The paper provides guidance on the application of different evaluation approaches for the selection of advanced treatment technologies for water reuse and desalination.; It is based on a review of assessment methods used in six different projects funded by the German Federal Ministry of Education and Research and provides insights into challenges that were faced in the assessment processes of the individual projects.; It presents a general approach for comparative multi-criteria evaluation of water reuse systems consisting of prerequisites, minimum requirements, evaluation criteria (qualitative, semi-quantitative or quantitative) and a final aggregation of results.; Exemplary sets of criteria for the application in a more industrial, municipal and/or international context are presented as an aid for the application of holistic evaluation approaches for concept and technology selection in the context of water reuse and desalination.; Finally, possible data sources, challenges in using them and indicators to measure data quality are presented to give guidance on data collection.;

With the continuous innovation of new-generation information technology and its accelerated integration with manufacturing industry, industrial internet platforms (IIPs) are rapidly emerging worldwide. Construction and application of IIP has become a new focus in international competition for leading enterprises, and also a new direction of industrial development for many countries worldwide. However, the development of IIP is still in the stage of exploration, and the industry sector still lacks unified understanding of the IIP. Therefore, this study firstly proposes a reference architecture of IIP to clarify its framework and core functions, so as to provide a general reference model for the industry to understand and jointly promote construction of IIP. Secondly, an assessment system is proposed to evaluate the usage of IIP. The assessment framework is composed from three domains namely the foundation, key capability, value and benefit. Finally, the practical value of the reference architecture and the assessment framework of IIP is verified by an industry practice.

ABSTRACT Protected areas are complex social‐ecological systems, hence their management should be guided by engagement and co‐learning with diverse stakeholders. The challenge of effective stakeholder participation has generated a body of literature on the design and facilitation of coproduction processes. In this study, we used this literature to develop a principle‐based framework for assessing coproduction. We then applied this framework to evaluate how well “adaptive planning” (a sub‐process of adaptive management used for visioning and objective setting with stakeholders), as applied to the Garden Route National Park in South Africa, aligned with the ideals of coproduction. Our analysis revealed shortcomings in the adaptive planning process, which could be improved through broadening the agenda beyond the mandate and control of national parks, empowering collective agency among a wider stakeholder network, and embedding co‐learning with stakeholders as an ongoing journey. A significant finding was that adaptive management does not align well with the ideals of coproduction, which may be better supported by an adaptive co‐management approach. The latter is particularly necessary in complex national parks that are diverse in terms of both ecosystems and stakeholders, and where governance may be contested.

An important goal across Sub-Saharan Africa (SSA), and globally, is to foster a healthy nutrition. A strengthening of the diversity, sustainability, resilience and connectivity of food systems is increasingly seen as a key leverage point. Governance arrangements play a central role in connecting sustainable, resilient farming with healthy nutrition. In this article, we elaborate a framework for assessing, monitoring and improving the governance of food systems. Our focus is on food chains in six peri-urban and urban regions in SSA. A literature review on food chain governance and a mapping of current agri-food chains in the six regions provide the basis for the elaboration of an indicator-based assessment framework. The framework is adapted to the specific conditions of SSA and related goals. The assessment framework is then used to identify the challenges and opportunities in food chain governance in the six regions. The first testing of the framework indicates that the approach can help to identify disconnects, conflicting goals and tensions in food systems, and to formulate strategies for empowering agri-food chain actors in transitioning toward more efficient, equitable and sustainable agri-food systems. The article is concluded with a brief reflection on the strengths and weaknesses of the framework and suggests further testing and refinement.

In many cases, the purpose of reusing old industrial buildings is to serve the public. Converting a building that had a particular function and is unfamiliar to the public to a civic building is a great challenge. Significantly, the public’s curiosity towards a special-purpose industrial building alone is not enough to give the building a long life following its conversion and regeneration. To be sustainable in public life, the design of reused old industrial buildings should also meet the needs of the public. It is important to realise, however, that everyone’s needs are different. This paper will therefore analyse whether Abraham Maslow’s (1943) famous psychological theory, the Hierarchy of Needs, which not only summarized the content of human needs, but also divided them into levels, can be applied to the reuse of former industrial buildings. The paper translates this into the field of architecture to develop an assessment framework for the reuse of old industrial buildings. This assessment framework is able to combine mathematical models for quantitative assessment of future projects, and uses Shanghai 1933 Old Millfun, China as a case study for its demonstration. This provides an evaluation of a completed project and identifies challenges for further development, as well as providing guidance for future adaptive reuse projects.

The HapHop-Physio exer-learning game is a cognitive rehabilitation solution for children with learning disorders to train memory and attention functions. Therefore, HapHop-Physio must be assessed as an appropriate tool developed to support the enhancement of essential cognitive skills. In this paper, we aim to establish the validity of HapHop-Physio in a healthcare setting with children receiving training with this tool. HapHop-Physio was developed through interaction between clinical experts, one graphic designer, and game developers. Following an assessment framework for serious games in healthcare, the game’s rationale, functionality, validity, and data safety are described. Particularly, the validity was assessed with experts through a case study conducted in three phases with 12 children diagnosed with Specific Learning Disorders. The baseline of the cognitive profile of the children was obtained and trained with HapHop-Physio. General trends and findings were obtained through an exploratory analysis of the gathered results from the phases. The validity aspects were achieved through continuous feedback from the experts, allowing to improve the game in five features: game structure, scoring system, avatars, login system, and clinicians’ dashboard. The application of the assessment framework in HapHop-Physio guarantees end users that the game is safe and effective enough to be used for supporting memory and attention training. One relevant finding from the case study was that cognitive performance improved in 11 out of 12 children at the end of the training. The positive outcomes of this assessment indicate the game’s appropriateness for a healthcare setting. However, the improvement in cognitive performance cannot be associated with HapHop-Physio in this case study. Consequently, it needs to be evaluated in a controlled experiment (including a control group) to ensure that it leads to cognitive rehabilitation in reality.

The economic and social development evaluation system with the Gross Domestic Product (GDP) as the leading indicator is no longer applicable to the current social progress in China. It is essential to carry out an assessment of the Gross Ecosystem Product (GEP) to integrate ecological benefits into the economic and social evaluation system and promote sustainable socio-economic development. This study took Guangxi, an important province in South China, as the study area. We used four periods of land use and land cover data (LULC), meteorological data, soil data and yearbook statistics to construct a GEP assessment framework based on geographic information system (GIS) and remote sensing (RS) technologies. We accounted for the provisioning services, regulating services, and tourism services provided by Guangxi in 2005, 2010, 2015, and 2020 and analyzed the region’s and municipalities’ spatial–temporal pattern characteristics and trends of change in GEP. In addition, this study also discusses the relationship between GEP and GDP. The results showed that many important products and services provided by natural ecosystems in Guangxi had enormous economic benefits. GEP had increased from CNY 15,657.37 billion in 2005 to CNY 36,677.04 billion in 2020, and the distribution of GEP showed obvious spatial heterogeneity. The value of ecosystem regulation services was about 65–89% of GEP, which is the main component of GEP. From 2005 to 2020, natural ecosystem protection and socio-economic development have achieved coordinated development in Guangxi. GEP and GDP showed upward trends in general. Although Guangxi is relatively backward in terms of economic development, the scientific quantification of the unrealized value of the services provided by the ecosystem through GEP accounting makes it possible to transform ecological advantages into economic advantages. It could help the local government and people to re-recognize the value of ecological resources and realize the beautiful vision of lucid waters and lush mountains as invaluable assets.

The successful and fast development and deployment of renewable energy and greenhouse gas reduction technologies is a continuing and structural challenge. The deployment of these technologies is slowed down and sometimes even stalled due to societal challenges like public resistance, lack of appropriate policy and regulations, unsolid business cases and uncertainty concerning the impact on the environment. In this paper we elaborate on societal aspects that influence technology development and deployment and introduce the societal embeddedness level (SEL) framework. Building upon the technology readiness level (TRL), the SEL framework enables the assessment of the current level of societal embeddedness of energy technologies in order to identify the societal aspects which need to be taken into account to accelerate deployment of energy technologies. The SEL framework takes into account four societal dimensions (impact on the environment, stakeholder involvement, policy and regulations, and market and financial resources) and four stages of technology development (exploration, development, demonstration and deployment) that are linked to the TRL. The SEL framework has been elaborated for CCS technologies and is being applied to the monitoring of geological CO2 storage by the ACT II project DigiMon (Digital Monitoring of CO2 storage projects). DigiMon is an ACT second call project, funded by the national funding agencies in the period September 2019–August 2022.

The coastline plays an important role in indicating the conditions of social-economic development in the coastal zone. In this study, an integrated assessment framework was proposed to address the provincial and county-level spatiotemporal dynamics of continental coastlines from the perspectives of length, position, composition, and anthropogenic utilization quantitatively, and to explore the exact impacts of urbanization on coastline changes in the Fujian Province over the period from 1985 to 2020. Results showed that the total length of coastlines decreased first and then increased due to the different patterns of economic development. The proportion of artificial coastlines and the index of coastal utilization degree increased rapidly during the same period. Moreover, the seaward movement of coastlines due to the coastal reclamation projects resulted in a considerable increment in land areas. The pressure brought by the continuous concentration of population, built-up areas, and industrial districts under the rapid urbanization was the primary factor that increased the degree of anthropogenic disturbances in the coastal zone. Furthermore, the policies issued by the local or central government can be critical tipping points for coastline changes in different periods.

This paper addresses the development of performance-based assessment items for ICT skills, skills in dealing with information and communication technologies, a construct which is rather broadly and only operationally defined. Item development followed a construct-driven approach to ensure that test scores could be interpreted as intended. Specifically, ICT-specific knowledge as well as problem-solving and the comprehension of text and graphics were defined as components of ICT skills and cognitive ICT tasks (i.e., accessing, managing, integrating, evaluating, creating). In order to capture the construct in a valid way, design principles for constructing the simulation environment and response format were formulated. To empirically evaluate the very heterogeneous items and detect malfunctioning items, item difficulties were analyzed and behavior-related indicators with item-specific thresholds were developed and applied. The 69 item’s difficulty scores from the Rasch model fell within a comparable range for each cognitive task. Process indicators addressing time use and test-taker interactions were used to analyze whether most test-takers executed the intended processes, exhibited disengagement, or got lost among the items. Most items were capable of eliciting the intended behavior; for the few exceptions, conclusions for item revisions were drawn. The results affirm the utility of the proposed framework for developing and implementing performance-based items to assess ICT skills.

High quality descriptive metadata is essential to enabling the effective discovery of Earth observation data to a growing number of diverse users. In this paper, we define a framework to assess the quality of NASA’s Earth observation metadata with the overarching goal of improving the discoverability, accessibility and usability of the data it describes. The framework, developed by the Analysis and Review of the Common Metadata Repository (ARC) team, focuses on the metadata quality dimensions of correctness, completeness, and consistency. The methodology used by the ARC team to implement the framework is described, as well as best practices, lessons learned and recommendations for implementing similar metadata quality assessment processes. Initial results from the project indicate that this methodology, in combination with community and stakeholder collaboration, is effective in improving metadata quality.

We developed a framework to compare the similarities and differences in nature conservation between two highly biodiverse Mediterranean islands; Cyprus and Crete. We relied on a) literature review for the factors which have shaped the state of conservation affairs on the islands (e.g. institutional context) and b) the use of indicators to capture conservation effort (e.g. protected areas extent) as well as the main pressures on the islands (e.g. climate change). Entry to the European Union has improved environmental policy and legislation with both islands involved in several conservation projects. In Cyprus, an overall favorable habitat conservation status is reported compared to Crete and the role of formal education in environmental protection and awareness is more significant. Among the threats examined, fire seems to be important and projected to increase under climate change in both islands. Crete has a larger number of grazing animals but the available areas for stock raising are five times higher than those in Cyprus. Tourism is more intense in Crete but land development is more acute in Cyprus. Climate change is expected to be more severe for Cyprus. Despite the islands’ biotic and landscape affinities and the common threats they face, what seems to be making a difference in nature conservation is a) governance structure, b) the way/extent that these threats are manifested c) adaptive capacity to future threats, in particular climate change. Cyprus seems to be facing more intense threats but is also placed better in terms of institutional context to deal with these threats.

This paper applied a recently developed Local Government Climate Action Assessment Framework to identify whether small municipalities in British Columbia are on track to meet their climate targets and to better understand the effectiveness of their climate-related actions. The aim of this paper was (1) to further test the assessment framework by evaluating its applicability for smaller municipalities, (2) to evaluate and categorize local progress in three small cities, namely Campbell River, Prince George and Revelstoke, and (3) to contrast these climate actions with actions taken by larger municipalities in BC, using the same assessment framework. This assessment revealed that key external support made available to expand on their Integrated Community Sustainability Plans provided for striking similarities among the three case studies regarding their strategies and plan formulations for which actions were largely transformative or reformative. However, the three small cities were lacking periodic reporting and monitoring of actions and presented shorter timeframes of up to 20-50 years for their planning horizons, all of which negatively impact their prioritization strategies. The main difference between larger and smaller cities was found among actions related to the feedback and evaluation category of the framework, with smaller cities performing more poorly. Greater shift in priorities away from climate change-related actions were evident in smaller local governments, signalling their more vulnerable position regarding changes in leadership in local and provincial administrations. This study highlights the key role that strategic alliances, networks, and external champions as partners play in planning and implementing climate action and in increasing public interest in sustainability. Thus, these should be fostered and promoted to keep building local capacity and effectively accelerate greater change through e.g., strengthening their capacity to implement, monitor and evaluate climate actions.

Off-site construction is an innovative type of construction with the philosophy of standardizing the process and deploying the latest technological enablers. Many technologies, such as the Building Information Model (BIM), Internet of Things (IoT), etc., are concerned with virtual representation and manipulation of the physical site. However, a holistic view of the off-site construction processes is lacking in the exploration of the technological advances, resulting in inconsistency when applying these advances in practice. The concept of Digital Twin is useful for addressing this challenge. Digital Twin is a philosophy and a collection of technologies aimed toward seamless physical and virtual connections. Therefore, a holistic Off-site Construction Digital Twin model is necessary for any research concerning this topic, and an assessment framework is useful in helping off-site construction industry companies in approaching systematic Digital Twin. This research first proposes a model for Off-site Construction Digital Twin. To quantify this model, an assessment tool named Off-site Construction Digital Twin Maturity Level is proposed. The validation and evaluation of this assessment framework are conducted through a case study with ACQBuilt, an off-site construction company in Edmonton, Canada. The resulting assessment framework contributes to the body of knowledge in two ways: Firstly, it sets the foundation for an Off-site Construction Digital Twin, which is anticipated to significantly reduce waste and to improve efficiency. Secondly, it enables easier technology application in practice by offering a holistic Digital Twin framework.

Enhancing students’ critical thinking (CT) skills is an essential goal of higher education. This article presents a systematic approach to conceptualizing and measuring CT. CT generally comprises the following mental processes: identifying, evaluating, and analyzing a problem; interpreting information; synthesizing evidence; and reporting a conclusion. We further posit that CT also involves dealing with dilemmas involving ambiguity or conflicts among principles and contradictory information. We argue that performance assessment provides the most realistic—and most credible—approach to measuring CT. From this conceptualization and construct definition, we describe one possible framework for building performance assessments of CT with attention to extended performance tasks within the assessment system. The framework is a product of an ongoing, collaborative effort, the International Performance Assessment of Learning (iPAL). The framework comprises four main aspects: (1) The storyline describes a carefully curated version of a complex, real-world situation. (2) The challenge frames the task to be accomplished (3). A portfolio of documents in a range of formats is drawn from multiple sources chosen to have specific characteristics. (4) The scoring rubric comprises a set of scales each linked to a facet of the construct. We discuss a number of use cases, as well as the challenges that arise with the use and valid interpretation of performance assessments. The final section presents elements of the iPAL research program that involve various refinements and extensions of the assessment framework, a number of empirical studies, along with linkages to current work in online reading and information processing.

A growing interest has been expressed in the issue of building adaptability over the past decade, perceiving it as an intrinsic criterion for sustainability. In light of the circular economy (CE) and its application in the construction sector, more attention has been paid to buildings’ design for adaptability (DfA) towards the realization of circular buildings. DfA is considered a key enabler for other circular design strategies such as design for disassembly (DfD), multi-functionality, spatial transformability, and design reversibility. However, implementation and assessment frameworks, and design-support tools for the circular building, are still in development as the characterization of circular buildings continues with endeavors to draw a defined shape by identifying the prerequisites for circularity where the design takes an important place. For the sake of objectifying the role of DfA in circularity frameworks in buildings, this paper carries out an analytical review and discussion on two types of assessment and design-support frameworks; the first addresses adaptability criteria and considerations in assessment frameworks that handle the concept individually while the second classifies existing circularity assessment endeavors into four main categories under which multiple tools are reviewed. A reflection on the scope and objectives for both types is later performed, illustrating the state of adaptability evaluation and criteria as well as its role in circularity frameworks. Results show that the concept of building adaptability lacks quantitative methods that quantify a building’s capacity to adapt as well as empirical data that prioritize the most valuable criteria facilitating adaptations. Moreover, many circularity assessment frameworks fail to consider adaptability criteria at all hierarchal levels of a building composition. To address this shortcoming, a series of conceptual considerations and requirements is proposed towards a potential establishment of an inclusive framework of a circularity design-support tool in buildings. The study is concluded by identifying gaps and recommendations for further developments in the field.

In the past decade, resilient cities (RCs) have gained extensive attention in academic and political debates as a vision of urban futures. In particular, with the support of the Rockefeller Foundation’s Resilient City 100 Program (RC100), a number of cities worldwide have pushed this concept forward from theory to practice through their RC plans/strategies. However, there is widespread doubt regarding how much this holistic idea of the future built environment contributes to urban practice. After developing a scoring evaluation matrix based on the synthesis of existing RC assessment frameworks, this review scrutinizes the plans, reports, city leaders’ speeches, official websites and academic reviews of five representative resilient cities and investigates their motivations, planning and achievements. The results demonstrate a huge theoretical and practical gap in RC: while RC plans attempt to expand as comprehensively as possible from cities’ initially narrow motivations, their achievements in implementation are limited. Although RC provides more holistic solutions to the cities, the limited resources mean that cities have to prioritize their urgent issues in their everyday practice. This paper calls for designating more feasible and specific features in RC visions and maintaining regular alignments from planning to actions in future RC practice.

A framework for risk assessment due to inland waterway transportation of dangerous goods is designed based on all possible event types that may be caused by the inland transportation of dangerous goods. The objective of this study is to design a framework for calculating the risks associated with changes in the transportation of dangerous goods along inland waterways. The framework is based on the traditional definition of risk and is designed for sensitive riverside environmental conditions in inland waterways. From the perspective of transportation management, this paper introduced the concept of transportability of dangerous goods and constructed a transportability assessment framework, which consists of a multi-index evaluation system and a single metric model. The result of the assessment is as an auxiliary basis to determine the transportation permit and control intensity of dangerous goods in an inland waterway specific voyage. The methodology is illustrated using a case study of transporting fireworks in the Yangtze River.

This article analyzes the pilot study and first results of a test of history that has been conceived and designed as a possible model to assess historical thinking skills of students at the end of compulsory secondary education. The article provides a brief presentation of the assessment framework and explains how historical thinking concepts, such as "empathy", can be developed into measurable skills. The pilot study was conducted in two phases which have involved around 800 students aged between 16 and 18 years old. The results of the first phase, with 316 students’ answers that have been analyzed statistically according to the Item Response Theory (IRT), allow us to expect that the test can be an appropriate tool to assess students’ historical thinking and to distinguish scales of levels of achievement in the major historical competences.

Open data are currently a hot topic and are associated with realising ambitions such as a more transparent and efficient government, solving societal problems, and increasing economic value. To describe and monitor the state of open data in countries and organisations, several open data assessment frameworks were developed. Despite high scores in these assessment frameworks, the actual (re)use of open government data (OGD) fails to live up to its expectations. Our review of existing open data assessment frameworks reveals that these only cover parts of the open data ecosystem. We have developed a framework, which assesses open data supply, open data governance, and open data user characteristics holistically. This holistic open data framework assesses the maturity of the open data ecosystem and proves to be a useful tool to indicate which aspects of the open data ecosystem are successful and which aspects require attention. Our initial assessment in the Netherlands indicates that the traditional geographical data perform significantly better than non-geographical data, such as healthcare data. Therefore, open geographical data policies in the Netherlands may provide useful cues for other OGD strategies.

The aims of this paper are: to provide a comprehensive introduction to eDia, an online diagnostic assessment system; to show how the use of technology can contribute to solve certain crucial problems in education by supporting the personalization of learning; and to offer a general reference for further eDia-based studies. The primary function for which the system is designed is to provide regular diagnostic feedback in three main domains of education, reading, mathematics, and science, from the beginning of schooling to the end of the 6 years of primary education. The cognitive foundations of the system, the assessment frameworks, are based on a three-dimensional approach in each domain, distinguishing the psychological (reasoning), the application, and the disciplinary (curricular content) dimensions of learning. The frameworks have been carefully mapped into item banks containing over a 1,000 innovative (multimedia-supported) items in each dimension. The online assessments were piloted, and the system has been operating in experimental mode in over 1,000 schools for several years. This paper outlines the theoretical foundations of the eDia system and summarizes how results from research on the cognitive sciences, learning and instruction, and technology-based assessment have been integrated into a working system designed to assess a large population of students. The paper describes the main functions of eDia and discusses how it supports item writing, constructing tests, online test delivery, automated scoring, data processing, scaling and the provision of feedback both for students and teachers. It shows how diagnostic assessments can be implemented in school practice to facilitate differentiated instruction through regular measurements and to provide instruments for teachers to make formative assessments. Beyond its main function (supporting development toward personalizing education), the eDia platform has been used for assessments in a number of areas from pre-school to higher education both in Hungary and in a number of other countries as well. The paper also reviews results from eDia-based studies and highlights how technology-based assessment extends the possibilities of educational research by making more constructs measurable.

As organisations are vulnerable to cyberattacks, their protection becomes a significant issue. Capability Maturity Models can enable organisations to benchmark current maturity levels against best practices. Although many maturity models have been already proposed in the literature, a need for models that integrate several regulations exists. This article presents a light, web-based model that can be used as a cybersecurity assessment tool for Higher Education Institutes (HEIs) of the United Kingdom. The novel Holistic Cybersecurity Maturity Assessment Framework incorporates all security regulations, privacy regulations, and best practices that HEIs must be compliant to, and can be used as a self assessment or a cybersecurity audit tool.

Over decades the concept of integration has been promoted to enhance alignment between policy domains, and to manage trade-offs and maximize synergies across management practices. Integrated approaches have the potential to enable better outcomes for flood risk management (FRM) and society as a whole. However, achieving integration in practice is a recurring challenge, especially for FRM where multiple actors need to work together across fragmented policy domains. To disentangle this complexity of integration, a framework is proposed for assessing integration and identifying different degrees of integration. This framework is based on evidence from a literature review, 50 interviews with FRM-related professionals in England, and participant observation at 24 meetings relevant for FRM. The framework sets out the context of integration, assesses the governance capacity for integration through the strength of relationships between different types of actors (bridging, bonding, and linking) and the mechanisms (actor-, rule- and resource-based) that influence them, and the realization of integration in practice through knowledge, policies, and interventions. The framework is applied for FRM in England and used to identify degrees of integration: high, intermediate, low, and minimal. An important characteristic of the framework is the interconnectivity between the governance capacity and realization of integration. The framework provides further theoretical insights into the concept of integration, while offering an approach for researchers, policy makers, and practitioners to recognize current degrees of integration in FRM and identify the critical elements for improvement. It is recommended that further research and practice-based applications of the framework are completed in different geographical and institutional contexts. Specifically, such applications can create further understanding of the interactions and dependencies between elements of the governance capacity and realization of integration.

The design of the green infrastructure in urban areas largely ignores how people's relation to nature, or human-nature connection (HNC), can be nurtured. One practical reason for this is the lack of a framework to guide the assessment of where people, and more importantly children, experience significant nature situations and establish nature routines. This paper develops such a framework. We employed a mixed-method approach to understand what qualities of nature situations connect children to nature (RQ1), what constitutes children's HNC (RQ2), and how significant nature situations and children's HNC relate to each other over time (RQ3). We first interviewed professionals in the field of connecting children to nature (N = 26), performed inductive thematic analysis of these interviews, and then further examined the inductive findings by surveying specialists (N = 275). We identified 16 qualities of significant nature situations (e.g., “awe,” “engagement of senses,” “involvement of mentors”) and 10 abilities that constitute children's HNC (e.g., “feeling comfortable in natural spaces,” “feeling attached to natural spaces,” “taking care of nature”). We elaborated three principles to answer our research questions: (1) significant nature situations are various and with differing consequences for children's HNC; (2) children's HNC is a complex embodied ability; (3) children's HNC progresses over time through diverse nature routines. Together, these findings form the Assessment framework for Children's Human Nature Situations (ACHUNAS). ACHUNAS is a comprehensive framework that outlines what to quantify or qualify when assessing “child-nature connecting” environments. It guides the assessment of where and how children connect to nature, stimulating both the design of nature-connecting human habitats as well as pedagogical approaches to HNC.

Can we match formal procedures for quality assurance with the creativity and individuality that defines honours? In a session at the Utrecht Honours Conference 2016: Honours Futures we discussed experiences in quality assurance of honours programmes in the United States of America, the Netherlands and Belgium. To illustrate the possibilities, a case study of using an external audit for honours education and two case studies of the use of internal quality assurance tools in an honours programme were presented. It is concluded that a form of quality assurance is needed to continuously improve. So honours educators must at least care for internal quality control. Student involvement is stimulating for the engagement of all participants in the process of quality control. Internal quality control may result in an annual report. Annual reports can be used both internally and in external quality control.

Open data are currently a hot topic and are associated with realising ambitions such as a more transparent and efficient government, solving societal problems and increasing economic value. To describe and monitor the state of open data in countries and organisations, several open data assessment frameworks were developed. Despite high scores in these assessment frameworks, the actual (re)use of open government data fails to live up to its expectations. Our review of existing open data assessment frameworks reveals that these only cover parts of the open data ecosystem. We have developed a framework, which assesses open data supply, open data governance and open data user characteristics holistically. This holistic open data framework assesses the maturity of the open data ecosystem and proves to be a useful tool to indicate which aspects of the open data ecosystem are successful and which aspects require attention. Our initial assessment in the Netherlands indicates that the traditional geographical data perform significantly better than non-geographical data, such as healthcare data. Therefore, open geographical data policies in the Netherlands may provide useful cues for other open government data strategies.