Search

Intelligent applications are highly susceptible to uncertainty and inconsistency due to the intense and intricate interactions among their autonomous components (or agents), making their verification theoretically and practically challenging. This paper presents the design and implementation of a new open-source and scalable software tool for modeling and verifying intelligent applications with commitment and trust protocols under both uncertainty and inconsistency settings, using reduction-based multi-valued model checking techniques. The proposed tool is equipped with original and novel algorithms that transform our logics of multi-valued commitment (mv-CTLC) and multi-value trust (mv-TCTL) that we recently introduced to their classical two-valued commitment (CTLC) and trust (TCTL) logic versions as well as to Computational Tree Logic (CTL). Moreover, the tool transforms the mv-CTL to CTL, and it is applicable for the classical model checking by transforming the classical logics of trust and commitment to CTL. To demonstrate the practicality and applicability of the proposed tool in real settings, we present and report experimental results over two blockchain-based applications in the healthcare domain. Finally, we provide discussions and comparisons between the proposed approaches regarding scalability and efficiency. Moreover, we provide packages of more than 11 experiments, including the ones we conduct in this paper and enhanced experiments from previous works. Our findings ensure that the proposed approaches and the software tool that implements them are highly efficient and scalable, giving accurate results under varying conditions. • Design and implementation of an open-source scalable tool for systems model checking. • System modeling with multi-valued logic capturing uncertainty and inconsistency. • Practical demonstration using blockchain-based applications in healthcare domain. • Extensive experiments showing scalability, efficiency and reliability of the tool. [ABSTRACT FROM AUTHOR]

Post-hoc explaining approaches for deep learning (DL) models has attracted much attention in safety–critical applications such as rotating machinery intelligent fault diagnosis (IFD). However, with the help of the explanation techniques, the models are still fragile to domain shifts caused by varying speeds and loads without help for improving their cross-domain performance. Since humans in the decision-making loop are essential for a reliable diagnostic system to determine the reliability of diagnosis, this paper proposes a causal explaining guided domain generalization (CXDG) method to realize trust worthy IFD with human in the decision loop. Specifically, an explaining model is trained with the conditional mutual information, which is a causal strength metric, and utilized to tell the causal features in the input data as the attributions of the diagnostic model. A translation process of the attributions is proposed to make the explaining process understandable. Furthermore, the aim of this paper is not only explaining but also beyond that the diagnostic model is guided to focus on the causal features to improve its generalization ability in unseen domains. The effectiveness of the method is validated on two experiment datasets. The results show that the proposed method can both explain the attributions of the diagnosis model and be beneficial to the generalization ability. [ABSTRACT FROM AUTHOR]

Artificial Intelligence (AI) has become pervasive, enabling transformative advancements in various industries including smart city, smart healthcare, smart manufacturing, smart virtual world and the Metaverse. However, concerns related to risk, trust, and security are emerging with the increasing reliance on AI systems. One of the most beneficial and original solutions for ensuring the reliability and trustworthiness of AI systems is AI Trust, Risk and Security Management (AI TRiSM) framework. Despite being comparatively new to the market, the framework has demonstrated already its effectiveness in various products and AI models. It has successfully contributed to fostering innovation, building trust, and creating value for businesses and society. Due to the lack of systematic investigations in AI TRiSM, we carried out a comprehensive and detailed review to bridge the existing knowledge gaps and provide a better understanding of the framework from both theoretical and technical standpoints. This paper explores various applications of the AI TRiSM framework across different domains, including finance, healthcare, and the Metaverse. Futhermore, the paper discusses the obstacles related to implementing AI TRiSM framework, including adversarial attacks, the constantly changing landscape of threats, ensuring regulatory compliance, addressing skill gaps, and acquiring expertise in the field. Finally, it explores the future directions of AI TRiSM, emphasizing the importance of continual adaptation and collaboration among stakeholders to address emerging risks and promote ethical and enhanced overall security bearing for AI systems. [ABSTRACT FROM AUTHOR]

The significant proliferation of AI-empowered systems and machine learning (ML) across various examined domains underscores the vital necessity for comprehensive and customised explainability frameworks to lead to usable and trustworthy systems. Especially in the medical domain, where validation of methodologies and outcomes is as important as the adoption rate of such systems, the requirements of the depth and the level of abstraction of the explainability are particularly important and necessitate a systemic approach to ensure a proper definition. Explainability and interpretability are important usability and trustworthiness properties of AI-empowered systems and, as such, constitute important factors for technology acceptance. In this paper, we propose a novel framework for explainability requirements in AI-empowered systems using the Technology Acceptance Model (TAM). This framework employs targeted ML (hierarchical clustering, k-means or other) to acquire a user model for personalised, multi-layered explainability. Our novel framework integrates a rule-based system, which guides the degree of trustworthiness to be achieved based on user perception and AI literacy level. We test this methodology in the case of AI-empowered medical systems to (1) assess and quantify the doctors' abilities and familiarisation with technology and AI, (2) generate layers of personalised explainability based on user ability and user needs in terms of trustworthiness and (3) provide the necessary environment for transparency and validation. To assess and quantify the doctors' abilities we have considered Rapid Estimate of Adult Literacy in Medicine (REALM) a tool commonly used in the medical domain to bridge the communication gap between patients and doctors. • Framework for personalised explainability in Artificial intelligence, based on Levels. • Levels refer to AI literacy level and level of abstraction. • Behavioural models were used that measure perception towards an innovation. • Framework is evaluated and implemented in an AI-empowered medical application. [ABSTRACT FROM AUTHOR]

The purpose of this paper is to propose a novel hybrid framework for evaluating and benchmarking trustworthy artificial intelligence (AI) applications in healthcare by using multi-criteria decision-making (MCDM) techniques under a new fuzzy environment. To develop such a framework, a new decision matrix has been built, and then integrated with q-ROF2TL-FWZIC (q‐Rung Orthopair Fuzzy 2‐Tuple Linguistic Fuzzy-Weighted Zero-Inconsistency) and q-ROF2TL-CODAS (q‐Rung Orthopair Fuzzy 2‐Tuple Linguistic Combinative Distance-Based Assessment). In this integration, q-ROF2TL-FWZIC is utilized for assigning the weights of evaluation attributes of trustworthy AI, while q-ROF2TL-CODAS is employed for benchmarking trustworthy AI applications. Findings show that the q-ROF2TL-FWZIC method effectively weights the evaluation attributes. The transparency attribute receives the highest importance weight (0.173566825), whereas the human agency and oversight criterion has the lowest weight (0.105741901). The remaining attributes are distributed in between. Moreover, alternative_4 receives the highest rank order (score of 7.370410417), while alternative_13 receives the lowest rank order (score of −4.759794397). To evaluate the validity of the proposed framework, systematic ranking and sensitivity analysis assessments were employed. [ABSTRACT FROM AUTHOR]

To deal with increasing amounts of data, decision and policymakers frequently turn to advances in machine learning and artificial intelligence to capitalise on the potential reward. But there is also a reluctance to trust black-box models, especially when such models are used to support decisions and policies that affect people directly, like those associated with transport and people's mobility. Recent developments focus on explainable artificial intelligence to bolster models' trustworthiness. In this paper, we demonstrate the use of an explainable-by-design model, Bayesian Networks, on travel behaviour. The model incorporates various demographic and socioeconomic variables to describe full day activity chains: activity and mode choice, as well as the activity and trip durations. More importantly, this paper shows how the model can be used to provide the most relevant explanation for people's observed travel behaviour. The overall goal is to show that model explanations can be quantified and, therefore, assist policymakers to truly make evidence-based decisions. This goal is achieved through two case studies to explain people's vulnerability as it pertains to their total trip duration. • Bayesian network approach to demonstrate explainable artificial intelligence (XAI). • Network structure includes demographic, travel and temporal variables. • Bayesian networks is both behaviourally rich and intuitively interpretable. • Quantify vulnerability explanations for travel behaviour. [ABSTRACT FROM AUTHOR]

Current Artificial Intelligence (AI) technologies are widely regarded as black boxes, whose internal structures are not inherently transparent, even though they provide powerful prediction capabilities. Having a transparent model that enables users to understand its inner workings allows them to appreciate the learning and inference process, leading to trust and higher confidence in the model. While methods that help with interpretability have been created, most of them require the user to have a certain level of AI knowledge and do not allow a user to fine-tune them based on prior knowledge. In this paper, we present a smart interpretable model (SIM) framework that requires little to no AI knowledge and can be used to create a set of fuzzy IF-THEN rules along with its corresponding membership functions at ease. The framework also allows users to incorporate prior knowledge during various steps in the framework and generates comprehensive insights summarized from rules and samples, allowing users to identify anomalous rules, feature contributions of each sample and confidence level for each rule. We demonstrate these capabilities and compare our model to other existing rule-based models using various datasets that have been used for rule-based model validations. Validations are then done in terms of performance and whether the rules that are generated by SIM are similar to the rules generated by other more recent rule-based models. • Framework that requires little to no AI knowledge. • Facilitates creation of a set of fuzzy IF-THEN rules. • Allows subject matter experts (SME) to incorporate prior knowledge. • Generates comprehensive insights summarized from rules and samples. • Validation on benchmark datasets to state-of-the art models yields compatible results. [ABSTRACT FROM AUTHOR]