Back to Search Start Over

ConvXAI: a System for Multimodal Interaction with Any Black-box Explainer.

Authors :
Malandri, Lorenzo
Mercorio, Fabio
Mezzanzanica, Mario
Nobani, Navid
Source :
Cognitive Computation; Mar2023, Vol. 15 Issue 2, p613-644, 32p
Publication Year :
2023

Abstract

Several studies have addressed the importance of context and users' knowledge and experience in quantifying the usability and effectiveness of the explanations generated by explainable artificial intelligence (XAI) systems. However, to the best of our knowledge, no component-agnostic system that accounts for this need has yet been built. This paper describes an approach called ConvXAI, which can create a dialogical multimodal interface for any black-box explainer by considering the knowledge and experience of the user. First, we formally extend the state-of-the-art conversational explanation framework by introducing clarification dialogue as an additional dialogue type. We then implement our approach as an off-the-shelf Python tool. To evaluate our framework, we performed a user study including 45 participants divided into three groups based on their level of technology use and job function. Experimental results show that (i) different groups perceive explanations differently; (ii) all groups prefer textual explanations over graphical ones; and (iii) ConvXAI provides clarifications that enhance the usefulness of the original explanations. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
18669956
Volume :
15
Issue :
2
Database :
Complementary Index
Journal :
Cognitive Computation
Publication Type :
Academic Journal
Accession number :
163334670
Full Text :
https://doi.org/10.1007/s12559-022-10067-7