solution 0The researchers conducted two sets of experiments ("Predict the speed-dating outcomes and get up to $6 (takes less than 20 min)" and a similar Prolific experiment) in which participants interacted with the AI system in a task of predicting the outcome of a dating to explore the impact of model explainability and feedback on user trust in AI and prediction accuracy. The results show that although explainability (e.g., global and local interpretation) does not significantly improve trust, feedback can most consistently and significantly improve behavioral trust. However, increased trust does not necessarily lead to the same level of performance gains, i.e., there is a "trust-performance paradox". Exploratory analysis reveals the mechanisms behind this phenomenon.
Q3: How does result feedback and model interpretability affect user task performance?
MIT Licensed | Copyright © 2024-present Zhirong Xue's knowledge base
blog
Xue Zhirong, Designer, Interaction Design, Human-Computer Interaction, Artificial Intelligence, Official Website, Blog, Creator, Author, Engineer, Paper, Product Design, Research, AI, HCI, Design, Learning, Knowledge Base, xuezhirong, UX, Design, Research, AI, HCI, Designer, Engineer, Author, Blog, Papers, Product Design, Study, Learning, User Experience
tool
summary
The Interpretability of Artificial Intelligence and the Impact of Outcome Feedback on Trust: A Comparative Study | Xue Zhirong's knowledge base
solution
User experience
speech
solution
Xue Zhirong is a designer, engineer, and author of several books; Founder of the Design Open Source Community, Co-founder of MiX Copilot; Committed to making the world a better place with design and technology. This knowledge base will update AI, HCI and other content, including news, papers, presentations, sharing, etc.
Xue Zhirong is a designer, engineer, and author of several books; Founder of the Design Open Source Community, Co-founder of MiX Copilot; Committed to making the world a better place with design and technology. This knowledge base will update AI, HCI and other content, including news, papers, presentations, sharing, etc.
Draw inferences
Problem finding
MIT Licensed | Copyright © 2024-present Zhirong Xue's knowledge base
Robots and digital humans
Personal insights
outcome
The Interpretability of Artificial Intelligence and the Impact of Outcome Feedback on Trust: A Comparative Study
The researchers found that although it is generally believed that the interpretability of the model can help improve the user's trust in the AI system, in the actual experiment, the global and local interpretability does not lead to a stable and significant trust improvement. Conversely, feedback (i.e., the output of the results) has a more significant effect on increasing user trust in the AI. However, this increased trust does not directly translate into an equivalent improvement in performance.
Translation
The Interpretability of Artificial Intelligence and the Impact of Outcome Feedback on Trust: A Comparative Study
Q1: How does feedback affect users' trust in AI?
artificial intelligence
Based on large language model generation, there may be a risk of errors.
Q2: Does explainability necessarily enhance users' trust in AI?
A2: Although it is generally believed that the explanatory nature of the model helps to improve user trust, the experimental results show that this enhancement is not significant and not as effective as feedback. In specific cases, such as areas of low expertise, some form of interpretation may result in only a modest increase in appropriate trust.
To assess trust more accurately, the researchers used behavioral trust (WoA), a measure that takes into account the difference between the user's predictions and the AI's recommendations, and is independent of the model's accuracy. By comparing WoA under different conditions, researchers can analyze the relationship between trust and performance.
The Interpretability of Artificial Intelligence and the Impact of Outcome Feedback on Trust: A Comparative Study | Xue Zhirong's knowledge base
Conference
Original address:
thesis
The Interpretability of Artificial Intelligence and the Impact of Outcome Feedback on Trust: A Comparative Study
The Interpretability of Artificial Intelligence and the Impact of Outcome Feedback on Trust: A Comparative Study
outcome
Xue Zhirong, Designer, Interaction Design, Human-Computer Interaction, Artificial Intelligence, Official Website, Blog, Creator, Author, Engineer, Paper, Product Design, Research, AI, HCI, Design, Learning, Knowledge Base, xuezhirong, UX, Design, Research, AI, HCI, Designer, Engineer, Author, Blog, Papers, Product Design, Study, Learning, User Experience
User experience
Q3: How does result feedback and model interpretability affect user task performance?
Problem finding
To assess trust more accurately, the researchers used behavioral trust (WoA), a measure that takes into account the difference between the user's predictions and the AI's recommendations, and is independent of the model's accuracy. By comparing WoA under different conditions, researchers can analyze the relationship between trust and performance.
Personal insights
artificial intelligenceyuzhibolangzi@gmail.com Interactive