AI summary · arXiv: 2303.03235v1 · cs.HC

On the Visualisation of Argumentation Graphs to Support Text Interpretation

Hanadi Mardah, Oskar Wysocki, Markel Vigo, Andre Freitas
Original paper Submitted to arXiv on 06 Mar. 2023 35 pages License: CC BY-NC-SA 4.0

How to read this summary? Illustrated guide

The essentials

  • Recent advancements in Natural Language Processing (NLP) methods, particularly in argumentation mining, have the potential to revolutionize text interaction and analysis of complex discourse and debates.
  • A study investigated whether a graphic visualization of complex argumentation could enable a more critical interpretation of arguments.
  • The study presented 10 argument topics in two models: PTM (text-based model) and a 2D AGM (structured representation of an argument).
  • The structured modality (2D AGM) significantly outperformed the text-based one (PTM) in terms of attractiveness, perspicuity, efficiency, dependability, and stimulation.
  • Participants found it easier to interpret arguments using AGs than textual representations.
  • Participants chose more critical questions when they were less familiar with the topic being discussed.
  • There is a trade-off between time spent interpreting an argument and critical interpretation; while introducing a temporal overhead, the additional structure forces users to be more critical and systematic when judging the quality of an argument.
  • Both models had similar effects on working memory.
  • The study's limitations include its small sample size (25 participants), which may not be representative enough to generalize its findings across different populations or tasks.
  • Future studies are needed to understand how humans critically interpret complex arguments or debates better.
  • Visualizing complex argumentation through 2D AGMs can support critical interpretations of arguments; especially for unfamiliar topics.
  • The study's findings have implications for designing more effective tools and methods to support critical interpretation processes in various domains including education journalism and law.
  • Future studies should aim to validate these results and examine their influence on different populations tasks and settings.

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: Argumentation Mining Natural Language Processing Graphic Visualization Critical Interpretation Empirical Evidence

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
The recent advancements in Natural Language Processing (NLP) methods, particularly in the field of argumentation mining, have the potential to revolutionize the way we interact with text and support the interpretation and analysis of complex discourse and debates. This study aimed to investigate whether a graphic visualization of complex argumentation could enable a more critical interpretation of arguments. The study presented 10 argument topics in two models: PTM (text-based model) and a 2D AGM (structured representation of an argument). The evaluation process for these models was based on task-related constructs such as time spent, working memory effort, workload, and user experience. The results showed that the structured modality (2D AGM) significantly outperformed the text-based one (PTM) in terms of attractiveness, perspicuity, efficiency, dependability, and stimulation. The participants also found it easier to interpret arguments using AGs than textual representations. Interestingly, participants chose more critical questions (CQs) when they were less familiar with the topic being discussed. This finding suggests that AG schemes can be supportive of the interpretation process for unfamiliar topics. The study also confirmed that there is a trade-off between time spent interpreting an argument and critical interpretation; while introducing a temporal overhead, the additional structure forces users to be more critical and systematic when judging the quality of an argument. Furthermore, both models had similar effects on working memory. The study's limitations include its small sample size (25 participants), which may not be representative enough to generalize its findings across different populations or tasks. Additionally, while this study provides empirical evidence supporting AGs' effectiveness in supporting critical interpretation processes for complex arguments or debates compared to text-based models like PTMs; future studies are needed to understand how humans critically interpret complex arguments or debates better. In conclusion, this study demonstrated that visualizing complex argumentation through 2D AGMs can support critical interpretations of arguments; especially for unfamiliar topics. The study's findings have implications for designing more effective tools and methods to support critical interpretation processes in various domains including education journalism and law. Future studies should aim to validate these results and examine their influence on different populations tasks and settings.

Was this synthesis useful?

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 3 free rewrites left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero
Citation alerts Citation alerts guide
Journal club Premium+ Slides to present it

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Related
    GraphiMind: LLM-centric Interface for Information Graphics Design
    Qirui Huang, Min Lu, Joel Lanir et al. · 2024 · Human-Computer Interaction · AI summary available
    Abstract

    Information graphics are pivotal in effective information dissemination and storytelling. However, creating such graphics is extremely challenging for non-professionals, since the design process requires multifaceted skills and comprehensive knowledge. Thus, despite the many available authoring tools, a significant gap remains in enabling non-experts to produce compelling information graphics seamlessly, especially from scratch. Recent breakthroughs show that Large Language Models (LLMs), especially when tool-augmented, can autonomously engage with external tools, making them promising candidates for enabling innovative graphic design applications. In this work, we propose a LLM-centric inte…

  2. Related
    A Preliminary Roadmap for LLMs as Assistants in Exploring, Analyzing, and Visualizing Knowledge Graphs
    Harry Li, Gabriel Appleby, Ashley Suh · 2024 · Human-Computer Interaction · AI summary available
    Abstract

    We present a mixed-methods study to explore how large language models (LLMs) can assist users in the visual exploration and analysis of knowledge graphs (KGs). We surveyed and interviewed 20 professionals from industry, government laboratories, and academia who regularly work with KGs and LLMs, either collaboratively or concurrently. Our findings show that participants overwhelmingly want an LLM to facilitate data retrieval from KGs through joint query construction, to identify interesting relationships in the KG through multi-turn conversation, and to create on-demand visualizations from the KG that enhance their trust in the LLM's outputs. To interact with an LLM, participants strongly pre…

  3. Related
    Ask and You Shall Receive (a Graph Drawing): Testing ChatGPT's Potential to Apply Graph Layout Algorithms
    Sara Di Bartolomeo, Giorgio Severi, Victor Schetinger et al. · 2023 · Human-Computer Interaction · Not summarized yet
    Abstract

    Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context, we are interested in exploring the application of LLMs to graph drawing algorithms by performing experiments on ChatGPT. These algorithms are used to improve the readability of graph visualizations. The probabilistic nature of LLMs presents challenges to implementing algorithms correctly, but we believe that LLMs' ability to learn from vast amounts of data and apply complex operations may lead to interesting graph drawing results. For example, we could en…

  4. Related
    Innovative Digital Storytelling with AIGC: Exploration and Discussion of Recent Advances
    Rongzhang Gu, Hui Li, Changyue Su et al. · 2023 · Human-Computer Interaction · AI summary available
    Abstract

    Digital storytelling, as an art form, has struggled with cost-quality balance. The emergence of AI-generated Content (AIGC) is considered as a potential solution for efficient digital storytelling production. However, the specific form, effects, and impacts of this fusion remain unclear, leaving the boundaries of AIGC combined with storytelling undefined. This work explores the current integration state of AIGC and digital storytelling, investigates the artistic value of their fusion in a sample project, and addresses common issues through interviews. Through our study, we conclude that AIGC, while proficient in image creation, voiceover production, and music composition, falls short of repl…

  5. Related
    explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
    Thilo Spinner, Udo Schlegel, Hanna Schäfer et al. · 2019 · IEEE Transactions on Visualization and Computer Graphics (2019) · AI summary available
    Abstract

    We propose a framework for interactive and explainable machine learning that enables users to (1) understand machine learning models; (2) diagnose model limitations using different explainable AI methods; as well as (3) refine and optimize the models. Our framework combines an iterative XAI pipeline with eight global monitoring and steering mechanisms, including quality monitoring, provenance tracking, model comparison, and trust building. To operationalize the framework, we present explAIner, a visual analytics system for interactive and explainable machine learning that instantiates all phases of the suggested pipeline within the commonly used TensorBoard environment. We performed a user-s…

  6. Related
    Exploring the Roles of NLP-based Dialog Indicators in Predicting User Experience in interacting with Large Language Model System
    Eason Chen · 2024 · Human-Computer Interaction · Not summarized yet
    Abstract

    The use of Large Language Models for dialogue systems is rising, presenting a new challenge: how do we assess users' chat experience in these systems? Leveraging Natural Language Processing (NLP)-powered dialog analyzers to create dialog indicators like Coherence and Emotion has the potential to predict the chat experience. In this paper, we proposed a conceptual model to explain the relationship between the dialog indicators and various factors related to the chat experience, such as users' intentions, affinity toward dialog agents, and prompts of the agents' characters. We evaluated the conceptual model using PLS-SEM with 120 participants and found it well fit. Our results suggest that dia…

  7. Related
    KG4Vis: A Knowledge Graph-Based Approach for Visualization Recommendation
    Haotian Li, Yong Wang, Songheng Zhang et al. · 2021 · Human-Computer Interaction · AI summary available
    Abstract

    Visualization recommendation or automatic visualization generation can significantly lower the barriers for general users to rapidly create effective data visualizations, especially for those users without a background in data visualizations. However, existing rule-based approaches require tedious manual specifications of visualization rules by visualization experts. Other machine learning-based approaches often work like black-box and are difficult to understand why a specific visualization is recommended, limiting the wider adoption of these approaches. This paper fills the gap by presenting KG4Vis, a knowledge graph (KG)-based approach for visualization recommendation. It does not require…

  8. Related
    Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making
    Shuai Ma, Qiaoyi Chen, Xinru Wang et al. · 2024 · Human-Computer Interaction · AI summary available
    Abstract

    In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole. In such a paradigm, humans are found to rarely trigger analytical thinking and face difficulties in communicating the nuances of conflicting opinions to the AI when disagreements occur. To tackle this challenge, we propose Human-AI Deliberation, a novel framework to promote human reflection and discussion on conflicting human-AI opinions in decision-making. Based on theories in human deliberation, this framework engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates. To empower AI with deliberative capabilitie…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

For now only among the papers summarized on this site: search again to add the prior work, the follow-ups and Semantic Scholar’s recommendations.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.