AI summary · arXiv: 1705.09585v1 · cs.CL
Detecting and Explaining Crisis
The essentials
- Individuals on social media may reveal themselves to be in various states of crisis such as suicide, self-harm, abuse, or eating disorders.
- Detecting these crises automatically and accurately can have profound consequences for mental health professionals who can use these techniques to identify individuals who may be in need of support or intervention based on their online behavior.
- The authors propose an explanation as a coherent, concise subset of the text that rationalizes the crisis detection.
- To achieve this goal, they explore several methods to detect and explain crises using a combination of neural and non-neural techniques.
- The authors evaluate these techniques on a unique dataset obtained from Koko, an anonymous emotional support network available through various messaging applications.
- They annotate a small subset of the samples labeled with crisis with corresponding explanations.
- The authors find that their best technique significantly outperforms the baseline for both detection and explanation of crises in social media text.
- Overall, this study highlights the importance of combining machine learning techniques with human expertise to improve our understanding and response to mental health crises in digital spaces.
Key points written by AI: they may contain errors, check them against the paper.
Ask questions about this paper to our AI assistant
How to chat with this paper? Illustrated guide
You can also chat with multiple papers at once here.
Keep this conversation — a free account saves your questions and answers, your collections of papers and your alerts.
Continue with Google Create a free accountTools for this paper
Advanced tools Premium
For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium
Papers around this one
See them on a mapRanked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
Recognizing Social Cues in Crisis SituationsDi Wang, Yuan Zhuang, Ellen Riloff et al. · 2024 · International Conference on Language Resources and Evaluation · cited 2 times · Not summarized yet
Abstract
During crisis situations, observations of other people’s behaviors often play an essential role in a person’s decision-making. For example, a person might evacuate before a hurricane only if everyone else in the neighborhood does so. Conversely, a person might stay if no one else is leaving. Such observations are called social cues. Social cues are important for understanding people’s response to crises, so recognizing them can help inform the decisions of government officials and emergency responders. In this paper, we propose the first NLP task to categorize social cues in social media posts during crisis situations. We introduce a manually annotated dataset of 6,000 tweets, labeled with r…
-
Let’s explain crisis: deep multi-scale hierarchical attention framework for crisis-task identificationS. Priya, V. Joshi, Joydeep Chandra · 2024 · Journal of Supercomputing · cited 3 times · Not summarized yet
Abstract
Emergency services rely heavily on Twitter for early detection of crisis tasks to enhance crisis management systems. However, employing state-of-the-art models often face data sparsity as well as their inadequacy to handle long-range dependencies between tweet tokens. Additionally, the authorities need to gain confidence in the model’s prediction so that the detected task information can be better believed and prioritized. In this study, we present a generalized framework named explainable attentive model for crisis task identification (ExACT) to handle the above mentioned challenges, while identifying crisis task relevant tweets as well as provide the model explainability by utilizing a ver…
-
Learning Faithful Attention for Interpretable Classification of Crisis-Related Microblogs under Constrained Human BudgetThi Huyen Nguyen, Koustav Rudra · 2023 · The Web Conference · cited 7 times · Not summarized yet
Abstract
The recent widespread use of social media platforms has created convenient ways to obtain and spread up-to-date information during crisis events such as disasters. Time-critical analysis of crisis data can help human organizations gain actionable information and plan for aid responses. Many existing studies have proposed methods to identify informative messages and categorize them into different humanitarian classes. Advanced neural network architectures tend to achieve state-of-the-art performance, but the model decisions are opaque. While attention heatmaps show insights into the model’s prediction, some studies found that standard attention does not provide meaningful explanations. Altern…
-
Clustering of Social Media Messages for Humanitarian Aid Response during CrisisSwati Padhee, T. K. Saha, Joel R. Tetreault et al. · 2020 · arXiv.org · preprint, not peer reviewed · cited 6 times · Not summarized yet
Abstract
Social media has quickly grown into an essential tool for people to communicate and express their needs during crisis events. Prior work in analyzing social media data for crisis management has focused primarily on automatically identifying actionable (or, informative) crisis-related messages. In this work, we show that recent advances in Deep Learning and Natural Language Processing outperform prior approaches for the task of classifying informativeness and encourage the field to adopt them for their research or even deployment. We also extend these methods to two sub-tasks of informativeness and find that the Deep Learning methods are effective here as well.
-
The establishment and evaluation of the automatic crisis balance analysis model for social network users based on artificial intelligence technologyShengxin Hu, Qing Wang, Lu Chen et al. · 2021 · International Symposium on Artificial Intelligence in Medical Sciences · Not summarized yet
Abstract
Online social media provides people with a platform to express their emotions anonymously. Social media has been identified as an important data source for suicide prevention related to emotional problems in China. Almost Three million messages were published by 450,000 users in a particular Chinese social media data base. This study aims to develop a Crisis Balance Analysis Model based on concepts of "balancing factors" as described by Aguilera. Through interactions with psychological experts, deep learning architecture that was built and refined. Three annotation levels free annotations (zero cost), easy annotations (by psychology students), and hard annotations (by psychology experts) wer…
-
Source-Aware Crisis-Relevant Tweet Identification and Key Information SummarizationXiaodong Ning, Li-Na Yao, B. Benatallah et al. · 2019 · ACM Trans. Internet Techn. · cited 10 times · Not summarized yet
Abstract
Twitter is an important source of information that people frequently contribute to and rely on for emerging topics, public opinions, and event awareness. Crisis-relevant tweets can potentially avail a magnitude of applications such as helping authorities and governments become aware of situations and thus offer better responses. One major challenge toward crisis-awareness in Twitter is to identify those tweets that are relevant to unseen crises. In this article, we propose an automatic labeling approach to distinguishing crisis-relevant tweets while differentiating source types (e.g., government or personal accounts) simultaneously. We first analyze and identify tweet-specific linguistic, se…
-
Learning to classify emotional content in crisis-related tweetsJ. Brynielsson, F. Johansson, Anders Westling · 2013 · 2013 IEEE International Conference on Intelligence and Security Informatics · cited 22 times · Not summarized yet
-
An Explainable AI Approach to Detecting Linguistic Markers of Mental Health Risk in Toxic Online DiscourseAnilson Monteiro, Sebasti˜ao Pais, Farzaneh Lashgari et al. · 2025 · 2025 IEEE International Conference on Data Mining Workshops (ICDMW) · Not summarized yet
Abstract
Online aggression, including cyberbullying and hate speech, is a significant public health concern, contributing to adverse mental health outcomes such as depression, anxiety, and suicidal ideation among social media users, and typically manifests in subtle and context-sensitive forms, such as sarcasm, emojis, and coded messages. These offensive remarks currently plague machine learning-based detection models since they are founded on one-layer linguistic features and have low interpretability. This research proposes a modular and interpretable model that unifies four linguistic dimensions, lexical, syntactic, semantic, and emotional, within a single framework for toxic language detection. W…
Prior work it builds on
-
Toward Macro-Insights for Suicide Prevention: Analyzing Fine-Grained Distress at ScaleC. Homan, R. Johar, Tong Liu et al. · 2014 · CLPsych@ACL · cited 69 times · Not summarized yet
Abstract
Suicide is a leading cause of death in the United States. One of the major challenges to suicide prevention is that those who may be most at risk cannot be relied upon to report their conditions to clinicians. This paper takes an initial step toward the automatic detection of suicidal risk factors through social media activity, with no reliance on self-reporting. We consider the performance of annotators with various degrees of expertise in suicide prevention at annotating microblog data for the purpose of training text-based models for detecting suicide risk behaviors. Consistent with crowdsourcing literature, we found that novice-novice annotator pairs underperform expert annotators and ou…
-
Rationalizing Neural PredictionsTao Lei, R. Barzilay, T. Jaakkola · 2016 · Conference on Empirical Methods in Natural Language Processing · cited 922 times · Not summarized yet
Abstract
Prediction without justification has limited applicability. As a remedy, we learn to extract pieces of input text as justifications -- rationales -- that are tailored to be short and coherent, yet sufficient for making the same prediction. Our approach combines two modular components, generator and encoder, which are trained to operate well together. The generator specifies a distribution over text fragments as candidate rationales and these are passed through the encoder for prediction. Rationales are never given during training. Instead, the model is regularized by desiderata for rationales. We evaluate the approach on multi-aspect sentiment analysis against manually annotated test cases. …
-
Detecting suicidality on TwitterB. O'Dea, Stephen Wan, P. Batterham et al. · 2015 · Internet Interventions · cited 423 times · Not summarized yet
Abstract
This project was supported in part by funding from the NSW Mental Health Commission and the NHMRC John Cade Fellowship 1056964. PJB and ALC are supported by the NHMRC Early Career Fellowships 1035262 and 1013199.
-
Efficacy of a Web-Based, Crowdsourced Peer-To-Peer Cognitive Reappraisal Platform for Depression: Randomized Controlled TrialR. Morris, Stephen M. Schueller, Rosalind W. Picard · 2015 · Journal of Medical Internet Research · cited 184 times · Not summarized yet
Abstract
Background Self-guided, Web-based interventions for depression show promising results but suffer from high attrition and low user engagement. Online peer support networks can be highly engaging, but they show mixed results and lack evidence-based content. Objective Our aim was to introduce and evaluate a novel Web-based, peer-to-peer cognitive reappraisal platform designed to promote evidence-based techniques, with the hypotheses that (1) repeated use of the platform increases reappraisal and reduces depression and (2) that the social, crowdsourced interactions enhance engagement. Methods Participants aged 18-35 were recruited online and were randomly assigned to the treatment group, “Panopl…
-
“Why Should I Trust You?”: Explaining the Predictions of Any ClassifierMarco Tulio Ribeiro, Sameer Singh, Carlos Guestrin · 2016 · North American Chapter of the Association for Computational Linguistics · cited 25,724 times · AI summary available
Abstract
Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, which is fundamental if one plans to take action based on a prediction, or when choosing whether to deploy a new model. Such understanding also provides insights into the model, which can be used to transform an untrustworthy model or prediction into a trustworthy one. In this work, we propose LIME, a novel explanation technique that explains the predictions of any classifier in an interpretable and faithful manner, by learning an interpretable model locally varound the prediction. We also propose a method to explain mod…
Papers that cite it
-
Deep Knowledge-Infusion For Explainable Depression DetectionSumit Dalal, Sarika Jain, M. Dave · 2024 · arXiv.org · preprint, not peer reviewed · cited 9 times · Not summarized yet
Abstract
Discovering individuals depression on social media has become increasingly important. Researchers employed ML/DL or lexicon-based methods for automated depression detection. Lexicon based methods, explainable and easy to implement, match words from user posts in a depression dictionary without considering contexts. While the DL models can leverage contextual information, their black-box nature limits their adoption in the domain. Though surrogate models like LIME and SHAP can produce explanations for DL models, the explanations are suitable for the developer and of limited use to the end user. We propose a Knolwedge-infused Neural Network (KiNN) incorporating domain-specific knowledge from D…
-
Adapting Deep Learning Methods for Mental Health Prediction on Social MediaIvan Sekulic, M. Strube · 2019 · Conference on Empirical Methods in Natural Language Processing · cited 91 times · Not summarized yet
Abstract
Mental health poses a significant challenge for an individual’s well-being. Text analysis of rich resources, like social media, can contribute to deeper understanding of illnesses and provide means for their early detection. We tackle a challenge of detecting social media users’ mental status through deep learning-based models, moving away from traditional approaches to the task. In a binary classification task on predicting if a user suffers from one of nine different disorders, a hierarchical attention network outperforms previously set benchmarks for four of the disorders. Furthermore, we explore the limitations of our model and analyze phrases relevant for classification by inspecting th…
-
Multi-task learning to detect suicide ideation and mental disorders among social media usersPrasadith Buddhitha, D. Inkpen · 2023 · Frontiers in Research Metrics and Analytics · cited 19 times · Not summarized yet
Abstract
Mental disorders and suicide are considered global health problems faced by many countries worldwide. Even though advancements have been made to improve mental wellbeing through research, there is room for improvement. Using Artificial Intelligence to early detect individuals susceptible to mental illness and suicide ideation based on their social media postings is one way to start. This research investigates the effectiveness of using a shared representation to automatically extract features between the two different yet related tasks of mental illness and suicide ideation detection using data in parallel from social media platforms with different distributions. In addition to discovering t…
-
Deep Learning for Depression Detection of Twitter UsersAhmed Husseini Orabi, Prasadith Buddhitha, Mahmoud Husseini Orabi et al. · 2018 · CLPsych@NAACL-HTL · cited 342 times · Not summarized yet
Abstract
Mental illness detection in social media can be considered a complex task, mainly due to the complicated nature of mental disorders. In recent years, this research area has started to evolve with the continuous increase in popularity of social media platforms that became an integral part of people’s life. This close relationship between social media platforms and their users has made these platforms to reflect the users’ personal life with different limitations. In such an environment, researchers are presented with a wealth of information regarding one’s life. In addition to the level of complexity in identifying mental illnesses through social media platforms, adopting supervised machine l…
-
Identifying Moments of Change from Longitudinal User TextAdam Tsakalidis, F. Nanni, Anthony Hills et al. · 2022 · Annual Meeting of the Association for Computational Linguistics · cited 53 times · Not summarized yet
Abstract
Identifying changes in individuals’ behaviour and mood, as observed via content shared on online platforms, is increasingly gaining importance. Most research to-date on this topic focuses on either: (a) identifying individuals at risk or with a certain mental health condition given a batch of posts or (b) providing equivalent labels at the post level. A disadvantage of such work is the lack of a strong temporal component and the inability to make longitudinal assessments following an individual’s trajectory and allowing timely interventions. Here we define a new task, that of identifying moments of change in individuals on the basis of their shared content online. The changes we consider are…
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
Updated on 6 November 2026.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.