Long-form factuality in large language models

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

1. Very close Cites this paper Not relevant

   Investigating Factuality in Long-Form Text Generation: The Roles of Self-Known and Self-Unknown

   Lifu Tu, Rui Meng, Shafiq R. Joty et al. · 2024 · Proceedings of the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP 2025) · cited 5 times · Not summarized yet

   Abstract

   Large language models (LLMs) have demonstrated strong capabilities in text understanding and generation. However, they often lack factuality, producing a mixture of true and false information, especially in long-form generation. In this work, we investigates the factuality of long-form text generation across various large language models (LLMs), including GPT-4, Gemini-1.5-Pro, Claude-3-Opus, Llama-3-70B, and Mistral. Our analysis reveals that factuality tend to decline in later sentences of the generated text, accompanied by a rise in the number of unsupported claims. Furthermore, we explore the effectiveness of different evaluation settings to assess whether LLMs can accurately judge the c…

2. Very close Not relevant

   Fine-tuning Language Models for Factuality

   Katherine Tian, Eric Mitchell, Huaxiu Yao et al. · 2023 · Computation and Language · cited 307 times · AI summary available

   Abstract

   The fluency and creativity of large pre-trained language models (LLMs) have led to their widespread use, sometimes even as a replacement for traditional search engines. Yet language models are prone to making convincing but factually inaccurate claims, often referred to as 'hallucinations.' These errors can inadvertently spread misinformation or harmfully perpetuate misconceptions. Further, manual fact-checking of model responses is a time-consuming process, making human factuality labels expensive to acquire. In this work, we fine-tune language models to be more factual, without human labeling and targeting more open-ended generation settings than past work. We leverage two key recent innov…

3. Very close Cites this paper Uses this paper in depth Not relevant

   Beyond Precision: Importance-Aware Recall for Factuality Evaluation in Long-Form LLM Generation

   Nazanin Jafari, James Allan, M. Iyyer · 2026 · arXiv.org · preprint, not peer reviewed · cited 6 times · Not summarized yet

   Abstract

   Evaluating the factuality of long-form output generated by large language models (LLMs) remains challenging, particularly when responses are open-ended and contain many fine-grained factual statements. Existing evaluation methods primarily focus on precision: they decompose a response into atomic claims and verify each claim against external knowledge sources such as Wikipedia. However, this overlooks an equally important dimension of factuality: recall, whether the generated response covers the relevant facts that should be included. We propose a comprehensive factuality evaluation framework that jointly measures precision and recall. Our method leverages external knowledge sources to const…

4. Very close Not relevant

   FELM: Benchmarking Factuality Evaluation of Large Language Models

   Shiqi Chen, Yi-Ran Zhao, Jinghan Zhang et al. · 2023 · Neural Information Processing Systems · cited 91 times · Not summarized yet

   Abstract

   Assessing factuality of text generated by large language models (LLMs) is an emerging yet crucial research area, aimed at alerting users to potential errors and guiding the development of more reliable LLMs. Nonetheless, the evaluators assessing factuality necessitate suitable evaluation themselves to gauge progress and foster advancements. This direction remains under-explored, resulting in substantial impediments to the progress of factuality evaluators. To mitigate this issue, we introduce a benchmark for Factuality Evaluation of large Language Models, referred to as felm. In this benchmark, we collect responses generated from LLMs and annotate factuality labels in a fine-grained manner. …

5. Very close Not relevant

   How Does Response Length Affect Long-Form Factuality

   J. Zhao, Jimmy Z.J. Liu, Bryan Hooi et al. · 2025 · Annual Meeting of the Association for Computational Linguistics · cited 11 times · Not summarized yet

   Abstract

   Large language models (LLMs) are widely used for long-form text generation. However, factual errors in the responses would undermine their reliability. Despite growing attention to LLM factuality, the effect of response length on factuality remains underexplored. In this work, we systematically investigate this relationship by first introducing an automatic and bi-level long-form factuality evaluation framework, which achieves high agreement with human annotations while being cost-effective. Using this framework, we conduct controlled experiments and find that longer responses exhibit lower factual precision, confirming the presence of length bias. To explain this phenomenon, we empirically …

6. Very close Not relevant

   FactAlign: Long-form Factuality Alignment of Large Language Models

   Chao-Wei Huang, Yun-Nung Chen · 2024 · Conference on Empirical Methods in Natural Language Processing · cited 18 times · Not summarized yet

   Abstract

   Large language models have demonstrated significant potential as the next-generation information access engines. However, their reliability is hindered by issues of hallucination and generating non-factual content. This is particularly problematic in long-form responses, where assessing and ensuring factual accuracy is complex. In this paper, we address this gap by proposing FactAlign, a novel alignment framework designed to enhance the factuality of LLMs' long-form responses while maintaining their helpfulness. We introduce fKTO, a fine-grained, sentence-level alignment algorithm that extends the Kahneman-Tversky Optimization (KTO) alignment method. Leveraging recent advances in automatic f…

7. Very close Cites this paper Uses this paper in depth Not relevant

   MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMs

   Yucheng Ning, Xi-Xun Lin, Fang Fang et al. · 2025 · arXiv.org · preprint, not peer reviewed · cited 3 times · Not summarized yet

   Abstract

   The widespread adoption of Large Language Models (LLMs) raises critical concerns about the factual accuracy of their outputs, especially in high-risk domains such as biomedicine, law, and education. Existing evaluation methods for short texts often fail on long-form content due to complex reasoning chains, intertwined perspectives, and cumulative information. To address this, we propose a systematic approach integrating large-scale long-form datasets, multi-agent verification mechanisms, and weighted evaluation metrics. We construct LongHalluQA, a Chinese long-form factuality dataset; and develop MAD-Fact, a debate-based multi-agent verification system. We introduce a fact importance hierarc…

8. Very close Cites this paper Not relevant

   SimpleQA Verified: A Reliable Factuality Benchmark to Measure Parametric Knowledge

   Lukas Haas, G. Yona, G. D'Antonio et al. · 2025 · arXiv.org · preprint, not peer reviewed · cited 55 times · Not summarized yet

   Abstract

   We introduce SimpleQA Verified, a 1,000-prompt benchmark for evaluating Large Language Model (LLM) short-form factuality based on OpenAI's SimpleQA. It addresses critical limitations in OpenAI's benchmark, including noisy and incorrect labels, topical biases, and question redundancy. SimpleQA Verified was created through a rigorous multi-stage filtering process involving de-duplication, topic balancing, and source reconciliation to produce a more reliable and challenging evaluation set, alongside improvements in the autorater prompt. On this new benchmark, Gemini 2.5 Pro achieves a state-of-the-art F1-score of 55.6, outperforming other frontier models, including GPT-5. This work provides the…

Papers that cite it

1. Very close Uses this paper in depth Not relevant

   FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation

   Farima Fatahi Bayat, Lechen Zhang, Sheza Munir et al. · 2024 · Annual Meeting of the Association for Computational Linguistics · cited 34 times · Not summarized yet

   Abstract

   The rapid adoption of language models (LMs) across diverse applications has raised concerns about their factuality, i.e., their consistency with real-world facts. We first present VERIFY (Verification and Evidence RetrIeval for FactualitY evaluation), a pipeline to evaluate LMs' factuality in real-world user interactions. VERIFY considers the verifiability of LM-generated content and categorizes content units as supported, unsupported, or undecidable based on Web-retrieved evidence. Importantly, factuality judgment by VERIFY correlates better with human evaluations than existing methods. Using VERIFY, we identify"hallucination prompts"across diverse topics, i.e., those eliciting the highest …

2. Very close Uses this paper in depth Not relevant

   Learning to Reason for Factuality

   Xi-Lun Chen, Ilia Kulikov, Vincent-Pierre Berges et al. · 2025 · arXiv.org · preprint, not peer reviewed · cited 24 times · Not summarized yet

   Abstract

   Reasoning Large Language Models (R-LLMs) have significantly advanced complex reasoning tasks but often struggle with factuality, generating substantially more hallucinations than their non-reasoning counterparts on long-form factuality benchmarks. However, extending online Reinforcement Learning (RL), a key component in recent R-LLM advancements, to the long-form factuality setting poses several unique challenges due to the lack of reliable verification methods. Previous work has utilized automatic factuality evaluation frameworks such as FActScore to curate preference data in the offline RL setting, yet we find that directly leveraging such methods as the reward in online RL leads to reward…

3. Very close Uses this paper in depth Not relevant

   FACTORY: A Challenging Human-Verified Prompt Set for Long-Form Factuality

   Mingda Chen, Yang Li, Xi-Lun Chen et al. · 2025 · arXiv.org · preprint, not peer reviewed · cited 7 times · Not summarized yet

   Abstract

   Long-form factuality evaluation assesses the ability of models to generate accurate, comprehensive responses to short prompts. Existing benchmarks often lack human verification, leading to potential quality issues. To address this limitation, we introduce FACTORY, a large-scale, human-verified prompt set. Developed using a model-in-the-loop approach and refined by humans, FACTORY includes challenging prompts that are fact-seeking, answerable, and unambiguous. We conduct human evaluations on 6 state-of-the-art language models using FACTORY and existing datasets. Our results show that FACTORY is a challenging benchmark: approximately 40% of the claims made in the responses of SOTA models are n…

4. Very close Not relevant

   Measuring short-form factuality in large language models

   Jason Wei, Karina Nguyen, Hyung Won Chung et al. · 2024 · arXiv.org · preprint, not peer reviewed · cited 396 times · Not summarized yet

   Abstract

   We present SimpleQA, a benchmark that evaluates the ability of language models to answer short, fact-seeking questions. We prioritized two properties in designing this eval. First, SimpleQA is challenging, as it is adversarially collected against GPT-4 responses. Second, responses are easy to grade, because questions are created such that there exists only a single, indisputable answer. Each answer in SimpleQA is graded as either correct, incorrect, or not attempted. A model with ideal behavior would get as many questions correct as possible while not attempting the questions for which it is not confident it knows the correct answer. SimpleQA is a simple, targeted evaluation for whether mode…

5. Very close Uses this paper in depth Not relevant

   Think Through Uncertainty: Improving Long-Form Generation Factuality via Reasoning Calibration

   Xin Liu, Lu Wang · 2026 · arXiv.org · preprint, not peer reviewed · cited 3 times · Not summarized yet

   Abstract

   Large language models (LLMs) often hallucinate in long-form generation. Existing approaches mainly improve factuality through post-hoc revision or reinforcement learning (RL) with correctness-based rewards, but they do not teach the model to estimate which parts of its generation are reliable. As a result, models may still state incorrect claims confidently in their responses. Recent advances in reasoning have significantly improved LLM performance, and have been leveraged to estimate confidence by incorporating calibration into RL objectives. However, existing approaches remain limited to a single scalar confidence for the entire response, which is insufficient for long-form generation wher…