Exécution de notre outil de synthèse sur un nouvel article
Vérifiez l’article ci-dessous, puis lancez sa synthèse.
CoQ:AN Empirical Framework for Multi-hop Question Answering Empowered by Large Language Models
Qiang Huang (Xinjiang University), Feng Huang (Xinjiang University), Dehao Tao (Tsinghua University), YueTong Zhao (Beijing University of Posts and Telecommunications), Bingkun Wang (Zhengzhou College of Finance and Economics), Yongfeng Huang (Tsinghua University)
Résumé : Prompt-based Large Language Models(LLMs) are surprisingly powerful in generating natural language reasoning steps or Chains of Thoughts(CoT) for multi-hop question answering(QA). However, LLMs struggle when they lack access to necessary knowledge or when the knowledge within their parameters is outdated. Additionally, LLMs that rely solely on CoT tend to generate hallucinations during the reasoning process. To address these dilemmas, we propose the Chain of Question (CoQ) framework, a novel multi-hop QA approach. This approach decomposes a complex original question into multiple sub-questions according to a CoT to retrieve knowledge from an external knowledge base. It then answers the question process based on the retrieved knowledge in accordance with a CoT. We design that each point of thought generated during the reasoning process be supported by the knowledge retrieved in the external knowledge base. Experiments show that CoQ is effective in reducing model hallucinations, leading to higher factual accuracy than CoT. On average, it reduces factual errors by 31% over CoT, and even by 38% on the two most commonly used models today.