Résumé IA · arXiv: 2310.09716v1 · cs.HC
Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting
L’essentiel
- La réécriture de requêtes est essentielle pour améliorer la recherche conversationnelle en transformant les requêtes utilisateur dépendantes du contexte en formes autonomes.
- Les approches existantes se basent sur des réécritures humaines comme étiquettes pour entraîner des modèles, mais celles-ci peuvent manquer d'informations suffisantes.
- Utilisation de grands modèles linguistiques (LLMs) pour générer des réécritures informatives grâce à des instructions bien conçues.
- Définition de quatre propriétés essentielles pour les réécritures bien formulées et leur incorporation dans l'instruction.
- Introduction du rôle d'éditeurs de réécriture pour les LLMs afin d'améliorer le processus de réécriture.
- Proposition de distiller les capacités de réécriture des LLMs dans des modèles plus petits pour réduire la latence.
- Expérimentation montrant que les réécritures informatives améliorent significativement la performance par rapport aux réécritures humaines, surtout avec des systèmes récupérateurs épars.
- La rewriting of requests plays an essential role in improving conversational search by transforming context-dependent user queries into standalone forms.
- Existing approaches mainly rely on human rewritten queries as labels to train query rewriting models. However, human rewrites may lack sufficient information for optimal retrieval performance. To overcome this limitation, we propose using large language models (LLMs) as query rewriters, enabling the generation of informative rewrites through well-designed instructions. We define four essential properties for well-formulated rewrites and incorporate them all into the instruction. Additionally, we introduce the role of rewrite editors for LLMs when initial rewrites are available, forming a "rewrite then edit" process. Furthermore, we propose distilling the rewriting capabilities of LLMs into smaller models to reduce rewrite latency. Our experimental evaluation on the QReCC dataset demonstrates that informative rewrites can significantly enhance retrieval performance compared to human rewrites, especially with sparse retrieval systems. A simple approach to improve the informativeness of rewritten queries is to provide human annotators with more comprehensive instructions so they can make not only the original queries unambiguous but also informative. However, this approach has several drawbacks including high cost, increased workload for
Points clés rédigés par une IA : ils peuvent contenir des erreurs, vérifiez-les dans l’article.
Posez des questions sur cet article à notre assistant IA
Comment discuter avec cet article ? Guide illustré
Vous pouvez aussi discutez avec plusieurs papiers à la fois ici.
Gardez cette conversation — un compte gratuit conserve vos questions et réponses, vos collections d’articles et vos alertes.
Continuer avec Google Créer un compte gratuitOutils pour cet article
Outils avancés Premium
Pour suivre un domaine de près : alertes de citations, diapositives de journal club, comparaison des versions et envoi vers Zotero. Découvrir Premium
Les articles autour de celui-ci
Les voir sur une carteClassés selon la proximité de leur titre et de leur résumé avec ceux de cet article. Sélectionnez-en pour les lire ensemble.
Les articles les plus proches
-
Query Understanding in the Age of Large Language ModelsAvishek Anand, V. Venktesh, Abhijit Anand et al. · 2023 · arXiv.org · preprint, non relu par les pairs · cité 13 fois · Pas encore résumé
Résumé scientifique
Querying, conversing, and controlling search and information-seeking interfaces using natural language are fast becoming ubiquitous with the rise and adoption of large-language models (LLM). In this position paper, we describe a generic framework for interactive query-rewriting using LLMs. Our proposal aims to unfold new opportunities for improved and transparent intent understanding while building high-performance retrieval systems using LLMs. A key aspect of our framework is the ability of the rewriter to fully specify the machine intent by the search engine in natural language that can be further refined, controlled, and edited before the final retrieval phase. The ability to present, int…
-
LLM-R2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query EfficiencyZhaodonghui Li, Haitao Yuan, Huiming Wang et al. · 2024 · Databases · cité 71 fois · Résumé IA disponible
Résumé scientifique
Query rewrite, which aims to generate more efficient queries by altering a SQL query's structure without changing the query result, has been an important research problem. In order to maintain equivalence between the rewritten query and the original one during rewriting, traditional query rewrite methods always rewrite the queries following certain rewrite rules. However, some problems still remain. Firstly, existing methods of finding the optimal choice or sequence of rewrite rules are still limited and the process always costs a lot of resources. Methods involving discovering new rewrite rules typically require complicated proofs of structural logic or extensive user interactions. Secondly…
-
Crafting the Path: Robust Query Rewriting for Information RetrievalIngeol Baek, Ji-Min Lee, Joonho Yang et al. · 2024 · IEEE Access · cité 16 fois · Pas encore résumé
Résumé scientifique
Query rewriting aims to generate a new query that can complement the original query to improve the information retrieval system. Recent studies on query rewriting, such as query2doc, query2expand and querey2cot, rely on the internal knowledge of Large Language Models (LLMs) to generate a relevant passage to add information to the query. Nevertheless, the efficacy of these methodologies may markedly decline in instances where the requisite knowledge is not encapsulated within the model’s intrinsic parameters. In this paper, we propose a novel structured query rewriting method called Crafting The Path tailored for retrieval systems. Crafting The Path involves a three-step process that crafts q…
-
Context Aware Query Rewriting for Text Rankers using LLMAbhijit Anand, Venktesh V, Vinay Setty et al. · 2023 · Information Retrieval · preprint, non relu par les pairs · cité 27 fois · Résumé IA disponible
Résumé scientifique
Query rewriting refers to an established family of approaches that are applied to underspecified and ambiguous queries to overcome the vocabulary mismatch problem in document ranking. Queries are typically rewritten during query processing time for better query modelling for the downstream ranker. With the advent of large-language models (LLMs), there have been initial investigations into using generative approaches to generate pseudo documents to tackle this inherent vocabulary gap. In this work, we analyze the utility of LLMs for improved query rewriting for text ranking tasks. We find that there are two inherent limitations of using LLMs as query re-writers -- concept drift when using onl…
-
LiRe: Efficient Query Rewriting for Retrieval Augmented Generation SystemsChengfeng Chen, Xiao-Dong Huang, Yangzhen Xu et al. · 2024 · 2024 4th International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Techno · cité 1 fois · Pas encore résumé
Résumé scientifique
With the continuous advancement of information retrieval technologies, query rewriting has become a key technique for enhancing retrieval effectiveness. In the context of the widespread application of large language models and retrieval-augmented generation technologies, high-quality query rewriting plays a crucial role in tasks like open-domain question answering. Conventional Conversational Query Rewriting (CQR) methods often prioritize human-friendly query formulation, which may not consistently produce optimal retriever-friendly results. To address this limitation, we present LiRe, a lightweight and training-free query rewriting system. LiRe employs a retrieval-oriented strategy to refin…
-
Contextualizing Search Queries In-Context Learning for Conversational Rewriting with LLMsRaymond Wilson, Chase Carter, Cole Graham · 2025 · arXiv.org · preprint, non relu par les pairs · cité 6 fois · Pas encore résumé
Résumé scientifique
Conversational query rewriting is crucial for effective conversational search, yet traditional supervised methods require substantial labeled data, which is scarce in low-resource settings. This paper introduces Prompt-Guided In-Context Learning, a novel approach that leverages the in-context learning capabilities of Large Language Models (LLMs) for few-shot conversational query rewriting. Our method employs carefully designed prompts, incorporating task descriptions, input/output format specifications, and a small set of illustrative examples, to guide pre-trained LLMs to generate context-independent queries without explicit fine-tuning. Extensive experiments on benchmark datasets, TREC and…
-
ChatGPT Versus Modest Large Language Models: An Extensive Study on Benefits and Drawbacks for Conversational SearchGuido Rocchietti, Cosimo Rulli, Franco Maria Nardini et al. · 2025 · IEEE Access · cité 3 fois · Pas encore résumé
Résumé scientifique
Large Language Models (LLMs) are effective in modeling text syntactic and semantic content, making them a strong choice to perform conversational query rewriting. While previous approaches proposed NLP-based custom models, requiring significant engineering effort, our approach is straightforward and conceptually simpler. Not only do we improve effectiveness over the current state-of-the-art, but we also curate the cost and efficiency aspects. We explore the use of pre-trained LLMs fine-tuned to generate quality user query rewrites, aiming to reduce computational costs while maintaining or improving retrieval effectiveness. As a first contribution, we study various prompting approaches — incl…
-
Think Then Rewrite: Reasoning Enhanced Query Rewriting for Domain Specific RetrievalAng Li, Yu-Fei Shi, Yuxuan Si et al. · 2026 · AAAI Conference on Artificial Intelligence · cité 4 fois · Pas encore résumé
Résumé scientifique
Query rewriting is a crucial task for improving retrieval, especially in professional domains such as law and medicine, where user queries are often underspecified and ambiguous. While large language models (LLMs) offer strong understanding and generation capabilities, existing LLM-based approaches reduce the task to text transformation or expansion, neglecting reasoning to disambiguate queries, which fails to bridge the cognitive gap between user queries and specialized documents. In this paper, we propose Think-Then-Rewrite (TTR), a reinforcement learning based framework that unleashes LLMs' reasoning ability for domain-specific query rewriting. TTR introduces a contrastive mutual informat…
Les travaux antérieurs sur lesquels il s’appuie
-
ConvGQR: Generative Query Reformulation for Conversational SearchFengran Mo, Ke-Long Mao, Yutao Zhu et al. · 2023 · Annual Meeting of the Association for Computational Linguistics · cité 150 fois · Pas encore résumé
Résumé scientifique
In conversational search, the user’s real search intent for the current conversation turn is dependent on the previous conversation history. It is challenging to determine a good search query from the whole conversation context. To avoid the expensive re-training of the query encoder, most existing methods try to learn a rewriting model to de-contextualize the current query by mimicking the manual query rewriting.However, manually rewritten queries are not always the best search queries.Thus, training a rewriting model on them would lead to sub-optimal queries. Another useful information to enhance the search query is the potential answer to the question. In this paper, we propose ConvGQR, a…
-
Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query RewritingSheng-Chieh Lin, Jheng-Hong Yang, Rodrigo Nogueira et al. · 2021 · ACM Trans. Inf. Syst. · cité 117 fois · Pas encore résumé
Résumé scientifique
Conversational search plays a vital role in conversational information seeking. As queries in information seeking dialogues are ambiguous for traditional ad hoc information retrieval (IR) systems due to the coreference and omission resolution problems inherent in natural language dialogue, resolving these ambiguities is crucial. In this article, we tackle conversational passage retrieval, an important component of conversational search, by addressing query ambiguities with query reformulation integrated into a multi-stage ad hoc IR system. Specifically, we propose two conversational query reformulation (CQR) methods: (1) term importance estimation and (2) neural query rewriting. For the form…
-
Explicit Query Rewriting for Conversational Dense RetrievalHong-Jin Qian, Zhicheng Dou · 2022 · Conference on Empirical Methods in Natural Language Processing · cité 76 fois · Pas encore résumé
Résumé scientifique
In a conversational search scenario, a query might be context-dependent because some words are referred to previous expressions or omitted. Previous works tackle the issue by either reformulating the query into a self-contained query (query rewriting) or learning a contextualized query embedding from the query context (context modelling). In this paper, we propose a model CRDR that can perform query rewriting and context modelling in a unified framework in which the query rewriting’s supervision signals further enhance the context modelling. Instead of generating a new query, CRDR only performs necessary modifications on the original query, which improves both accuracy and efficiency of quer…
-
Open-Domain Question Answering Goes Conversational via Question RewritingR. Anantha, Svitlana Vakulenko, Zhucheng Tu et al. · 2020 · North American Chapter of the Association for Computational Linguistics · cité 286 fois · Pas encore résumé
Résumé scientifique
We introduce a new dataset for Question Rewriting in Conversational Context (QReCC), which contains 14K conversations with 80K question-answer pairs. The task in QReCC is to find answers to conversational questions within a collection of 10M web pages (split into 54M passages). Answers to questions in the same conversation may be distributed across several web pages. QReCC provides annotations that allow us to train and evaluate individual subtasks of question rewriting, passage retrieval and reading comprehension required for the end-to-end conversational question answering (QA) task. We report the effectiveness of a strong baseline approach that combines the state-of-the-art model for ques…
-
Few-Shot Generative Conversational Query RewritingS. Yu, Jiahua Liu, Jingqin Yang et al. · 2020 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · cité 233 fois · Pas encore résumé
Résumé scientifique
Conversational query rewriting aims to reformulate a concise conversational query to a fully specified, context-independent query that can be effectively handled by existing information retrieval systems. This paper presents a few-shot generative approach to conversational query rewriting. We develop two methods, based on rules and self-supervised learning, to generate weak supervision data using large amounts of ad hoc search sessions, and to fine-tune GPT-2 to rewrite conversational queries. On the TREC Conversational Assistance Track, our weakly supervised GPT-2 rewriter improves the state-of-the-art ranking accuracy by 12%, only using very limited amounts of manual query rewrites. In the…
Les articles qui le citent
-
CompCQR: Compositional Query Generation for Training-Free Conversational SearchYunah Jang, Kang-il Lee, Joongbo Shin et al. · 2026 · Pas encore résumé
Résumé scientifique
Multi-turn interactions with LLMs are becoming increasingly common in information-seeking scenarios. However, user queries are often ambiguous and context-dependent, making them ill-suited for direct use as retriever queries. Conversational query reformulation (CQR) addresses this issue by rewriting the current utterance into a stand-alone query grounded in the dialogue history. Recent LLM-based CQR approaches achieve strong performance; however, their repeated LLM invocations and misalignment with downstream retrievers remain challenges. In this work, we begin from the observation that retrievers are highly sensitive to content ordering: simply reordering the same content can lead to change…
-
RaFe: Ranking Feedback Improves Query Rewriting for RAGShengyu Mao, Yong Jiang, Boli Chen et al. · 2024 · Conference on Empirical Methods in Natural Language Processing · cité 93 fois · Pas encore résumé
Résumé scientifique
As Large Language Models (LLMs) and Retrieval Augmentation Generation (RAG) techniques have evolved, query rewriting has been widely incorporated into the RAG system for downstream tasks like open-domain QA. Many works have attempted to utilize small models with reinforcement learning rather than costly LLMs to improve query rewriting. However, current methods require annotations (e.g., labeled relevant documents or downstream answers) or predesigned rewards for feedback, which lack generalization, and fail to utilize signals tailored for query rewriting. In this paper, we propose ours, a framework for training query rewriting models free of annotations. By leveraging a publicly available re…
-
Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QANirmal Roy, Leonardo F. R. Ribeiro, Rexhina Blloshmi et al. · 2024 · Computation and Language · cité 25 fois · Résumé IA disponible
Résumé scientifique
Augmenting Large Language Models (LLMs) with information retrieval capabilities (i.e., Retrieval-Augmented Generation (RAG)) has proven beneficial for knowledge-intensive tasks. However, understanding users' contextual search intent when generating responses is an understudied topic for conversational question answering (QA). This conversational extension leads to additional concerns when compared to single-turn QA as it is more challenging for systems to comprehend conversational context and manage retrieved passages over multiple turns. In this work, we propose a method for enabling LLMs to decide when to retrieve in RAG settings given a conversational context. When retrieval is deemed nec…
-
MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language ModelsYu-Jing Wang, Hainan Zhang, Liang Pang et al. · 2024 · AAAI Conference on Artificial Intelligence · cité 23 fois · Pas encore résumé
Résumé scientifique
In a real-world RAG system, the current query often involves spoken ellipses and ambiguous references from dialogue contexts, necessitating query rewriting to better describe user's information needs. However, traditional context-based rewriting has minimal enhancement on downstream generation tasks due to the lengthy process from query rewriting to response generation. Some researchers try to utilize reinforcement learning with generation feedback to assist the rewriter, but this sparse rewards provide little guidance in most cases, leading to unstable training and generation results.We find that user's needs are also reflected in the gold documents, retrieved documents and ground-truth. Th…
-
DVCQR: Dual-View Conversational Query Rewriting with Stage-wise Reinforcement LearningChen-Yi Li, Xinhui Tu, Zaixiang Wang · 2026 · Annual Meeting of the Association for Computational Linguistics · cité 2 fois · Pas encore résumé
Résumé scientifique
Conversational query rewriting (CQR) addresses context dependence in conversational search by rewriting each user query into a standalone form. Recent approaches leverage reinforcement learning (RL) to directly optimize retrieval effectiveness; however, they typically rely on a single rewrite, which struggles to accommodate the divergent preferences of sparse and dense retrievers and often suffers from conflicting optimization signals. We pro-pose DVCQR, a Dual-View CQR framework that explicitly generates two complementary rewrites for each query: a sparse-view rewrite that emphasizes distinctive lexical anchors, and a dense-view rewrite that captures complete semantic constraints. Both rewr…
Aller plus loin
Comment ces articles sont-ils trouvés ?
Nous comparons le titre et le résumé de cet article avec ceux de tous les articles résumés sur ce site, et avec les articles que Semantic Scholar recommande, ceux qu’il cite et ceux qui le citent (pour un article très cité, ses citations les plus récentes et, depuis OpenAlex, les plus citées). Parmi les travaux antérieurs et les suites, les articles qui s’utilisent en profondeur, une méthode qu’il utilise et les suites très citées remontent un peu. Les niveaux (très proche, proche, apparenté) viennent de la similarité des textes, pas d’un jugement de qualité ; * signale un article sans résumé, comparé par son titre. La phrase sous un article est écrite par une IA à partir des deux résumés : vérifiez-la dans les articles. Un article jugé hors sujet par trois lecteurs quitte la liste.
Mis à jour le 1 novembre 2026.
Le résumé précédent a été créé il y a plus d'un an et peut être réexécuté (si nécessaire) en cliquant sur le bouton Exécuter ci-dessous.
Avertissement : Notre outil de synthèse basé sur l'IA et l'assistant virtuel fournis sur ce site Web peuvent ne pas toujours fournir des résumés complets ou des réponses exactes. Nous vous encourageons à examiner attentivement et à évaluer le contenu généré pour vous assurer de sa qualité et de sa pertinence par rapport à vos besoins.