Exploring the Compositional Generalization in Context Dependent Text-to-SQL Parsing
AI-generated Key Points
- Generated SQL statements in Text-to-SQL task are refined iteratively based on user input utterance
- Input text from each interaction can be viewed as component modifications to previous SQL statements
- Modification patterns can be extracted from these interactions and combined with other SQL statements
- Two challenging benchmarks, CoSQL-CG and SParC-CG, were constructed by recombining modification patterns and existing SQL statements
- Current models struggle to perform well on these benchmarks
- Alignment of previous SQL statements with input utterance improves compositional generalization ability of models
- A method called p-align is proposed to improve compositional generalization by aligning text and SQL statements accurately and incorporating previous SQL statements into model architecture
- The research highlights the importance of compositional generalization in context-dependent Text-to-SQL settings
- The proposed method significantly enhances model performance in handling complex queries.
Authors: Aiwei Liu, Wei Liu, Xuming Hu, Shuang Li, Fukun Ma, Yawen Yang, Lijie Wen
Abstract: In the context-dependent Text-to-SQL task, the generated SQL statements are refined iteratively based on the user input utterance from each interaction. The input text from each interaction can be viewed as component modifications to the previous SQL statements, which could be further extracted as the modification patterns. Since these modification patterns could also be combined with other SQL statements, the models are supposed to have the compositional generalization to these novel combinations. This work is the first exploration of compositional generalization in context-dependent Text-to-SQL scenarios. To facilitate related studies, we constructed two challenging benchmarks named \textsc{CoSQL-CG} and \textsc{SParC-CG} by recombining the modification patterns and existing SQL statements. The following experiments show that all current models struggle on our proposed benchmarks. Furthermore, we found that better aligning the previous SQL statements with the input utterance could give models better compositional generalization ability. Based on these observations, we propose a method named \texttt{p-align} to improve the compositional generalization of Text-to-SQL models. Further experiments validate the effectiveness of our method. Source code and data are available.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.