Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledge

AI-generated keywords: Natural Language Processing

AI-generated Key Points

  • Natural language processing (NLP) analyzes and processes natural language data to investigate interactions between agents and humans
  • Large-scale language models are crucial in NLP but pose challenges of explainability and complexity
  • Researchers have been exploring ways to introduce logical relations and rules into NLP models through the integration of AI planning
  • Integration of AI planning and NLP can improve communication between human and intelligent agents in five areas: planning-based text understanding, planning-based natural language processing, planning-based explainability, text-based human-robot interaction, and applications
  • Text summarization involves extracting important information from texts and generating new summaries based on that information
  • Text summarization can be categorized into extractive techniques or abstractive techniques
  • Researchers have integrated text summarization models with AI planning by using deep learning abstractive summarization with content planning
  • Planning-based text summarization methods first plan out skeletons of summaries or compute probability distributions before generating whole sentences based on those plans or predictions
  • Current planning-based text summarization approaches rely on deep learning to learn models and probability distributions, but it is challenging to capture the relations implied in texts.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Kebing Jin, Hankz Hankui Zhuo

License: CC BY-NC-SA 4.0

Abstract: Natural language processing (NLP) aims at investigating the interactions between agents and humans, processing and analyzing large amounts of natural language data. Large-scale language models play an important role in current natural language processing. However, the challenges of explainability and complexity come along with the developments of language models. One way is to introduce logical relations and rules into natural language processing models, such as making use of Automated Planning. Automated planning (AI planning) focuses on building symbolic domain models and synthesizing plans to transit initial states to goals based on domain models. Recently, there have been plenty of works related to these two fields, which have the abilities to generate explicit knowledge, e.g., preconditions and effects of action models, and learn from tacit knowledge, e.g., neural models, respectively. Integrating AI planning and natural language processing effectively improves the communication between human and intelligent agents. This paper outlines the commons and relations between AI planning and natural language processing, argues that each of them can effectively impact on the other one by five areas: (1) planning-based text understanding, (2) planning-based natural language processing, (3) planning-based explainability, (4) text-based human-robot interaction, and (5) applications. We also explore some potential future issues between AI planning and natural language processing. To the best of our knowledge, this survey is the first work that addresses the deep connections between AI planning and Natural language processing.

Submitted to arXiv on 15 Feb. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2202.07138v2

Natural language processing (NLP) is a field that focuses on analyzing and processing large amounts of natural language data to investigate the interactions between agents and humans. Large-scale language models play a crucial role in NLP, but they also pose challenges of explainability and complexity. To address these challenges, researchers have been exploring ways to introduce logical relations and rules into natural language processing models, such as through the integration of AI planning. AI planning, or automated planning, involves building symbolic domain models and synthesizing plans to transition initial states to goals based on those models. Recently, there has been significant research on the integration of AI planning and NLP, which can generate explicit knowledge such as preconditions and effects of action models while also learning from tacit knowledge like neural models. This integration can improve communication between human and intelligent agents in five areas: (1) planning-based text understanding, (2) planning-based natural language processing, (3) planning-based explainability, (4) text-based human-robot interaction, and (5) applications. One area where AI planning has shown promise in NLP is text summarization. Text summarization involves extracting important information from texts and generating new summaries based on that information. It requires agents to understand texts, filter information from abundant descriptions, and organize them into summaries. Text summarization can be categorized into extractive techniques that select subsets of words or sentences from input articles to summarize them or abstractive techniques that try to understand the texts and generate summaries. In recent years, researchers have integrated text summarization models with AI planning by using deep learning abstractive summarization with content planning that describes or predicts skeletons of articles. Planning-based text summarization methods first plan out skeletons of summaries or compute probability distributions before generating whole sentences based on those plans or predictions. For example, some researchers have computed plans in the form of entity chains before generating summaries conditioned on those plans. While current planning-based text summarization approaches rely on deep learning to learn models and probability distributions, it is challenging to capture the relations implied in texts. Researchers believe that it would be interesting and challenging to let content planning modules understand these relations, allowing content plans to be more coherent and controllable. Furthermore, there are commonalities between some mainstream text summarization methods and AI planning. For example, tree-based and graph-based text summarization approaches first find the most important information from the text before using trees and graphs to create summaries.
Created on 26 Apr. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.