A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applications
Authors: Wenbo Shang, Xin Huang
AI-generated Key Points
- Graphs are essential for representing complex relationships in society and nature, including social networks, transportation systems, financial structures, and biomedical networks.
- Large language models (LLMs) have transformed natural language processing (NLP) and multi-modal tasks with their exceptional generalization capabilities, particularly in addressing challenges related to graph tasks.
- The survey focuses on LLM applications in graph data analysis, highlighting the effectiveness of LLM models in various graph analytics tasks such as generative graph analytics (LLM-GGA), graph query processing (LLM-GQP), graph inference and learning (LLM-GIL), and graph-LLM-based applications.
- LLM-GQP integrates graph analytics techniques with LLM prompts to enhance functionalities like graph understanding and knowledge graph-based augmented retrieval.
- LLM-GIL leverages LLM capabilities for learning and reasoning over graphs through mechanisms such as graph learning, reasoning formation based on graphs, and enhancing overall graph representation.
- The survey explores how integrating different prompts into LLM models can effectively address various downstream tasks related to graphs.
- It provides insights into evaluating LLM models, benchmark datasets/tasks used for assessment purposes, along with a detailed analysis of pros and cons associated with employing these models.
- This interdisciplinary research area at the intersection of LLMs and graph analytics presents numerous open problems and future directions for exploration.
Abstract: A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, financial networks, and biomedical systems. Recently, large language models (LLMs) have showcased a strong generalization ability to handle various NLP and multi-mode tasks to answer users' arbitrary questions and specific-domain content generation. Compared with graph learning models, LLMs enjoy superior advantages in addressing the challenges of generalizing graph tasks by eliminating the need for training graph learning models and reducing the cost of manual annotation. In this survey, we conduct a comprehensive investigation of existing LLM studies on graph data, which summarizes the relevant graph analytics tasks solved by advanced LLM models and points out the existing remaining challenges and future directions. Specifically, we study the key problems of LLM-based generative graph analytics (LLM-GGA) with three categories: LLM-based graph query processing (LLM-GQP), LLM-based graph inference and learning (LLM-GIL), and graph-LLM-based applications. LLM-GQP focuses on an integration of graph analytics techniques and LLM prompts, including graph understanding and knowledge graph (KG) based augmented retrieval, while LLM-GIL focuses on learning and reasoning over graphs, including graph learning, graph-formed reasoning and graph representation. We summarize the useful prompts incorporated into LLM to handle different graph downstream tasks. Moreover, we give a summary of LLM model evaluation, benchmark datasets/tasks, and a deep pro and cons analysis of LLM models. We also explore open problems and future directions in this exciting interdisciplinary research area of LLMs and graph analytics.
Tools for this paper
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
We compare the title and abstract with papers indexed in our database. For arXiv papers, we search within the same category; for DOI and other sources, we search across sources and subjects. You can rerun the search as our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.