Graph of Thoughts: Solving Elaborate Problems with Large Language Models

AI-generated keywords: Graph of Thoughts

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • The paper introduces a framework called Graph of Thoughts (GoT) that enhances the prompting capabilities of large language models (LLMs).
  • GoT allows the modeling of LLM-generated information as an arbitrary graph, going beyond existing paradigms like Chain-of-Thought or Tree of Thoughts (ToT).
  • GoT represents units of information generated by an LLM as vertices in a graph and establishes dependencies between these vertices using edges.
  • This approach enables the combination of different LLM thoughts to produce synergistic outcomes and allows for distilling the essence of entire networks of thoughts or enhancing thoughts using feedback loops.
  • GoT offers several advantages over state-of-the-art methods on various tasks, including a 62% improvement in sorting quality compared to ToT and reducing costs by more than 31%.
  • The extensibility of GoT with new thought transformations makes it suitable for spearheading new prompting schemes.
  • The introduction of the Graph of Thoughts framework presents a significant advancement in enhancing the capabilities and performance of large language models.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Michal Podstawski, Hubert Niewiadomski, Piotr Nyczyk, Torsten Hoefler

Abstract: We introduce Graph of Thoughts (GoT): a framework that advances prompting capabilities in large language models (LLMs) beyond those offered by paradigms such as Chain-ofThought or Tree of Thoughts (ToT). The key idea and primary advantage of GoT is the ability to model the information generated by an LLM as an arbitrary graph, where units of information ("LLM thoughts") are vertices, and edges correspond to dependencies between these vertices. This approach enables combining arbitrary LLM thoughts into synergistic outcomes, distilling the essence of whole networks of thoughts, or enhancing thoughts using feedback loops. We illustrate that GoT offers advantages over state of the art on different tasks, for example increasing the quality of sorting by 62% over ToT, while simultaneously reducing costs by >31%. We ensure that GoT is extensible with new thought transformations and thus can be used to spearhead new prompting schemes. This work brings the LLM reasoning closer to human thinking or brain mechanisms such as recurrence, both of which form complex networks.

Submitted to arXiv on 18 Aug. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2308.09687v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

In their paper titled "Graph of Thoughts: Solving Elaborate Problems with Large Language Models," Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Michal Podstawski, Hubert Niewiadomski, Piotr Nyczyk and Torsten Hoefler introduce a framework called Graph of Thoughts (GoT) that enhances the prompting capabilities of large language models (LLMs). GoT goes beyond existing paradigms like Chain-of-Thought or Tree of Thoughts (ToT) by allowing the modeling of LLM-generated information as an arbitrary graph. The key idea behind GoT is to represent units of information generated by an LLM as vertices in a graph and establish dependencies between these vertices using edges. This approach enables the combination of different LLM thoughts to produce synergistic outcomes and allows for distilling the essence of entire networks of thoughts or enhancing thoughts using feedback loops. By leveraging this framework, GoT offers several advantages over state-of-the-art methods on various tasks. For example, GoT demonstrates a 62% improvement in sorting quality compared to ToT while simultaneously reducing costs by more than 31%. The extensibility of GoT with new thought transformations makes it suitable for spearheading new prompting schemes. This work brings LLM reasoning closer to human thinking and brain mechanisms such as recurrence that are characterized by complex networks. Overall, the authors' introduction of the Graph of Thoughts framework presents a significant advancement in enhancing the capabilities and performance of large language models.
Created on 28 Sep. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.