Tree of Thoughts: Deliberate Problem Solving with Large Language Models

AI-generated keywords: Tree of Thoughts

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Limitations of language models (LMs) in tasks requiring exploration, strategic lookahead, or where initial decisions are crucial
  • Introduction of a new framework called Tree of Thoughts (ToT) for language model inference
  • ToT builds upon the Chain of Thought approach and allows LMs to explore coherent units of text as intermediate steps towards problem-solving
  • Enables LMs to make deliberate decisions by considering multiple reasoning paths and self-evaluating choices
  • Allows LMs to look ahead or backtrack when necessary for making global choices
  • Experiments conducted to evaluate the effectiveness of ToT on three novel tasks: Game of 24, Creative Writing, and Mini Crosswords
  • Comparison with GPT-4 using chain-of-thought prompting shows ToT achieving a success rate of 74% in Game of 24 tasks compared to GPT-4's 4%
  • ToT significantly improves language models' performance in tasks requiring non-trivial planning or search
  • ToT is a valuable addition to existing language model frameworks for tackling complex problem-solving tasks
  • Code repository available for further exploration and development in this area
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan

Code repo with all prompts: https://github.com/ysymyth/tree-of-thought-llm

Abstract: Language models are increasingly being deployed for general problem solving across a wide range of tasks, but are still confined to token-level, left-to-right decision-making processes during inference. This means they can fall short in tasks that require exploration, strategic lookahead, or where initial decisions play a pivotal role. To surmount these challenges, we introduce a new framework for language model inference, Tree of Thoughts (ToT), which generalizes over the popular Chain of Thought approach to prompting language models, and enables exploration over coherent units of text (thoughts) that serve as intermediate steps toward problem solving. ToT allows LMs to perform deliberate decision making by considering multiple different reasoning paths and self-evaluating choices to decide the next course of action, as well as looking ahead or backtracking when necessary to make global choices. Our experiments show that ToT significantly enhances language models' problem-solving abilities on three novel tasks requiring non-trivial planning or search: Game of 24, Creative Writing, and Mini Crosswords. For instance, in Game of 24, while GPT-4 with chain-of-thought prompting only solved 4% of tasks, our method achieved a success rate of 74%. Code repo with all prompts: https://github.com/ysymyth/tree-of-thought-llm.

Submitted to arXiv on 17 May. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2305.10601v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

In their paper titled "Tree of Thoughts: Deliberate Problem Solving with Large Language Models," authors Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, and Karthik Narasimhan discuss the limitations of language models (LMs) in tasks that require exploration, strategic lookahead, or where initial decisions play a crucial role. The authors propose a new framework called Tree of Thoughts (ToT) for language model inference to address these challenges. ToT builds upon the popular Chain of Thought approach and enables LMs to explore coherent units of text (thoughts) as intermediate steps towards problem-solving. This allows LMs to make deliberate decisions by considering multiple reasoning paths and self-evaluating choices to determine the next course of action. It also enables them to look ahead or backtrack when necessary for making global choices. The authors conducted experiments to evaluate the effectiveness of ToT in enhancing language models' problem-solving abilities on three novel tasks: Game of 24, Creative Writing, and Mini Crosswords. They compared their method with GPT-4 using chain-of-thought prompting and found that while GPT-4 only achieved a success rate of 4% in Game of 24 tasks, their approach achieved an impressive success rate of 74%. These results demonstrate that ToT significantly improves language models' performance in tasks requiring non-trivial planning or search. Overall, the authors provide evidence that ToT is a valuable addition to existing language model frameworks for tackling complex problem-solving tasks. Their code repository containing all prompts also allows for further exploration and development in this area.
Created on 14 Jan. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.