Tree of Thoughts

Full definition

Yao et al. (Princeton, 2023) showed ToT solving tasks single-prompt and chain-of-thought could not (Game of 24, creative writing constraints). The cost is high — many forward passes per problem — making ToT suited to high-value, low-volume reasoning tasks rather than chat. Modern reasoning-tuned models internalize tree-search-like behavior, reducing but not eliminating the need for explicit ToT.

Why it matters

ToT marks the conceptual shift from "LLM as text generator" to "LLM as search operator." For high-stakes reasoning — proofs, plans, code synthesis — explicit search over reasoning trees still outperforms single-path generation on hard problems.

Example

A planning agent uses ToT with breadth-of-3 and depth-of-4 to schedule a 6-warehouse logistics rotation under a fuel-budget constraint, finding a feasible plan single-path CoT failed to produce.

Related terms

• Chain-of-Thought (CoT)
  Chain-of-Thought (CoT) is a prompting and training technique in which a language model is encouraged to reason step-by-step before producing its final answer — improving accuracy on math, logic, and multi-hop reasoning by 10-40 percentage points on standard benchmarks.
• Self-Consistency
  Self-consistency is a prompting technique that samples multiple chain-of-thought reasoning paths from an LLM at non-zero temperature, then selects the most common final answer by majority vote — improving reasoning accuracy at the cost of more tokens.
• ReAct Pattern
  ReAct (Reasoning + Acting) is a prompting pattern that interleaves reasoning steps ("Thought") with tool actions ("Action") and tool results ("Observation"), letting an LLM iteratively decompose a task, query the world, and self-correct.
• Agentic Workflow
  An agentic workflow is a multi-step AI process where a model plans, takes actions through tools, observes results, and iterates toward a goal — replacing single-shot prompting with a loop that reasons, acts, and self-corrects.