Techniques & MethodsToT
Tree of Thoughts
An advanced reasoning technique where the model explores multiple reasoning paths in a tree structure before choosing the best.
Tree of Thoughts (ToT) extends Chain of Thought by exploring multiple reasoning branches in parallel. The model considers several possible next steps at each point, evaluates them, and pursues the most promising path.
ToT is particularly useful for problems with many possible solution paths, like puzzles, planning, and creative writing. It trades more compute for better results on hard problems.
Contrast: Chain of Thought is linear; Tree of Thoughts is a search over possible reasoning paths.
Implementing ToT requires the model to not only reason but also evaluate its own partial solutions and prune bad branches. This is more complex than plain CoT but unlocks harder problems.