Skip to main content

Chain of Thought

Chain of Thought (CoT) is an advanced prompt engineering technique that encourages AI models to break down complex problems into smaller, logical steps before arriving at a final answer. This approach helps improve accuracy and makes the reasoning process more transparent.

Benefits​

  • Improved accuracy on complex tasks
  • More transparent reasoning process
  • Better debugging of AI responses
  • Reduced hallucinations
  • More reliable outputs

How it Works​

Chain of Thought prompting can work in two ways:

  1. Few-Shot CoT: Works by providing examples of the reasoning process to the AI.
  2. Zero-Shot CoT: Explicitly tells the AI to solve the problem step by step.

Few-Shot CoT​

Few-Shot CoT works by providing examples of the reasoning process to the AI. This is an example of a few-shot CoT prompt:

Q: I have 10 apples, double the number of oranges. I gave 5 apples to a friend. How many fruits do I have now?
A: To find the solution, first I need to count the number of oranges. Since the oranges are double the number of apples, I have 20 oranges. Then, I need to subtract the 5 apples I gave to my friend from the total number of apples. 10 apples - 5 apples equals 5 apples. Finally, I add the number of apples and oranges to get the total number of fruits. 5 apples + 20 oranges equals 25 fruits.
Q: I have 10 apples, my 5 friends each have 15 apples. How many apples do we have in total?
A: To find the solution, first I need to count the number of apples I have. I have 10 apples. Then, I need to count the number of apples my 5 friends have. Each of my friends has 15 apples, so 5 friends times 15 apples equals 75 apples. Finally, I add the number of apples I have and the number of apples my friends have to get the total number of apples. 10 apples + 75 apples equals 85 apples.
Q: I have 10 apples, my friend has 15 oranges. How many oranges do we have in total?
A: To find the solution, first I need to count the number of oranges I have. I have none, because I have only apples. Then, I need to count the number of oranges my friend has. My friend has 15 oranges. Finally, I add the number of oranges I have and the number of oranges my friend has to get the total number of oranges. 0 oranges + 15 oranges equals 15 oranges.
Q: I have 10 apples and 10 oranges. How many fruits do I have?
A:

By providing all these examples in the prompt, the AI can learn the reasoning process and apply it to new problems.

Zero-Shot CoT​

Zero-Shot CoT works by explicitly telling the AI to solve the problem step by step. This is an example of a zero-shot CoT prompt:

Q: I have 10 apples and 10 oranges. How many fruits do I have?
Let's think step by step.

This prompt explicitly tells the AI to think step by step and arrive at the final answer.