Skip to main content

Command Palette

Search for a command to run...

Building a Thinking Model from a Non-Thinking Model Using Chain-of-Thought

Published
•4 min read•View as Markdown
Building a Thinking Model from a Non-Thinking Model Using Chain-of-Thought

Ever wonder how some AI answers tough questions, not just simple ones? It's like the difference between someone memorizing facts versus someone who can actually think through a problem. In this article, we'll explore a cool trick called "Chain-of-Thought" (CoT) that helps AI go from just knowing answers to figuring them out.

The "Robot" AI (Non-Thinking Model)

Imagine an AI that's like a really fast robot. If you ask it "What's 2 + 2?", it instantly says "4" because it's programmed with that exact answer. If you ask "What's the capital of France?", it knows "Paris" from its huge list of facts.

Problem: What if you ask something tricky? "If I leave my house, turn left, then turn right, then turn left again, where am I facing compared to my starting point?"

Our "robot" AI would likely be stumped! It doesn't have a way to break down the problem, take mental steps, and figure out the answer. It can't "think" about the turns.

Introducing "Chain-of-Thought": Teaching AI to "Show Its Work"

This is where CoT comes in. It's a simple idea: we tell the AI to explain its thinking process before giving the final answer. Just like a student showing their work on a math problem!

Think of it like this:

  • You: "What's 5 + 3 - 2?"

  • AI (with CoT): "Okay, first I'll add 5 and 3, which is 8. Then, I'll subtract 2 from 8, which leaves 6. So the answer is 6."

See? It didn't just blurt out "6." It showed its "thought" process, step-by-step.

How to Build a "Thinking" AI (Simply!)

You can try this with many AI tools available today, like those powered by Gemini, ChatGPT, or other language models.

Step 1: Pick Your AI Friend

Choose an AI you can chat with. These AIs are designed to understand and generate text.

Step 2: The Magic Phrase (The Prompt)

This is the most important part! Instead of just asking a question, you add a special phrase.

Simple CoT Example:

Instead of: "What is the capital of Japan?"

Try: "Let's think step by step. What is the capital of Japan?"

For a slightly harder question, you might see the AI try to break it down.

Better CoT Example (with an example):

This works even better if you give the AI an example of how you want it to "think."

**Example:**
Question: If I have 3 apples and give 1 away, then buy 2 more, how many do I have?
Thought:
1. I started with 3 apples.
2. I gave away 1, so 3 - 1 = 2 apples left.
3. I bought 2 more, so 2 + 2 = 4 apples.
Answer: 4 apples.

**Your Turn:**
Question: My dog ate 4 treats, then I gave him 3 more, and then he buried 1. How many treats did he eat in total?
Thought:

When you give the AI this kind of instruction, it learns from your example to "think" in steps for your new question!

What to include in your "thinking" prompt:

  • "Let's think step by step." (Always a good start!)

  • Give Examples: Show the AI how you want it to break down problems.

  • Be Clear: Tell the AI exactly what you want it to do ("First, do this...", "Then, figure that out...").

Step 3: Test and Improve

  • Try it out! Ask your AI all sorts of questions, some easy, some tricky.

  • See its "thoughts": Look at the steps it generates. Does it make sense?

  • Learn from mistakes: If the AI gets it wrong, look at its "thought" process. Where did it mess up? You can then adjust your prompt to guide it better next time. Maybe add a new example that helps it avoid that specific mistake.

Why is This Awesome?

  • It's not a Black Box: When an AI uses CoT, you can actually see how it got to its answer. This is super helpful if it makes a mistake, because you can pinpoint where it went wrong.

  • More Trustworthy: An AI that can explain itself feels more reliable, especially for important tasks.

  • Smarter Solutions: It helps the AI tackle problems that need more than just memorized facts – problems that require real "thinking" steps.

Conclusion

You don't need to be a coding genius to make an AI "think." By simply asking it to "show its work" using Chain-of-Thought prompts, you can transform a simple AI into one that can reason, solve problems step-by-step, and amaze you with its newfound "smart thinking" abilities. Give it a try – you might be surprised at what your AI can do!