Lesson 7: Think Step by Step
Why Showing Your Work Isn’t Just for Math Class
Here’s a riddle for you: A farmer has 17 sheep. All but 9 run away. How many sheep does the farmer have left? Quick, what’s your gut answer? If you said “8,” you’re not alone. Many people do. But the correct answer is 9. (“All but 9” means 9 remain.) Here’s the fascinating part: when researchers asked AI models this exact question, the models often got it wrong too, unless they were asked to think through the problem step by step. When prompted to reason out loud, accuracy jumped dramatically. This lesson is about that simple but powerful idea: asking AI to show its work doesn’t just help you understand the answer; it helps the AI find the right answer in the first place.Core Concepts
Why “Just Give Me the Answer” Often Fails
Remember back in Lesson 2 when we talked about how AI doesn’t really “think”? It predicts the most likely next word based on patterns. This works beautifully for simple tasks, but it can trip up on anything that requires multiple logical steps. Think about it this way. Imagine I asked you to multiply 23 by 47 in your head. Could you do it? Maybe. But it would be much easier (and you’d be much less likely to make mistakes) if you could write out the steps:The Magic Phrase: “Let’s Think Step by Step”
Researchers discovered something almost comically simple: adding “Let’s think step by step” to a prompt can dramatically improve AI performance on reasoning tasks. This technique is called Chain of Thought (CoT) prompting. Here’s why it works. When you ask AI to explain its reasoning, you’re essentially creating a trail of logic. Each step builds on the previous one. If the AI makes a wrong turn early on, it’s more likely to catch it, and you’re more likely to spot it too. Without Chain of Thought:Prompt: If I have 3 apples and buy 2 bags with 6 apples each, then give away half of all my apples, how many do I have? AI Response: You have 6 apples.Maybe that’s right? Let’s see. With Chain of Thought:
Prompt: If I have 3 apples and buy 2 bags with 6 apples each, then give away half of all my apples, how many do I have? Let’s think through this step by step. AI Response:Now you can see the reasoning and catch the answer that’s actually 7.5, not 6. You can also see exactly where the AI went and verify each step makes sense.You would have 7.5 apples. (In practical terms, you’d have 7 apples and would have given away 8.)
- Starting apples: 3
- Apples from 2 bags (6 each): 2 x 6 = 12
- Total apples: 3 + 12 = 15
- After giving away half: 15 / 2 = 7.5
Breaking Complex Tasks Into Smaller Pieces
“Let’s think step by step” is great, but sometimes you need to be even more explicit about how to break down a problem. This is especially true for tasks that aren’t purely mathematical. Let’s say you want AI to help you plan a community event. You could ask:“Help me plan a summer barbecue for 50 people.”And you’ll get a generic list. Serviceable, maybe. But compare that to:
“I need to plan a summer barbecue for 50 people. Walk me through this step by step:By explicitly laying out the steps you want the AI to walk through, you get a much more thorough, organized, and useful response. You’ve essentially given the AI a roadmap for its thinking. Pro tip: You don’t always know the right steps in advance, and that’s okay! You can ask the AI to figure out the steps first:
- First, what key decisions do I need to make?
- Then, what food and supplies will I need?
- Next, what’s a realistic timeline for preparation?
- Finally, what could go wrong and how should I prepare for it?”
“I want to learn how to brew coffee at home like a pro. Before giving me instructions, first break this goal down into the key skills or areas I’d need to learn, then walk me through each one.”This two-stage approach (ask for the framework, then ask for the details) is incredibly powerful for learning and tackling unfamiliar topics.
When to Ask for Reasoning vs. Just Results
Not every prompt needs Chain of Thought. Asking AI to “think step by step” about what time zone Tokyo is in is overkill. The answer is simple and factual. So when should you deploy this technique? Here’s a handy guide: Use Chain of Thought when:- The task involves multiple steps or calculations
- You need to verify the AI’s logic (not just trust the answer)
- The problem has potential for misinterpretation
- You’re dealing with word problems, puzzles, or conditional logic
- You’re making a decision and want to see the trade-offs considered
- The stakes are high enough that a wrong answer matters
- The question has a simple, factual answer
- You’re doing creative tasks where the “why” doesn’t matter
- Speed is more important than verification
- You already trust the straightforward response
Try It Yourself
Exercise 1: The Classic Test
Try this prompt in your favorite AI tool:“A bat and a ball cost 1.00 more than the ball. How much does the ball cost?”Note the answer. Now try:
“A bat and a ball cost 1.00 more than the ball. How much does the ball cost? Work through this step by step before giving your final answer.”Compare the responses. Did you get the intuitive (but wrong) answer of 0.05, because if the ball costs 1.05, which is 1.10.
Exercise 2: Real-World Reasoning
Pick a genuine decision you’re facing (or make one up), then try this prompt:“I’m trying to decide whether to [your decision]. Think through this systematically:Notice how the structured reasoning gives you not just an answer, but a framework for thinking about the problem yourself.
- First, list the key factors I should consider
- Then, evaluate the pros and cons of each option
- Consider what information I might be missing
- Finally, suggest which option seems strongest and why”
Exercise 3: Explain It To Me
Choose a concept you’d like to understand better (how compound interest works, why the sky is blue, how vaccines work, anything). Try:“Explain [concept] to me. Build up the explanation step by step, starting from the most basic foundation and adding one piece at a time until I understand the full picture.”This forces the AI to construct a logical progression rather than dumping information on you all at once.

