Evidence Detectives Slides Lesson 1.1
Anecdotes vs Evidence
The Battle of Pathos and Logos in Research
Data Literacy
Debate Prep
The Viral Story
"My cousin's best friend stopped drinking soda and grew three inches in a month. Soda clearly stunts growth! Everyone needs to know!"
4.2 Million Shares
Why does this story spread faster than a 50-page medical journal article?
Pathos: It touches our emotions.
Relatability: It happens to a "person."
The Hasty Generalization: We love simple answers.
Know Your Tools
Anecdotal
Evidence based on personal observation, individual stories, or isolated incidents.
"I once saw..." / "In my experience..."
Empirical
Evidence based on systematic observation, measurement, and experimentation across a population.
"Data shows..." / "The study found..."
THE STRATEGIC BALANCE
Anecdotal (Pathos)
Hooks the audience, humanizes the issue, makes the problem "real."
Empirical (Logos)
Proves the scope of the problem, provides credibility, and justifies policy changes.
"An anecdote without data is just a story. Data without an anecdote is just a spreadsheet."
The Danger Zone
The Hasty Generalization
This occurs when a researcher or debater takes a small, unrepresentative sample (like one person's story) and claims it applies to an entire group.
CLAIM:
"My grandfather smoked two packs a day and lived to be 100."
LOGICAL ERROR:
Generalizing an "outlier" to represent the medical reality of billions.
Evidence Classification Worksheet Pathos vs. Logos
Debate Research & Data Literacy Unit
Student Name
Part 1: The Evidence Sort
Identify whether each piece of evidence is Anecdotal (A) or Empirical (E) . Then, explain the primary strength of that evidence type.
"A 2023 study by the Pew Research Center found that 76% of teens believe social media has a mostly positive impact on their friendships."
Strength: ________________________________________________________________
"I interviewed Sarah, a freshman who says she lost all her confidence after a single negative comment on her Instagram post."
Strength: ________________________________________________________________
"Average global temperatures have risen by 1.1 degrees Celsius since the late 19th century, according to NASA satellite data."
Strength: ________________________________________________________________
"Farmer Joe in Nebraska claims this was the hottest summer he has experienced in his 50 years of farming."
Strength: ________________________________________________________________
Part 2: The Generalization Audit
Analyze the following debate claim. Identify the logical error and rewrite the argument to be statistically valid.
Claim to Analyze:
"We should ban school uniforms because my friend Marcus says they are uncomfortable and they make him feel like he can't express his true self. If Marcus feels this way, it's clear that uniforms are destroying the mental health of all students in America."
What is the logical error in this claim?
How would you "fix" this argument? (What kind of data would you need to find?)
Part 3: The Debater's Choice
Topic: Should the voting age be lowered to 16?
Which piece of evidence would be better for a Hook (Introduction) and which would be better for a Point (Body Paragraph)? Explain why.
Evidence A
"A 20-year-old study in Austria showed that 16-year-olds have the same level of political knowledge as 18-year-olds."
Evidence B
"Elena, a 16-year-old climate activist, works 20 hours a week and pays taxes but has no say in the leaders who decide climate policy."
Your Selection & Strategy:
Anecdotal Empirical Teacher Guide Teacher Facilitation Guide
Lesson 1: Anecdotal vs Empirical Evidence
Data Literacy 9
Objective
Students will distinguish between personal anecdotes and empirical data, identifying the hasty generalization fallacy and choosing the right evidence for specific rhetorical goals.
Pacing
Hook: 10 minsDirect Instruction: 15 minsActivity: 20 minsDebrief: 10 mins
Key Concept
Hasty Generalization
Drawing a broad conclusion from a small, unrepresentative sample size.
Worksheet Answer Key
Part 1: The Evidence Sort
Scenario Type Primary Strength 1. Pew Research Study E Representativeness; shows broad consensus of 76%. 2. Sarah Interview A Emotional connection (Pathos); humanizes the impact. 3. NASA Data E Scientific objectivity; undeniable global trend. 4. Farmer Joe A Contextual/Local lived experience; vivid storytelling.
Part 2: Generalization Audit
The Flaw: Hasty Generalization. Using one friend's discomfort (Marcus) to conclude that uniforms destroy the mental health of all students.
The Fix: Look for surveys on student self-esteem in uniform vs. non-uniform schools, or psychological studies on attire and student well-being.
Part 3: Debater's Choice
Hook: Elena (Evidence B). Personal stories capture interest and build empathy immediately.
Point: Austrian Study (Evidence A). Claims need logical backing to be persuasive to judges/skeptics.
Class Discussion Prompts
"Why do you think politicians often start their speeches with an anecdote about 'one person they met' in a small town?"
"Can an anecdote ever 'disprove' a large-scale statistic? Why or why not?"
Causation Lab Slides Lesson 1.2
Correlation & Causation
The Logic of the "Hidden Connection"
Logic & Reasoning
Causal Mechanisms
The Ice Cream Mystery
May June July Aug
Ice Cream Sales & Shark Attacks
"When ice cream sales go up, shark attacks also go up."
Does eating mint chocolate chip cause a shark to bite you?
The Hidden Variable:
HEAT / SUMMER
Correlation
A statistical relationship where two variables move together (either up or down).
"X and Y happen at the same time."
Causation
A relationship where one event (the cause) directly makes the other event happen (the effect).
"X makes Y happen."
"Correlation does not imply causation."
Spurious Correlations
When two things have zero connection, but the math says they do.
Number of people who drowned in pools
CORRELATES WITH
Films Nicolas Cage appeared in
Cheese consumption
CORRELATES WITH
People who died becoming tangled in bedsheets
Divorce rate in Maine
CORRELATES WITH
Margarine consumption
Find the Mechanism
To prove causation, a researcher must explain the mechanism —the physical or logical "How" and "Why."
The Debater's Checklist:
Is there a third variable (like heat) explaining both?
Is it just a coincidence ?
Does X physically lead to Y?
Spurious Mechanism Activity The Mechanism Challenge
Debate Research: Correlation & Causation
Student Name
Part 1: Identifying the Hidden Variable
For each correlation below, identify a Third Variable that might be causing both, or explain why it is likely just a Spurious Correlation (coincidence).
Observation:
"Cities with more churches also tend to have significantly higher crime rates."
The Hidden Variable / Explanation:
Observation:
"Student who play chess regularly have higher math scores than students who don't."
The Hidden Variable / Explanation:
Observation:
"The number of pool drownings in Virginia increases when more Nicolas Cage movies are released."
The Hidden Variable / Explanation:
Part 2: Building the Mechanism
In a debate, you can't just show a graph. You must explain the causal chain . Map out the "Mechanism" for the following claim.
"Starting school one hour later causes higher GPA scores."
Cause (X)
School starts 1 hour later
Mechanism (How?)
Effect (Y)
GPAs Increase
Write the Causal Chain Explanation (How does X physically/biologically lead to Y?):
Part 3: Reverse Causation
Sometimes Y causes X. Analyze the claim below and explain how the "arrow" might actually point the other way.
The Claim:
"Studies show that people who own dogs are more active and exercise more than non-owners. Therefore, getting a dog causes you to become a healthy person."
How could this be Reverse Causation?
Causation Answer Key Teacher Answer Key
Lesson 2: Correlation and Causation
Data Literacy 9
Part 1: Identifying the Hidden Variable
Scenario 1: Churches & Crime
Observation: More churches correlate with higher crime.
Hidden Variable: Population Size. Larger cities naturally have more of everything (churches, parks, crimes, people). The churches aren't causing crime, nor is crime causing churches.
Scenario 2: Chess & Math Scores
Observation: Chess players have higher math scores.
Hidden Variable: Socioeconomic Status or Selection Bias. Students in well-funded schools with chess clubs may have better resources overall. Also, students naturally talented at logic (math) may be drawn to logic-based games (chess).
Scenario 3: Pool Drownings & Nicolas Cage
Observation: Drownings correlate with Cage movies.
Explanation: Spurious Correlation (Coincidence). There is no logical mechanism here. With enough data points, random trends will occasionally align. This is a classic "false" correlation used in statistics classes.
Part 2: Causal Chain
A strong student answer should include a biological link:
STARTLATER START
MORE SLEEP (CIRCADIAN RHYTHM)
BETTER COGNITIVE FUNCTION
HIGHER GPA
Part 3: Reverse Causation
"The healthy person gets the dog."
Explain that active, healthy, and mobile people are more likely to adopt a dog in the first place because they have the energy to walk it. The health comes first; the dog comes second.
Teaching Tip:
"The most dangerous part of a debate is when an opponent presents a 'stat' that sounds logical but lacks a mechanism. Teach students to always ask: How exactly does that happen? If they can't explain the step-by-step process, it's just a correlation."
Sampling Secrets Slides Lesson 1.3
Sample Size & Methodology
The Secret Ingredients of a Reliable Study
N-Value
Protocol
The "N" Number
n = Sample Size
The total number of individuals or data points included in a study.
The Danger of Small N:
"I surveyed 3 people in this room. 2 of them hate pineapple on pizza. Therefore, 66% of all Americans hate pineapple on pizza."
100?
General Rule: The larger the N, the more reliable the study.
Is your sample "Like" the whole?
Selection Bias
When the people chosen for the study are not a diverse reflection of the group being claimed.
"Surveying only college students to understand how retired seniors feel about technology."
The Fix: Randomization
Ensuring every member of the population has an equal chance of being selected for the study.
The "Gold Standard" of Methodology.
Research Red Flags
Conflict of Interest
Who paid for the study? (Example: A soda company funding a study on sugar's health benefits).
Self-Reporting Bias
Did participants just answer a survey? People often lie or misremember their behavior.
The "Debater's Question"
"Before I accept your number, can you tell me: how many people were surveyed, and who chose them?"
Methodology Audit Worksheet The Methodology Audit
Debate Research: Evaluating Study Validity
Auditor: __________________
Date: __________________
Instructions: Below are three summaries of fictional research studies. For each study, identify the Methodology Red Flag (N-size, Bias, or Protocol) and explain why the results should be questioned in a debate.
1
Study: The "Sleep for Success" Initiative
"A study conducted by a leading mattress manufacturer surveyed 12 professional athletes about their sleep habits. 11 out of 12 reported that sleeping on the company's 'UltraCloud' mattress helped them recover faster and perform better in games. The company claims their mattress is scientifically proven to increase athletic performance."
Primary Red Flag:
Explain the Flaw:
2
Study: Teen Tech Usage Trends
"To determine how much time the average American teenager spends on social media, researchers set up a booth at a weekend-long 'Esports and Gaming Convention' in Los Angeles. They surveyed 5,000 attendees. The results showed that teens spend 9 hours a day online. The researchers published a report titled 'Generation Digital: The 9-Hour Reality.'"
Primary Red Flag:
Explain the Flaw:
3
Study: Coffee and Focus
"A university researcher wanted to see if caffeine helps students study. They asked 500 students to remember a list of 20 words. 250 students were given coffee before the test, and 250 were given nothing. The coffee group scored 15% higher. However, the study didn't check if the students in the coffee group were already regular coffee drinkers or if they had slept the night before."
Primary Red Flag:
Explain the Flaw:
The Debater's Shield
If you were debating an opponent who used Study #1 as their main piece of evidence, what is the exact question you would ask them during Cross-Examination to expose the weakness?
Sampling Teacher Key Teacher Audit Key
Lesson 3: Sample Size and Methodology
Data Literacy 9
Study Primary Red Flag Analysis Notes 1. Sleep for Success Conflict of Interest / Small N Conflict: The study was funded/conducted by the mattress company. They have a financial incentive for a positive result.Sample Size: n=12 is extremely low. You cannot claim something is "scientifically proven" based on 12 people.2. Teen Tech Usage Selection Bias Bias: The sample (teens at a gaming convention) is not representative of "average" teens. Gaming enthusiasts are significantly more likely to spend more time online than the general population.3. Coffee and Focus Confounding Variables Protocol: The study failed to control for external factors like baseline caffeine tolerance or sleep deprivation. The higher scores might not be from the coffee, but from the groups being fundamentally different before the test started.
The "Shield" Answer Key
A strong student question for Study #1 would be:
"Given that your study was funded by the manufacturer itself and only looked at 12 people, how can you claim this is a universal scientific fact rather than just a marketing survey?"
Teaching Tip
Remind students that in a Cross-Examination , they shouldn't just say "The study is bad." They should ask questions that force their opponent to admit the flaws (e.g., "Who funded that study?" or "How many people were in that sample?").
Graph Gymnastics Slides Lesson 1.4
Graph Gymnastics
How to Lie with Pictures
Visual Literacy
Manipulation
Trick #1: The Zoom-In
The Truncated Y-Axis
Starting the Y-axis at a high number (like 95) instead of 0 to make a tiny difference look like a massive explosion.
Example Result:
"Interest rates went from 1.2% to 1.3%, but the graph makes the bar look four times as tall."
1.2%
1.3%
Axis starts at 1.15%
Trick #2: Scale Stretching
Stretching the X
Making the time periods inconsistent to hide a sudden drop or flatline in the data.
2010 2011 2012 2024
The "3D" Pie Chart
Using 3D perspectives to make the "slice" at the front look larger than the slices in the back, even if its percentage is lower.
"Perspective is the Enemy of Truth."
The Antidote
How to spot the lie in 3 seconds:
Check the Y-Axis Zero Point .
Check the Intervals (Are they equal?).
Ignore the colors; read the Raw Data Table .
Honest Graph Redesign Activity Honest Graph Redesign
Visual Literacy Challenge: Spotting the Manipulation
Student: __________________
Data Designer
The "Misleading" Evidence
Graph Title: "EXPLOSIVE GROWTH IN CAFFEINE ADDICTION"
This graph appeared in a local newspaper. It claims that coffee consumption has "spiraled out of control" in the last three years.
Raw Data Table:
<table class="w-full text-sm"><tbody><tr class="border-b"><td>2021</td><td class="text-right font-bold">1.8 cups/day</td></tr><tr class="border-b"><td>2022</td><td class="text-right font-bold">1.85 cups/day</td></tr><tr class="border-b"><td>2023</td><td class="text-right font-bold">1.9 cups/day</td></tr></tbody></table>
CUPS PER DAY
2021
2022
2023
*Axis starts at 1.75 cups
1. How is this graph misleading?
2. What story does the Raw Data tell?
The "Honest" Redesign
Redraw the graph below using an honest scale (start the Y-axis at 0). Label your axes correctly.
Year
Cups per day
Final Verdict:
If you were a debater arguing that caffeine addiction is NOT a crisis, how would you describe this data to a judge using the redesigned graph?
Visual Literacy Cheat Sheet Visual Literacy Cheat Sheet
Debater's Guide to Spotting Data Manipulation
The Y-Axis Trap
"The most common way to make a molehill look like a mountain."
● The Truncated Axis: Does the axis start at 0? If not, the bars or lines are exaggerated.
● Inconsistent Scales: Do the numbers jump from 10 to 20, then suddenly to 100?
Check: "What is the actual numerical difference?"
Time Distortion
"Choosing specific dates to create a false narrative of growth or decline."
● Cherry-Picking: Does the graph start on a weird date? (e.g., starting a 'crime drop' graph on the day crime was at its all-time high).
● The X-Axis Gap: Are there years missing between data points?
Check: "What happened before or after this time frame?"
Visual Illusions
"Using design to distract from the actual data points."
● 3D Effects: Perspectives tilt slices of pie charts to make them look bigger.
● Icon Sizing: Doubling the height of a person-icon often quadruples the area, making the increase look way bigger than it is.
The Attack Script
How to challenge a graph in a round:
"While your graph appears to show a massive increase, isn't it true that you started your Y-axis at 90, making a 2% change look like 20%?"
"Why does this data set skip the years between 2018 and 2022? Are you omitting data that contradicts your point?"
"If the graph has no raw numbers, it's not evidence. It's an illustration."
Consensus Quest Slides Lesson 1.5
Consensus Quest
Finding the Gold Standard of Evidence
Meta-Analysis
Master Search
The Problem: Study Whiplash
Monday's News:
"New study says coffee is great for heart health!"
Tuesday's News:
"New study says coffee increases heart risk."
Which one do you use in your debate round?
The Solution:
The Meta-Analysis
A "Study of Studies" that combines the results of dozens of trials to find the scientific consensus .
The Pyramid of Truth
1. Meta-Analysis / Systematic Review
2. Randomized Controlled Trials
3. Observational Studies
4. Case Reports / Opinions
5. Anecdotes / Viral Posts
"In a debate, a Level 1 piece of evidence will always defeat a Level 5 piece of evidence in the eyes of a logic-based judge."
How to Find the Gold
The "Magic Words"
"Topic X" + "Meta-analysis"
"Topic X" + "Systematic review"
"Topic X" + "Literature review"
Why it works:
"Meta-analyses fix the 'Sample Size' problem by turning 100 people into 100,000 people."
Targets the consensus, not the outlier.
Consensus Hunt Activity The Consensus Hunt
Advanced Research Workshop: Finding Meta-Analyses
Researcher: __________________
Target: Gold Standard Evidence
Mission Briefing
Debaters often get stuck in "Evidence Wars" where one person has a study saying "Yes" and the other has one saying "No." Your goal is to find a Meta-Analysis or Systematic Review to settle the debate.
Phase 1: Your Search Terms
Choose a debate topic (e.g., "Ban Social Media for Minors," "School Uniforms," "Universal Basic Income"). Write down 3 specific search strings you would use to find a meta-analysis.
String #1...
String #2...
String #3...
Phase 2: The Consensus Audit
Once you find a meta-analysis (use Google Scholar if possible), answer the following:
Title of Meta-Analysis:
Number of Studies Reviewed (k):
Total Participants (n):
The "Final Verdict" (What was the overall consensus?):
Phase 3: The Debate Pitch
Imagine your opponent just cited a single study of 50 people that contradicts your findings. Write a 30-second rebuttal that uses your meta-analysis to "out-weigh" their evidence.
"While my opponent points to a single study... our evidence is a meta-analysis of over ________ individual studies..."
Hierarchy Evidence Handout Hierarchy of Evidence
The Debater's Gold Standard Reference
1
Meta-Analysis & Systematic Reviews
What it is: A study that mathematically combines the results of dozens of previous studies.
Why it wins: It proves a global consensus and eliminates the 'fluke' results of small trials.
2
Randomized Controlled Trials (RCTs)
What it is: A single study where participants are randomly assigned to a 'treatment' or 'control' group.
Why it wins: It is the best way to prove causation rather than just correlation.
3
Observational / Cohort Studies
What it is: Researchers observe people in the real world over time without interfering.
Debater's Note: Great for long-term trends, but vulnerable to "Hidden Variables."
4
Expert Opinion & Case Reports
What it is: One person's professional judgment or a report on one specific event.
Why it's weak: It's still just Level 4 evidence—opinions can be biased or wrong.
5
Anecdotes & Viral Stories
What it is: Individual stories from TikTok, news hooks, or personal experiences.
Use for: Hooks only. Do not use as logical proof.
Master Search Tip:
"Look for Google Scholar results with the most citations. If 5,000 other scientists cited a study, it's more likely to be the consensus."
The "K" value:
"In a meta-analysis, k stands for the number of studies combined. A higher k means a stronger consensus."
