Behavior Design Slides BEHAVIOR BY DESIGN
Introduction to Operant Conditioning
How is this possible?
[Imagine: Pigeon playing ping-pong or rat basketball]
Pigeons don't play ping-pong in the wild.
Reflex vs. Choice
Classical
Involuntary (reflexive) responseAssociation between stimuli
Learner is passive
Operant
Voluntary (emitted) behaviorAssociation between action & result
Learner is active
The Law of Effect
"Behaviors followed by favorable consequences become more likely, and behaviors followed by unfavorable consequences become less likely."
— EDWARD THORNDIKE (1898)
The Skinner Box
B.F. Skinner expanded Thorndike’s work by creating the Operant Chamber .
A bar or key the animal presses
A food dispenser (reinforcement)
Signals (light/sound)
Operant Chamber Diagram Placeholder
Quick Challenge
A child learns that if they say "Please," they get a cookie. If they throw a tantrum, they go to time-out.
Is this Operant or Classical?
Defend your answer using the "Law of Effect."
Conditioning Lab Report Worksheet Conditioning Lab Report
Subject: Classical vs. Operant Conditioning
Student Name:
Date:
1
The Law of Effect
In your own words, explain how Edward Thorndike’s "Law of Effect" describes the relationship between a behavior and its consequence.
2
Feature Comparison
Feature Classical Conditioning Operant Conditioning Type of Behavior Is the learner active? Timing of Stimulus Comes BEFORE the behavior Comes AFTER the behavior Key Goal
3
Scenario Analysis
Scenario A: Pavlov's Dog
A dog hears a bell and begins to salivate because it has learned that the bell signals food is coming.
Classical
Operant
Scenario B: Skinner's Rat
A rat accidentally presses a lever and receives a sugar pellet. The rat now presses the lever 100 times per hour.
Classical
Operant
Scenario C: Exam Success
Maria studies for 5 hours and gets an A. In the future, Maria studies even longer for her psychology exams.
Classical
Operant
Operant Quadrants Slides THE FOUR QUADRANTS
Reinforcement & Punishment Decoded
Mastering the Terms
The Math of Behavior
Positive
Something is ADDED
Negative
Something is REMOVED
The Goal of Behavior
Reinforcement
Increases the behavior
Punishment
Decreases the behavior
Effect on Behavior
Positive (+)
Negative (-)
Positive Reinforcement
Add reward to increase behavior
Negative Reinforcement
Remove aversives to increase behavior
Positive Punishment
Add aversives to decrease behavior
Negative Punishment
Remove reward to decrease behavior
The Common Confusion
Negative Reinforcement
"Escape or Avoidance"
Example: Buckling your seatbelt to stop the annoying buzzing sound.
RESULT: Behavior INCREASES
Punishment
"Deterrence"
Example: Getting a ticket for speeding.
RESULT: Behavior DECREASES
Scenario Sorter Worksheet Scenario Sorter
Operant Conditioning Workshop
Name
Identify the quadrant for each scenario. Follow the logic:Added (+) or Removed (-) ?Increase (↑) or Decrease (↓) ?
Behavioral Scenario
Added / Removed
Incr / Decr
Final Quadrant
You take an aspirin to get rid of a headache. In the future, you take aspirin the moment you feel pain.
-
↑
↓
A teenager stays out past curfew and has their phone taken away. They don't stay out late again.
-
↑
↓
A dog gets a treat for sitting on command. The dog sits more often when commanded.
-
↑
↓
A driver gets a $200 ticket for speeding. They stop speeding on that road.
-
↑
↓
A child is teased for wearing a certain shirt and never wears it to school again.
-
↑
↓
Critical Analysis
Why is negative reinforcement often confused with punishment ? Explain the fundamental difference in the desired outcome of the behavior.
Reinforcement Timing Slides Timing is Everything
Schedules of Reinforcement
How do you schedule?
Question 1: What triggers it?
RATIO
Reinforcement after a number of RESPONSES .
INTERVAL
Reinforcement after a period of TIME .
Question 2: Is it predictable?
FIXED
The requirement is CONSTANT and known.
VARIABLE
The requirement CHANGES or is random.
Fixed Ratio (FR)
"Buy 10, get 1 free"
Fast response rate with short pauses after reinforcement.
Variable Ratio (VR)
"Slot Machines"
Extremely high, steady response rates. Hardest to extinguish.
Fixed Interval (FI)
"The Weekly Quiz"
"Scalloped" pattern: activity increases as the deadline nears.
Variable Interval (VI)
"Checking Email"
Slow, steady response rates. You never know when the message will arrive.
Persistence & Extinction
What is Extinction?
When reinforcement stops, the behavior eventually stops.
The Rule of Persistence
Variable schedules (unpredictable) create behaviors that are much harder to stop than fixed schedules.
The Gambler's Fallacy
Why do people keep playing slot machines after 20 losses, but stop using a vending machine after 1 failed attempt?
Reinforcement Lab Worksheet The Reinforcement Lab
Experimental Analysis of Behavior
Name: ________________________
Date: ________________________
Lab Objectives
Simulate four schedules of reinforcement.
Analyze response patterns and extinction.
Part 1: Scenario Identification
A: A factory worker is paid $50 for every 10 units they assemble.
Schedule:
B: You check your phone for a text message from your crush.
Schedule:
C: A slot machine pays out a jackpot on an unpredictable basis.
Schedule:
D: You receive a paycheck every Friday at 5:00 PM.
Schedule:
Part 2: Response Rate Prediction
Sketch the typical cumulative response curve for each schedule. Label the "Scallop" and the "Post-Reinforcement Pause."
Cumulative Responses
Time
Fixed Interval (FI)
Cumulative Responses
Time
Variable Ratio (VR)
Experimental Conclusion
Based on the "resistance to extinction," why is it more difficult to stop a behavior that was reinforced on a Variable Ratio schedule compared to a Fixed Ratio schedule?
Shaping Success Slides THE ART OF SHAPING
Building Complex Behaviors Step-by-Step
1
2
3
What is Shaping?
"The process of reinforcing successive approximations toward a target behavior."
Start Small
Reinforce any behavior that is even slightly similar to the goal.
Raise the Bar
Stop reinforcing the old step and only reward the closer one.
Workshop: Human Shaping
You are the Trainer. Your partner is the Learner.
Use ONLY a "Click" sound as reinforcement.
NO speaking or gestures.
Target: Touch the light switch.
The Successive Steps
1. Reward looking at the switch.
2. Reward moving a step toward it.
3. Reward raising a hand near it.
4. Reward touching it.
Chaining Behaviors
Shaping
Developing a new behavior from scratch by rewarding approximations.
Chaining
Linking existing behaviors together in a specific sequence (e.g., tying shoes).
Shaping Protocol Log Worksheet Shaping Protocol Log
Subject: Human Behavioral Shaping
Experimental Pair
Trainer:
Learner:
Target Behavior
Example: Touch the blue marker on the desk, spin 360 degrees, or pick up the textbook.
Observation Table
Step Behavioral Approximation (What did they do?) Reinforcement Strategy (When did you click?) Success? 1 Y / N 2 Y / N 3 Y / N 4 Y / N 5 Y / N
Post-Protocol Reflection
Trainer Perspective
What was the most difficult part of shaping your partner’s behavior without using words or gestures?
Learner Perspective
How did you feel when you were performing behaviors but NOT receiving reinforcement (a click)?
Behavioral Engineering Slides BEHAVIORAL ENGINEERING
Ethics & Practical Intervention
Designing for Change
To change behavior, you need a blueprint:
1 Identify Target Behavior
2 Choose Quadrant (PR/NR/PP/NP)
3 Set the Reinforcement Schedule
4 Define Ethical Boundaries
"It is the environment that shapes us, but we can shape the environment."
The Ethics of Control
"Nudging"
Using subtle environmental cues to influence choices without removing freedom (e.g., placing fruit at eye level in cafeteria).
Is it Ethical?
When does 'encouragement' become 'manipulation'? Who decides which behaviors are "good" to increase?
The Workplace
Companies use gamification (points, badges) to increase productivity. Are workers being "Skinner-boxed"?
Your Final Mission
You are a behavioral consultant hired to solve a problem:"The employees at 'TechGiant' are ignoring security protocols."
Design a plan that uses BOTH reinforcement and nudging.
Ready for Deployment?
Behavioral Intervention Plan Template Behavioral Intervention Design
Psychology Applied Case Studies
Lead Consultant Name
Project Date
Case Study Analysis
Scenario: The Lunchroom Litter Crisis
A high school cafeteria is plagued by students leaving trays and trash on tables. Previous attempts at "Positive Punishment" (Saturday detentions) have failed and created resentment. The administration wants a plan that uses Reinforcement to build a culture of cleanliness.
1. Precise Behavioral Target
What exactly should the students do? Be specific.
2. Selected Quadrant
PR, NR, PP, or NP? Why?
3. Reinforcement Schedule
Fixed/Variable Ratio/Interval? Why?
4. Intervention Description
Detail how you will implement the rewards/consequences.
Ethical Audit
What is one potential negative side effect of your plan? Does this plan respect the students' autonomy (freedom)?
Operant Conditioning Answer Key Conditioning Key
Teacher Reference Only
Master Sequence: Behavior Modification
Lesson 1: Comparison Logic
Classical Conditioning
Reflexive/Involuntary
Stimulus precedes behavior
Learner is passive
Operant Conditioning
Voluntary/Emitted
Consequence follows behavior
Learner is active
Lesson 2: Scenario Sorter Key
Aspirin for headache: Behavior (Taking aspirin) Increases (↑), Stimulus (Pain) Removed (-). Negative Reinforcement
Phone taken away: Behavior (Curfew break) Decreases (↓), Stimulus (Phone) Removed (-). Negative Punishment
Treat for sitting: Behavior (Sitting) Increases (↑), Stimulus (Treat) Added (+). Positive Reinforcement
Speeding ticket: Behavior (Speeding) Decreases (↓), Stimulus (Ticket) Added (+). Positive Punishment
Teased for shirt: Behavior (Wearing shirt) Decreases (↓), Stimulus (Teasing) Added (+). Positive Punishment
Lesson 3: Schedule Response Rates
Variable Ratio (VR)
Pattern: Steadiest and highest rate. Almost a straight line up.
Why: You never know when the next press will pay off, so you press as fast as possible.
Fixed Interval (FI)
Pattern: "Scalloped." Long pause after reward, then sharp rise as interval ends.
Why: The animal learns that responses don't matter until the time is almost up.
Lesson 4 & 5: Teaching Tips
Shaping Pitfall:
Watch for students who click too late. Reinforcement must be immediate to associate with the correct approximation. If they wait 2 seconds, the student might have already changed posture.
The Ethics Debate:
Common misconception: Reinforcement is "bribing." Counter-point: A bribe is given before behavior to influence it; reinforcement is earned after behavior to maintain it.
