Black Box Challenge Slides Psychology 301: Behavioral Science
The Black Box Challenge
"From Thorndike's Law of Effect to Skinner's Radical Behaviorism"
Lab Session 01
Rituals of the Random
In 1948, B.F. Skinner placed hungry pigeons in a box where food was delivered every 15 seconds, regardless of their behavior.
The Result:
• Pigeon A: Counter-clockwise turns
• Pigeon B: Thrusting head into corners
• Pigeon C: Pendulum-like tossing movements
"The bird behaves as if there were a causal relation between its behavior and the presentation of food."
Thorndike & The Law of Effect
Est. 1898
The Puzzle Box
Cats escaped through trial and error. Success resulted in immediate "satisfaction" (food).
The Law
"Behaviors followed by favorable consequences become more likely, and behaviors followed by unfavorable consequences become less likely."
The "Satisfier"
Early theory relied on the internal state (the feeling of satisfaction), which Skinner later rejected.
The Radical Shift
Rejecting the Internal
Skinner argued that "mind," "will," and "satisfaction" are unobservable and scientifically useless.
The Organism as a "Black Box"
We focus exclusively on observable inputs (stimuli) and observable outputs (responses).
?
Stimulus
Response
The ABC Model
A
Antecedent
The environmental context or trigger that precedes the behavior.
B
Behavior
The observable action performed by the organism (the Operant).
C
Consequence
The event following the behavior that determines its future probability.
Example: [Light Turns On] → [Rat Presses Lever] → [Food Pellet]
Inside the Operant Chamber
[ DIAGRAM: SKINNER BOX COMPONENTS ]
Manipulanda:
Levers, keys, or buttons the subject must interact with.
Reinforcer:
Pellet dispenser or water delivery system.
Discriminative Stimuli:
Lights, sounds, or screens indicating when to act.
Cumulative Recorder:
The mechanism tracking rate of response over time.
Key Features:
Automation: Removed human interaction from observation.Standardization: Precise control of the environment.Data Density: Tracked thousands of responses automatically.
Seminar Question
"If an organism is just a 'black box' reacting to contingencies, does 'free will' exist, or is it merely an illusion created by complex environmental histories?"
10 Minute Discussion
Pigeon Rituals Observation Log Observation Log 01
Project: Rituals of the Random | Subject: Columba livia
Name: ___________________________
Date: ___________________________
Lab Section: ____________________
Task Overview
Analyze the provided footage of Skinner's 1948 "Superstition in the Pigeon" experiment. Your goal is to identify the Antecedent , the specific Behavior being reinforced, and the Consequence as perceived by the organism, even in the absence of a true causal link.
Part I: ABC Functional Analysis
Antecedent (A) Behavior (B) Consequence (C)
Topography of Behavior
Describe the physical form of the "superstitious" ritual in detail (e.g., speed, direction, frequency).
Reinforcement Interval
How does the 15-second fixed interval (FI) delivery of food contribute to the strengthening of random behaviors?
Critical Synthesis
Skinner noted that "the bird behaves as if there were a causal relation." Based on your observations, why is the temporal proximity (contiguity) of the food delivery more important for learning than the actual contingency (causality)?
Part II: The "Black Box" Challenge
Contrast the theories of Edward Thorndike and B.F. Skinner by analyzing a modern human behavior: "Checking a smartphone for notifications."
Thorndike's Interpretation
Focus on the internal "Satisfier" or "Annoyer."
Skinner's Interpretation
Focus on the "Black Box" and external contingencies only.
Mechanical Comparison
Feature The Puzzle Box (Thorndike) The Operant Chamber (Skinner) Primary Subject Felis catus (Cats) Rats / Pigeons Learning Mechanism Role of Cognition
Laboratory Reflection
"The consequences of behavior determine the probability that the behavior will occur again." Based on today's lab, identify one behavior in your own life that you suspect is "superstitious" (reinforced by accidental contiguity). Explain the ABC pattern for this behavior.
Quadrant Mastery Slides Lab Session 02
Quadrant Mastery
Precisely distinguishing the mechanisms of consequence in behavioral engineering.
Positive Negative Reinforcement Punishment
The Binary Logic of Operant Conditioning
Step 1: The Valence
Is the stimulus being added or removed?
- Negative
Step 2: The Effect
Does the behavior increase or decrease?
Reinforcement
Punishment
"Forget colloquial meanings. In behavioral science, these are mathematical operations."
Positive ≠ Good | Negative ≠ Bad
The Contingency Matrix
Reinforcement (B↑)
Punishment (B↓)
Positive (+ Added)
Positive Reinforcement
Give a pellet → More lever pressing.
Positive Punishment
Give a shock → Less lever pressing.
Negative (- Removed)
Negative Reinforcement
Stop the noise → More lever pressing.
Negative Punishment
Take away food → Less lever pressing.
The Misconception Trap
Negative Reinforcement
Often confused with punishment because it involves something "bad" (aversive).
Example: Aspirin
A: Headache (Aversive)
B: Swallow Pill
C: Pain is removed (-)
Result: Pill-swallowing behavior increases in the future.
Escape vs. Avoidance
Escape: Terminating an existing aversive stimulus.Avoidance: Preventing an aversive stimulus before it starts.
"Negative reinforcement is a reward, just a reward of relief."
Ready for the Matrix?
In your workshop groups, you will analyze 10 clinical and everyday vignettes. You must identify:
01
Target Behavior
02
Stimulus Valence
03
Behavioral Rate
Precision is required. Vague answers will not be accepted.
Contingency Matrix Worksheet Contingency Matrix Challenge
Lab Session 02: Operational Precision Workshop
Student ID: ____________________
Score: ________ / 20
Analysis Protocol
1. Identify the Target Behavior .
2. Determine if the stimulus is Added (+) or Removed (-) .
3. Observe if the behavior Increases (↑) or Decreases (↓) .
Scenario 01: The Clinical Setting
REF: CL-104
A patient in a behavioral health unit frequently engages in self-injurious head-banging. The staff is instructed that every time the patient begins head-banging, they must immediately guide the patient to a "quiet room" (removing them from the social environment and preferred activities) for 10 minutes. Over two weeks, the frequency of head-banging decreases significantly.
Stimulus Added/Removed?
Behavior Inc/Dec?
Final Operant Quadrant
Scenario 02: Corporate Performance
REF: CP-882
An office manager notices that employees are often late for morning meetings. She implements a "Morning Relief" policy: any employee who arrives 5 minutes early to the meeting is excused from the tedious Friday afternoon filing tasks. By the next month, 90% of employees are arriving early.
Stimulus Added/Removed?
Behavior Inc/Dec?
Final Operant Quadrant
Scenario 03: Domestic Interaction
REF: DI-019
A toddler is screaming in the grocery store checkout line for a candy bar. To make the screaming stop, the parent gives the child the candy bar. The child stops screaming immediately. The next time they are at the store, the child begins screaming as soon as they reach the checkout.
Stimulus Added/Removed?
Behavior Inc/Dec?
Final Operant Quadrant
Scenario 04: The Grocery Store Redux
REF: DI-019-B
Refer back to Scenario 03. This time, analyze the PARENT'S behavior (giving the candy). The aversive stimulus (child's screaming) stops once the candy is given. The parent is now more likely to give candy in the future to stop screaming.
Stimulus Added/Removed?
Behavior Inc/Dec?
Final Operant Quadrant
Part II: The Technical Misconception
Explain the difference between Negative Reinforcement and Positive Punishment in clinical terms.
Operational Definition: ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
Contingency Matrix Answer Key Answer Key: Contingency Matrix
Instructor Reference • Behavioral Architecture Sequence
SCENARIO 01: Head-Banging
Stimulus valence Removed (-)
Behavioral effect Decreases (↓)
Quadrant Negative Punishment
Rational: The social environment/preferred activities (the reinforcing stimulus) are removed following the behavior.
SCENARIO 02: Early Meetings
Stimulus valence Removed (-)
Behavioral effect Increases (↑)
Quadrant Negative Reinforcement
Rational: An aversive task (filing) is removed to increase the frequency of a desired behavior (arriving early). This is specifically Avoidance learning .
SCENARIO 03: Toddler (Child's View)
Stimulus valence Added (+)
Behavioral effect Increases (↑)
Quadrant Positive Reinforcement
Rational: A rewarding stimulus (candy) is added following the behavior (screaming), increasing its future probability.
SCENARIO 04: Toddler (Parent's View)
Stimulus valence Removed (-)
Behavioral effect Increases (↑)
Quadrant Negative Reinforcement
Rational: The aversive stimulus (screaming) is removed when the parent gives candy, increasing the parent's future likelihood of giving candy. This illustrates how behavioral traps are often maintained by multiple consequences.
NR vs PP Distinction
Negative Reinforcement increases behavior by taking away something bad (relief).Positive Punishment decreases behavior by adding something bad (pain/aversive).
Timeout Analysis
A timeout is Negative Punishment because it is the "removal of the opportunity to earn reinforcement." It is not the addition of a stimulus (unless the child is being scolded/hit, which would be PP), but rather the removal of a reinforcing environment.
Hard Mode Answer: Seatbelt Alarm
1. Initial Learning: Negative Reinforcement (Escape) - The sound is happening, and the action stops it.
2. Maintenance: Negative Reinforcement (Avoidance) - The driver acts before the sound begins to prevent it from ever occurring.
Schedules of Reinforcement Slides Lab Session 03
The Slot Machine Paradox
Predicting behavioral rates through the mechanics of reinforcement schedules.
Variable Unpredictable
Fixed Predictable
The Persistence of the Variable
Why does a gambler pull a lever for hours without a single payout, while a lab rat stops pressing a lever almost immediately once the food machine breaks?
Resistance to Extinction
The most powerful schedule of reinforcement is the one that might happen at any moment.
???
7 - 7 - [ ? ]
"The Variable Ratio schedule is the most effective at maintaining high, steady rates of response."
The Taxonomy of Timing
Fixed Ratio (FR)
Every X times
Reinforcement occurs after a set number of responses. Leads to high rates with a "post-reinforcement pause."
Example: Factory piecework.
Variable Ratio (VR)
Avg X times
Reinforcement occurs after an unpredictable number of responses. Leads to the highest, most consistent rates.
Example: Slot machines, fishing.
Fixed Interval (FI)
Every X mins
Reinforcement occurs after a set amount of time has passed. Leads to a "scalloped" response pattern.
Example: Checking the mail, cramming for exams.
Variable Interval (VI)
Avg X mins
Reinforcement occurs after an unpredictable amount of time has passed. Leads to moderate, steady rates.
Example: Checking social media notifications.
Analyzing the Cumulative Record
Time
Total Responses
Key Visual Indicators:
Steep Slope: High rate of responding.Horizontal Line: No responding (pause or extinction).The "Tick" Mark: Indicates when reinforcement was delivered.
The cumulative record is the "EKG of behavior." It reveals the internal mechanics of the conditioning process.
The Road to Extinction
What happens when the consequence stops?
1. The Extinction Burst
A temporary increase in the rate and intensity of the response when reinforcement is first withdrawn.
2. Spontaneous Recovery
The reappearance of a previously extinguished response after a rest period.
PREDICTION TASK
"Rank the four schedules from Fastest to Extinguish to Slowest to Extinguish."
Schedule Grapher Worksheet Cumulative Data Plot 03
Quantitative Behavioral Analysis
Name: ___________________________
Lab ID: ____________________
Lab Objectives
Manually plot the response patterns of four distinct subjects (Subjects A-D) each assigned to a different schedule of reinforcement. Analyze the slope, consistency, and pauses to identify the underlying contingency.
Cumulative Record Master Grid
Session Time (Minutes)
Total Responses (Cumulative)
Subject A
Subject B
Subject C
Subject D
Subject A: FI-1min
Low response initially, rapid increase just before the end of each 1-min interval. Plot a "scalloped" curve.
Subject B: VR-10
Extremely steep, consistent slope. Highest response rate with zero pauses. Plot a nearly vertical straight line.
Subject C: FR-10
High rate followed by a short horizontal pause after every 10 responses. Plot a "stair-step" pattern.
Subject D: VI-2min
Moderate, steady slope without significant pauses or bursts. Plot a constant diagonal line with a low slope.
Part II: Post-Plotting Analysis
Structural Comparison
Schedule Response Rate (High/Med/Low) Predictability (Fixed/Var) Primary Usage/Real World Subject A (FI) Subject B (VR) Subject C (FR) Subject D (VI)
The Slot Machine Paradox
Explain why Partial Reinforcement (Intermittent) creates behaviors that are significantly harder to extinguish than Continuous Reinforcement . Use the term "Discrimination Hypothesis" in your answer.
Analysis: _________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
Extinction Prediction
Imagine the food dispenser is permanently disabled at Minute 15. Sketch on your grid (using a dashed line) how you expect the response curve of Subject B (VR) to differ from
Shaping Behavior Slides Lab Session 04
Architecting Action
The Method of Successive Approximations and Behavioral Chaining.
The Art of the Approximation
How do you teach a behavior that the organism never performs naturally?
Shaping Defined
The reinforcement of successive approximations to a desired terminal behavior.
1. Reward current behavior.
2. Stop reward. (Wait for variation)
3. Reward behavior closer to target.
4. Repeat.
TARGET
"Incremental steps toward complexity."
The Tools of the Trainer
Primary Reinforcers
Naturally satisfying stimuli that do not require learning to be effective.
Food / Water
Physical Comfort
Social Contact
Relief from Pain
Secondary (Conditioned)
Stimuli that gain reinforcing power through association with primary reinforcers.
Money / Tokens
Verbal Praise
Clicker Sound
Letter Grades
Chaining Action
STEP 01
Approach Lever
STEP 02
Touch Lever
STEP 03
Press Lever
GOAL
REWARD
Forward Chaining
Teach the first step first, then reinforce it along with the second, and so on.
Backward Chaining
Complete all steps for the learner except the last one. Reinforce completion. Gradually work backward.
Partner Training Lab
"Your goal: Train your partner to perform a hidden 3-step behavior sequence using only a clicker as a secondary reinforcer."
No Speaking No Gestures 15 Minutes
Precision timing is the difference between learning and confusion.
Shaping Protocol Worksheet Shaping Protocol 04
Architecting Complex Action | Lab 04
Trainer: ___________________________
Learner: ___________________________
The Mission
Select a Terminal Behavior (e.g., "Touching a specific book on a shelf," "Sitting on a specific chair," "Standing on one leg while touching a wall"). You must train your partner to perform this behavior using only an auditory signal (clicker/pen click).
Constraints: No verbal instructions. No gestures. No physical guidance.
Rules of Reinforcement
• Click during the behavior, not after.
• One click = One successful step.
• If behavior stalls, regress to the previous step.
• Silence = "Not that."
Phase I: Task Analysis
GOAL
Define Terminal Behavior:
Break down the sequence into 5 Successive Approximations:
Step 1
Step 2
Step 3
Step 4
Step 5
Phase II: Training Log
Time (Min) Behavioral Variations Observed Reinforcement Delivered? 0:00 - 3:00 3:00 - 6:00 6:00 - 9:00
Part III: Post-Lab Deconstruction
01. The Extinction Burst
Describe a moment during the training where your partner began to exhibit varied, intense, or frustrated behaviors because they were not being clicked. How did you utilize this variation to shape the next approximation?
Observation: ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
02. Timing and Contiguity
If you clicked even 1 second too late, what "accidental" behavior did you inadvertently reinforce? How did you correct this "superstition"?
Analysis: ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
03. Learned Helplessness vs. Acquisition
Compare the experience of the
ABA and Ethics Slides Lab Session 05
Engineering Behavior
Applied Behavior Analysis and the Ethics of Human Conditioning.
"Beyond Freedom and Dignity?"
Applied Behavior Analysis (ABA)
The scientific application of behavioral principles to solve socially significant problems.
Autism Spectrum Disorder
Corporate Management (OBM)
Special Education & Inclusion
The 7 Dimensions of ABA
Applied
Behavioral
Analytic
Technological
Conceptually Systematic
Effective
Generality
The Token Economy
Structural Anatomy:
Target Behaviors: Clearly defined desirable actions.Tokens: Neutral objects (secondary reinforcers).Back-up Reinforcers: Preferred items or activities.
Why it works:
Tokens bridge the delay between the behavior and the primary reinforcer. This ensures immediate contiguity even when the final reward is distant.
Challenge:
Can behavioral engineering replace intrinsic motivation, or does it eventually destroy it?
The Ethical Frontier
Autonomy
Is it ethical to modify a person's behavior without their informed consent if the outcome is "better" for them?
CONSIDER: Non-verbal clients, children.
Coercion
When does "Positive Reinforcement" become a form of control that limits genuine freedom?
CONSIDER: Workplace productivity, surveillance.
The End Goal
Who decides which behaviors are "socially significant" enough to be engineered?
CONSIDER: Cultural bias, neurodiversity.
The Skinnerian Question
"We are all conditioned by our environment anyway. Is it not better to engineer that environment deliberately for the common good than to leave it to chance?"
Agree Disagree
Token Economy Design Canvas Behavioral Design Canvas
Applied Behavior Analysis | Project 05
Lead Designer: ____________________
Implementation Site: ______________
System Design Challenge
Identify a population and a socially significant behavior that needs modification. Design a comprehensive Token Economy that utilizes operant principles to increase desirable behaviors and phase out the intervention.
01. Target & Operationalization
Who is the subject? Define 3 observable, measurable target behaviors.
Population: ______________________________
Behavior 1: ______________________________
Behavior 2: ______________________________
Behavior 3: ______________________________
02. The Medium of Exchange
What is the token? How is it delivered immediately? How is counterfeiting prevented?
Token Description: _________________________
Delivery Mechanism: _______________________
Storage/Tracking: _________________________
03. The Exchange Menu
What primary or highly preferred secondary reinforcers can be purchased?
Item/Activity Cost (Tokens) ______________________ _______ ______________________ _______ ______________________ _______
04. Delivery Schedule
How often are tokens given? (Continuous for acquisition, intermittent for maintenance).
Initial Schedule: __________________________
Fading Schedule: ___________________________
05. Response Cost Protocols
Will tokens be removed for maladaptive behavior? Define the Negative Punishment mechanism.
Rule: ____________________________________
Cost: ____________________________________
06. The Exit Strategy
How will the system be phased out so the behavior persists in the "natural" environment?
Fading Steps: _____________________________
Natural Reinforcers: ______________________
Part II: Behavioral Ethics Audit
"The Engineering Dilemma"
Every behavior modification plan is an exercise in power. Before implementing your system, you must subject it to rigorous ethical scrutiny based on the Principles of Autonomy, Non-Maleficence, and Social Benefit.
01. Consent & Choice
