Fidelity Blueprint Slides Fidelity Blueprint
Defining and Measuring Treatment Integrity in Behavioral Support
Graduate Seminar: Data-Driven Behavior Adjustment
The Central Question
How do we know if the student failed the plan, or if the plan was never actually tried?
The Implementation Gap
In behavioral science, we often make clinical decisions based on outcome data without ever looking at fidelity data.
"Data regarding student failure is often data regarding implementation failure."
The Type III Error
Definition
Evaluating an intervention that was not implemented as intended.
The Risk
Discarding a potentially effective intervention because of poor execution.
Ineffective use of clinical resources
Ethical concerns regarding delayed student progress
False conclusions about functional relationships
Dimensions of Treatment Integrity
Adherence
Were all components of the BIP implemented? (The "Yes/No" of implementation).
Dosage
How often and for how long was the intervention delivered?
Quality
How well was the intervention delivered? (The nuances of social interaction).
From Plan to Checklist
A narrative BIP is not a measurement tool. We must operationalize adult behavior.
1 Identify measurable plan components
2 Write clear, binary (Yes/No) steps
3 Define observation conditions
Checklist Mockup
"Gave 3:1 positive praise?"
"Prompted break at 10 min mark?"
"Used calm neutral tone?"
Workshop: The Audit
You are about to receive a BIP for "Marcus." Your task is to extract the implementation steps and build a fidelity checklist that a supervisor could use in 15 minutes.
Analyze
Extract
Checklist
Implementation Audit Worksheet Implementation Audit Workshop
Graduate Practicum: Behavioral Consultation
Name: __________________________
Date: __________________________
The BIP Snapshot: Marcus (Grade 4)
Target Behavior: Verbal aggression and task refusal.
The Plan: When a non-preferred task is presented, the teacher must provide a choice of two work locations. Every 5 minutes of on-task behavior, Marcus should receive a token and specific praise. If verbal aggression occurs, staff must immediately use a "planned ignore" strategy, removing eye contact and verbal interaction until the behavior ceases for 30 seconds. A visual timer must be visible at all times.
Step 1: Operationalizing Adult Behavior
Break the plan above into discrete, observable actions required by the teacher/staff.
Step 2: Designing the Observation Tool
Convert your components into a binary (Yes/No/NA) checklist for a supervisor to use during a 15-minute observation.
Implementation Step (Observation Item) Observed? Notes / Qualitative Observations Yes
No
| |
| |
Yes
No
| |
| |
Yes
No
| |
| |
Yes
No
| |
Calculation: Implementation Fidelity %
How will you calculate the final percentage? Write the formula below.
Formula: [Number of "Yes" responses] / [Total Number of Applicable Steps] x 100
Type III Investigation Teacher Guide Teacher Facilitation Guide Lesson 1: Fidelity Foundations
The Type III Investigation
Case Study Hook & Guided Discussion
Instructional Objective
Students will describe the clinical implications of a "Type III Error" and identify why student outcome data alone is insufficient for evaluating intervention effectiveness.
The Case of "Incorrigible" Isaac
The Pitch: Present Isaac, a 6th grader with severe property destruction. A detailed BIP was written, including a High-P sequence and a visual token board. After 4 weeks, the teacher provides the "Outcome Data": Property destruction has increased by 15%. The teacher demands a move to a more restrictive setting (self-contained classroom).
Teacher's Claim
"We've tried everything in the plan. It's just not working. He needs a more restrictive placement."
The "Twist" Reveal
A surprise fidelity check revealed that the token board was never printed and the High-P sequence was used only 5% of the time.
Guided Discussion Prompts
If we only looked at Isaac's behavior data, what clinical decision would we have made? How would that have impacted his "Least Restrictive Environment" rights?
Is the intervention a "failure"? Why is it dangerous to call this an "intervention failure"?
How does lack of fidelity data undermine the professional credibility of the behavior consultant?
Independent Variable (IV)
The intervention/plan. In fidelity, we are measuring the presence of the IV.
Dependent Variable (DV)
The student's behavior. The outcome we hope to change.
Behavioral Lab Graduate Series © 2026
Coaching with Data Slides Coaching with Data
Performance Feedback & The Performance Diagnostic Checklist (PDC)
Bridging the Gap Between Plan and Practice
Why Plans "Fail" to Implement
The Assumption Error
We often assume low fidelity is a "motivation" or "attitude" problem.
"They just don't care enough to follow the plan."
The PDC Reality Check:
Lack of clear antecedents (knowing when to act)
Insufficient training or resources
Competing task demands (the "Busy" factor)
The PDC-Human Services
Training
Can the staff member explain the procedure and demonstrate it correctly?
Antecedents
Are there prompts (visual/verbal) that remind the staff to implement?
Resources
Are materials (timers, token boards, etc.) organized and accessible?
Consequences
Has the staff member received feedback on their performance lately?
The Anatomy of Feedback
Timely
Provided as close to the implementation as possible.
Specific & Objective
Based on the fidelity checklist data, not vibes or opinions.
Constructive
Includes modeling and practice of the correct procedure.
Feedback Script Formula
"I observed you implement [Section]..."
"The data shows [Fidelity %]..."
"I noticed [Specific Step] was missing..."
"Let's practice [Correct Step] together..."
Simulation: The Defensive Teacher
"I'm doing everything exactly as the plan says! You just don't understand how difficult this class is."
Lead with Data
Acknowledge Reality
PDC Field Manual Handout PDC Field Manual
Performance Diagnostic Checklist Case Study
Counseling & Behavioral Support
Graduate Seminar Series
CASE STUDY: MR. HENDERSON
Mr. Henderson is a 2nd-year teacher. You have observed him three times implementing Sarah’s BIP (specifically the Non-contingent Reinforcement component). His fidelity score is consistently 45%. During a check-in, he says: "I know the plan, but it's just impossible with 28 other kids. I can't keep looking at my watch every 5 minutes."
Part 1: Diagnostic Assessment
Analyze the scenario above. Which PDC domains are likely barriers? Check all that apply and provide a brief rationale based on Mr. Henderson's statement.
Training
Task Clarification
Resources/Equipment
Consequences
Part 2: Environmental Modification
Rather than "retraining" (which is the default, and often wrong response), propose two environmental modifications to increase Mr. Henderson's fidelity.
Modification A (Antecedent/Resource)
Modification B (Feedback/Consequence)
The "Why" Matters
In behavioral supervision, we apply the same functional thinking to the adults that we apply to the students. A "skill deficit" requires training; a "performance deficit" requires environmental or consequence modification.
Coaching Conversation Script The Feedback Protocol
Simulating High-Stakes Clinical Supervision
The Setup
Students work in pairs. One student plays the Behavioral Consultant (Lead with data). The other plays the Overwhelmed Teacher (Defensive/Busy).
1 The Data Opening
Consultant: State the objective observation data from the fidelity checklist. Avoid "I feel" or "I think."
Example: "During my 20-minute observation, I noted the break prompt was delivered twice, which is a 40% adherence to the plan's 5-minute schedule."
2 The Barrier Identification (PDC Dialogue)
Consultant: Use an open-ended question to identify the barrier (Training? Antecedents? Resources?).
Example: "What makes it difficult to track that 5-minute window during your direct instruction block?"
3 The Collaborative Fix
Consultant: Propose a specific modification and schedule the next check-in.
Observer Rubric
Used objective data?
Aknowledged teacher's barrier?
Avoided judgmental language?
Set a follow-up date?
Visual Synthesis Slides Visual Synthesis
Concurrent Analysis of Fidelity and Outcome Data
Lesson 3: The Dual-Axis Perspective
The Incomplete Picture
Outcome Data
The Dependent Variable. Student behavior (screaming, task completion, social interaction).
Fidelity Data
The Independent Variable. Adult implementation (praise rates, prompt use, visual aids).
Synthesis
True clinical insight only happens when these two datasets are visually synchronized.
Visualizing Progress
Outcome (DV)
Fidelity (IV %)
Primary Axis: Student behavior (Counts/Percentage)
Secondary Axis: Implementation Fidelity (0-100%)
Goal: Observe the functional relationship.
The 4 Diagnostic Scenarios
1. High Fidelity / Good Progress
Plan works as designed. Maintain and thin reinforcement.
2. Low Fidelity / Good Progress
Luck or placebo? Is the plan actually necessary? Look for extraneous variables.
3. Low Fidelity / Poor Progress
The Type III Error. Coaching needed before plan modification.
4. High Fidelity / Poor Progress
Clinical failure. The plan is wrong. Functional redesign required.
The Hook: The Placebo Effect
We will analyze a dataset where student behavior improved dramatically, but fidelity data shows the teacher never used the plan .
What else changed in the environment?
Dual Axis Lab Worksheet Dual Axis Lab
Correlating Implementation with Outcomes
Precision Implementation Series
Dataset: Case "Leo"
Week Outbursts (DV) Fidelity % (IV) W1 (Baseline) 18 N/A W2 (Start BIP) 15 20% W3 16 25% W4 (Coaching) 14 85% W5 4 95% W6 2 90%
Plot the Synthesis
OUTBURSTS
FIDELITY %
Weeks (1-6)
Diagnostic Interpretation
1. Implementation Threshold:
Based on the data, what is the minimum implementation fidelity percentage required to see a significant decrease in outbursts?
2. The Variable of Change:
What occurred between Week 3 and Week 4? How did the visual relationship change after that event?
Clinical Conclusion
In your expert opinion, is this Behavior Intervention Plan (BIP) effective? Justify your answer using the relationship between the IV and DV.
© 2026 Behavioral Lab Monitoring Treatment Fidelity & BIP Modification
Ethical Pivot Slides Ethical Pivot
The Ethics of BIP Modification & The Least Restrictive Environment
Lesson 4: When High Fidelity Meets Poor Outcomes
The Data Decision Point
"If you have high implementation fidelity and zero progress after 3-4 weeks, the ethics of continuing the plan become questionable."
Stop
Stop assuming it needs "more time."
Stop blaming the student's biology.
Stop blaming the setting.
Pivot
Review the Functional Assessment.
Pivot to a different function-based strategy.
Apply the LRE Framework.
Least Restrictive Environment (LRE)
Level 1
Antecedent-based modifications (Visuals, choice, env. setup).
Least Restrictive
Level 2
Consequence-based (Reinforcement, Differential Reinforcement).
Moderate
Level 3
Restrictive/Punitive (Response cost, Time-out, Overcorrection).
Most Restrictive
Ethics Check: Have you exhausted Level 1 and 2 with high fidelity before moving to Level 3?
Clinical Justification
When amending a BIP, you must provide Data-Driven Justification.
Reference Fidelity Logs (IV)
Reference Trend Lines (DV)
Confirm Functional Alignment
Ethics Board Simulation
Today, we will review a plan that moves to a "level system" (punishment). Does the data support this restriction?
Begin Review
Ethics Panel Review Form Clinical Amendment & Ethics Review
Form BIP-E04 | Behavioral Oversight Board
Status: Under Review
Case ID: #AM-2026-X
Case Profile: Liam (Age 14)
Current Plan: Function-based (Attention) - DRA (Differential Reinforcement of Alternative behavior) + Functional Communication Training (FCT).
Current Fidelity: 92% Average over 20 observation sessions.
Current Outcome: Frequency of physical aggression remains at Baseline (mean: 4/day).
Proposed Change: Implement a Response Cost procedure (Level 3 Restrictive) where Liam loses earned "break minutes" for each incident.
Section 1: Least Restrictive Environment (LRE) Audit
As the Ethics Board, evaluate the proposal based on implementation history.
1. Has high fidelity implementation of Level 1/2 interventions been sufficiently demonstrated?
Yes No
Provide data-based justification for this decision:
2. Is the proposed modification (Response Cost) "functionally equivalent"?
Does it teach or reinforce a skill, or simply suppress behavior through punishment?
Section 2: Alternative Clinical Pivot
If you reject the restrictive procedure, what is your alternate recommendation? Consider a "Re-Functional Assessment" or a different Level 2 strategy.
Recommendation
Goal for next 2 weeks
Board Member Signature 1
Board Member Signature 2
Date of Review
Systemic Oversight Slides Systemic Oversight
Designing Sustainable Progress Monitoring & Review Systems
Lesson 5: Preventing the "File Drawer" Plan
The "File Drawer" Syndrome
Beautifully written plans that are never looked at again until the annual meeting.
Why Monitoring Systems Break
Data Exhaustion
Asking staff to collect 50 points of data with zero feedback.
Fragmented Teams
BCBAs, Teachers, and Parents rarely looking at the same dashboard.
Reactive Response
Only reviewing data when a crisis occurs.
Vague Roles
No one knows who is responsible for graphing or analyzing.
The Data Dashboard Blueprint
Visual Utility
Can a teacher understand the trend in 30 seconds or less?
Dual Tracking
Does it show fidelity and behavior on the same screen?
Action-Oriented
Does the dashboard trigger a meeting if fidelity drops below 80%?
The 15-Minute Data Huddle
Check Implementation (IV) first.
Check Student Progress (DV).
Ask: "What environmental barrier is next?"
"We don't meet to discuss the student's behavior. We meet to discuss our response to the student's behavior."
The Capstone Challenge
A local school's MTSS process is broken. Data is collected but never used. Your job is to design a sustainable "Behavior Dashboard" and "Meeting Protocol" that ensures plans are living documents.
Design System
Present Solution
Systemic Review Agenda Template Systemic Review Protocol
Mastery Project: Monitoring Design
Sustainable Systems Lab
Template v.2026
Task: Design a "Monitoring & Review" package for a school team. Your system must solve for sustainability—meaning it must take less than 15 minutes of teacher time per week and lead to clear clinical decisions.
Phase 1: The Visual Dashboard
Sketch or describe the components of your data dashboard. How will you visually display the relationship between the Independent Variable (Implementation) and Dependent Variable (Student Behavior)?
[ Sketch Dashboard Layout Here ]
Metrics Tracked
Review Frequency
Phase 2: The Action-Meeting Agenda
A sustainable system requires a rigid, time-boxed meeting structure. Draft your 15-minute "Data Huddle" agenda below.
Time Agenda Item Responsible Party 0:00 - 0:03 Review Fidelity Logs (Implementation) Supervisor/BCBA
Sustainability Audit
Does your system require less than 10 mins of teacher data entry per day?
Is there a clear trigger for plan modification (e.g., 2 weeks of low progress despite >80% fidelity)?
