Innovative Approaches to Measuring Fidelity

Whether one calls it Procedural Fidelity, Treatment Integrity, or any combination of those, and/or many other related terms, this is an important and often overlooked issue when it comes to implementing behavior analytic interventions.

Think about it for a minute: as practitioners, we spend all this time obsessing about what assessment strategy to use and what interventions we think are the best fit for the individuals we serve. As you'll come to find out, we spend comparatively less time on ensuring that the programs we write are being implemented correctly.

So it is with this in mind that I'm grateful that Dr. Claire St. Peter returned to the podcast to discuss her research in this area of procedural Fidelity.

In this episode, we talk about why she prefers the term "Procedural Fidelity," the types of behavior plans that are difficult for teachers to implement, the different types of procedural errors one can make, the impact these different errors have, what types of intervention plans are more vs. less resistant to reductions in procedural fidelity, why this is a topic that practitioners should care about, whether to measure procedural fidelity via rate or percent correct, and regardless of method, how behavior analysts can start tracking procedural fidelity right away.

We also talk about Claire's research in this area, going back to the work she did as part of her dissertation. We also talk about the state of reporting procedural fidelity in the behavior-analytic research literature.

Lastly, I think it's important to point out that this topic is replete with ethical implications, which is why I titled this episode the way I did. When I listened to the show, I kept track of the various code elements that were indirectly outlined or addressed. For the mentors in the audience, this might be a fun exercise to do with your supervisees.

Here are the resources discussed in this episode:

• Session 269/193: Claire's episode on Constructional Approaches to behavioral intervention.
• A link to Claire's multiple BOP appearances.
• Claire's lab website.
• On Claire's site, a section where you can download examples of Procedural Fidelity checklists and related resources.
• Bergmann et al., (2023). A detailed examination of reporting procedural fidelity in the Journal of Applied Behavior Analysis.
• Han et al., (2022). Trends in Reporting Procedural Integrity: A Comparison.
• Jones et al., (2023). Effects of Commission and Omission Errors on the Efficacy of Noncontingent Reinforcement.
• Jones and St. Peter (2022). Nominally acceptable integrity failures negatively affect interventions involving intermittent reinforcement.
• St. Peter et al. (2023). On a persisting curious double standard in behavior analysis: Behavioral scholars' perspectives on procedural fidelity.
• Kranak and Falligant (2023). Treatment Integrity, Commission Errors, and Reinstatement: A Primer.
• Campbell and Skinner (2008). Combining Explicit Timing with an Interdependent Group Contingency Program to Decrease Transition Times.

This episode was brought to you with support from:

• The 2024 Stone Soup Conference! Behavior Analysis' premier online event is taking place on October 25th. Come hear from pod faves including Drs. John Austin, Lina Slim, Jim Moore, and many others! 8.5 Learning CEUs are available, and when you use the promo code PODCAST24, that comes out to less than 8 bucks per credit. Learn more here!
• How to ABA…The Bx Resource Membership saves you time, lends you support, and helps you keep up with your CEUs. It's a growing library of resources, materials, programs, datasheets, assessments, and how-to videos to help you tackle any ABA program with ease. It also includes live CEUs each month, live mentorship sessions, a full library of CEUs (60+, enough for recertification), and a community of fellow behavior professionals where you can ask questions when you need support. Join us at howtoaba.com/join.
• The New England Center for Children! In previous podcasts, you've heard me talk about NECC's career opportunities, but later in this episode, you'll hear about their Autism Curriculum Encyclopedia, or ACE for short. It's an evidence-based teaching technology for educators and BCBAs who teach learners with autism and related disabilities. If you must know more right now however, you can go to acenecc.org.
• HRIC Recruiting. Barb Voss has been placing BCBAs in permanent positions throughout the US for just about a decade, and has been in the business more generally for 30 years. When you work with HRIC, you work directly with Barb, thereby accessing highly personalized service. So if you're about to graduate, you're looking for a change of pace, or you just want to know if the grass really is greener on the other side, head over to HRIColorado.com to schedule a confidential chat right away.
• ACE Approved CEUs from .... Behavioral Observations. That's right, get your CEUs while driving (maybe even this episode!), walking your dog, doing the dishes, or whatever else you might have going on, all while learning from your favorite podcast guests!