The Importance of Criticism in Research Design

Drs. Jane Howard and Gina Green join me today in a podcast that could've spanned several hours. In the time we had, we did manage to cover quite a bit of territory, including the following:

• What Gina has been up to since retiring from the Association for Professional Behavior Analysts (spoiler alert: she's not hanging out at the beach reading mystery novels).
• We talk about Jane's career in behavior analysis, including how she got into the field, some of her many, many accomplishments (including being recently honored as a Fellow of the Association for Behavior Analysis International), and what she is working on these days.
• The basics of research design, including why some experimental questions lend themselves to certain designs over others. In this segment, we also cover group or between-subjects designs and meta analyses, which are relevant to understand when looking at the ABA outcome literature. 
• The distinction of criterion vs. norm referenced assessments.
• We discussed a number of initiatives and resources in the general realm of ABA treatment, including the current state of licensure, The ABA Coding Coalition, The Autism Commission on Quality, & CASP.
• We talked at length about critical thinking, healthy skepticism, and epistemology in Behavior Analysis. 

In addition to these topics, we probably spent the most time talking about the empirical support for ABA interventions for individuals with Autism. In doing so, we discussed the large research projects that Jane and Gina led, what to make of some of the criticisms of this literature that is starting to gain some notoriety, and what research questions we still need answers to. 

Jane and Gina mentioned numerous studies and resources, and I've done my best to catalog them below:

• Session 21 (my first interview with Gina in 2017).
• Howard, J., Sparkman, C., Cohen, H., Green, G, & Stanislaw, H. (2005). A comparison of intensive behavior analytic and eclectic treatments for young children with autism. doi.org/10.1016/j.ridd.2004.09.005
• Howard, J. S., Stanislaw, H., Green, G., Sparkman, C. R., & Cohen, H. G. (2014). Comparison of behavior analytic and eclectic early interventions for young children with autism after three years. 
• Stanislaw, H., Howard, J., & Martin, C. (2020). Helping parents choose treatments for young children with autism: A comparison of applied behavior analysis and eclectic treatments. 
• Eldevik, S., Hastings, R. P., Hughes, J. C., Jahr, E., Eikeseth, S., & Cross, S. (2010). Using participant data to extend the evidence base for intensive behavioral intervention for children with autism. 
• Klintwall, L., Eldevik, S., & Eikeseth, S. (2015). Narrowing the gap: Effects of intervention on developmental trajectories in autism. 
• Padilla, K.L., Weston, R., Morgan, G.B., Lively, P., & O’Guinn, N. (2023). Validity and reliability evidence for assessments based in applied behavior analysis: A systematic review. 
• Steinbrenner, J. R., Hume, K., Odom, S. L., Morin, K. L., Nowell, S. W., Tomaszewski, B., Szendrey, S., McIntyre, N. S., Yücesoy-Özkan, S., & Savage, M. N. (2020). Evidence-Based Practices for Children, Youth, and Young Adults with Autism. The University of North Carolina at Chapel Hill, Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence and Practice Review Team. 
• ABA Coding Coalition (2022). Model Coverage Policy for Adaptive Behavior Services. https://abacodes.org/wp-content/uploads/2022/01/Model-Coverage-Policy-for-ABA-01.25.2022.pdf
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014) Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association. https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf
• Behavior Analyst Certification Board & Association of Professional Behavior Analysts (February 2019). Clarifications Regarding Applied Behavior Analysis Treatment of Autism Spectrum Disorder: Practice Guidelines for Healthcare Funders and Managers (2nded). https://cdn.ymaws.com/www.apbahome.net/resource/collection/1FDDBDD2-5CAF-4B2A-AB3F-DAE5E72111BF/Clarifications.ASDPracticeGuidelines.pdf
• Johnston, Pennypacker, and Green (2019). Strategies and Tactics for Behavioral Research and Practice.

This podcast is brought to you by:

• • The Michigan Autism Conference, which is taking place on October 11-13 in Kalamazoo, and online as well. We’ll hear more about this event later on in the show, but if you’re impatient like me, to go michiganautismconference.org, and use the code MAC10 to save $10 at checkout.
  • The Stone Soup Conference, which is taking place on October 20th. Use code PODCAST to save on your registration as well.
  • HRIC Recruiting. Barb Voss has been placing BCBAs in permanent positions throughout the US for just about a decade, and has been in the business more generally for 30 years. When you work with HRIC, you work directly with Barb, thereby accessing highly personalized service. So if you're about to graduate, you're looking for a change of pace, or you just want to know if the grass really is greener on the other side, head over to HRIColorado.com to schedule a confidential chat right away.
  • ACE Approved CEUs from .... Behavioral Observations. That's right, get your CEUs while driving, walking your dog, doing the dishes, or whatever else you might have going on, all while learning from your favorite podcast guests!