

TestGuild Devops Toolchain Podcast
Joe Colantonio
Welcome to The DevOps Toolchain Show – your go-to podcast for mastering the evolving world of DevOps! Previously known as The TestGuild Performance and SRE Podcast, we dive deep into the latest trends, must-know tools, and cutting-edge techniques shaping modern software delivery.
Join industry experts, engineers, and thought leaders as we uncover insights on automation, performance testing, security, CI/CD, AI in DevOps, and everything in between. Whether you're a DevOps practitioner, SRE, or testing professional, this show equips you with actionable knowledge to optimize your workflow and stay ahead in an ever-changing tech world. We got you covered!
Join industry experts, engineers, and thought leaders as we uncover insights on automation, performance testing, security, CI/CD, AI in DevOps, and everything in between. Whether you're a DevOps practitioner, SRE, or testing professional, this show equips you with actionable knowledge to optimize your workflow and stay ahead in an ever-changing tech world. We got you covered!
Episodes
Mentioned books

Jun 19, 2025 • 33min
How to Grow your Career in Cybersecurity with Grant McCracken
In today's episode, we discuss cybersecurity with Grant McCracken, a seasoned expert with over 13 years of experience in ethical hacking and executive-level cybersecurity roles. As the founder of Dark Horse Security, Grant shares his journey into the field, practical advice for aspiring ethical hackers, and actionable tips for organizations navigating the challenges of security in the AI era. From hands-on learning resources like Hack the Box and bug bounty programs to the real risks and rewards of using AI-generated code, Grant demystifies the realities of modern security threats. He also offers a peek into the social engineering tactics at events like DEFCON, explains why having a vulnerability disclosure program is crucial, and reveals how even small companies can build stronger defenses. Whether you're just dipping your toes into cybersecurity, managing DevOps security at your company, or curious about how AI is reshaping the security landscape, this episode is packed with insights you won't want to miss. Tune in to hear why effective communication may be the most powerful security skill of all—and get tips you can put to work right away in your DevOps journey. Try out Insight Hub free for 14 days now: https://testguild.me/insighthub. No credit card required.

Jun 11, 2025 • 25min
Aligning DevOps Teams for API Quality with Temil Sanchez
Welcome back to the DevOps Toolchain podcast! In this episode, host Joe Colantonio is joined by Temil Sanchez, a Product Manager at SmartBear, for a deep dive into how quality truly becomes a team effort—especially when aligning development, QA, and product teams within agile API environments. Together, they explore the evolution and surge in API adoption, the unique challenges of collaborating on APIs in agile settings, and the importance of closing feedback loops to deliver reliable software faster. Temil shares his journey from QA engineering to product management, offers insights on bridging the gaps between technical and non-technical roles, and provides details on how SmartBear’s new API Hub aims to unify teams across the API lifecycle. Additionally, discover the latest platform innovations, including contract testing, collaboration features, and AI-powered design tools that make API quality accessible to everyone—developers, testers, and even product managers. If you’ve ever struggled with fragmented processes or siloed teams in your API projects, this episode is packed with practical tips and tools to level up your DevOps practice. Listen up! Head over to https://testguild.me/apihub to learn more and get started.

Jun 4, 2025 • 33min
Overcoming Mobile Testing DevOps Challenge (Episode 3 of the SmartBeat Employees - Mobile Testing) with Todd McNeal
Today, we’re talking all about mobile testing in DevOps with special guest Todd McNeal, co-founder of Reflect—a cutting-edge AI-powered test automation tool now part of the SmartBear family. Todd breaks down the dynamic shifts happening in mobile testing, from the challenges of manual processes to the game-changing adoption of low-code, no-code, and pure AI-driven automation. We explore how Reflect’s AI approach is making mobile app testing more resilient, maintainable, and accessible across both iOS and Android, even for highly visual and complex interfaces, such as Flutter apps. Additionally, the conversation explores the integration of performance, UX, and exploratory testing into your pipeline, as well as what the future may hold for AI and automation in mobile DevOps. If you’re looking for practical insights to supercharge your DevOps mobile test automation strategy—and maybe a sneak peek at what’s on the horizon—this episode is packed with expert advice and firsthand experiences. Tune in and discover new ways to bring more speed, reliability, and efficiency to your mobile DevOps toolchain! Try it out at https://testguild.me/mobiledevops

May 28, 2025 • 30min
Will AI Replace DevOps Engineers, BI and More with Mark Koelsch
Mark Koelsch, North American president and co-founder of AgileAway, shares insights on AI-driven business intelligence. He discusses how AI has transformed into a mainstream tool and its impact on industries, particularly in healthcare. Mark emphasizes that while AI may automate repetitive tasks, it enhances human capabilities rather than replaces them. He also explores the evolving roles of BI analysts and the challenges of integrating AI in development, offering practical advice for leveraging these technologies effectively in business.

May 14, 2025 • 37min
Observability at Scale with AI with Jacob Leverich
In this episode of the DevOps Toolchain podcast, Joe Colantonio sits down with Jacob Leverich, cofounder and Chief Product Officer at Observe, to explore how AI and cutting-edge data strategies are transforming the world of observability. With a career spanning heavyweight roles from Splunk to Google and Kuro Labs, Jacob shares his journey from banging out Perl scripts as a Linux sysadmin to building scalable, data-driven solutions that address the complex realities of today’s digital infrastructure. Tune in as Joe and Jacob explore why traditional monitoring approaches are struggling with massive data volumes, how knowledge graphs and data lakes are breaking down tool silos, and what engineering leaders often get wrong when scaling visibility across teams. Whether you’re a tester, developer, SRE, or team lead, get ready to discover actionable insights on maximizing the value of your data, the true role of AI in troubleshooting, and practical tips for leading your organization into the future of DevOps observability. Don’t miss it! Try out Insight Hub free for 14 days now: https://testguild.me/insighthub. No credit card required.

May 7, 2025 • 31min
The Rise of Agentic AI: Transforming DevOps and Testing with Bridges Smith
Bridges Smith, VP of Product Management for AI at SmartBear, shares insights from over 25 years of experience in machine learning and product development. He discusses the exciting shift from generative AI to agentic AI, which can enhance decision-making and tackle complex tasks in DevOps. Bridges emphasizes the critical role of human oversight in AI integration and offers strategies for automating routine tasks. He also explores industry-specific AI training and the balance between AI efficiency and human creativity, making for a thought-provoking listen.

Apr 30, 2025 • 36min
AI in Testing: Innovation or Just Noise? with Fitz Nowlan
Fitz Nowlan, VP of AI and Architecture at SmartBear with a PhD from Yale, dives into the transformative role of AI in software testing. He distinguishes between genuine innovation and mere hype, tackling the complexities of MCP servers and agentic AI. Fitz shares insights on visual testing and AI-driven test data generation, emphasizing user feedback's role in innovation. He highlights the need for companies to adapt and integrate AI while addressing security challenges, ensuring that developers stay ahead in the fast-paced tech landscape.

Apr 23, 2025 • 30min
Making Performance Testing Accessible for All with k6 Studio with Mark Meier and Tom Miseur
Mark Meier and Tom Miseur from Grafana Labs are on a mission to democratize performance testing with k6 Studio. They delve into how this user-friendly tool empowers teams—from developers to QA—by simplifying script creation and testing processes. The duo addresses common misconceptions about performance load, emphasizes the integration of testing into CI/CD pipelines, and shares insights on leveraging AI to enhance scripting efficiency. Get ready for actionable strategies to transform performance testing into a collaborative team effort!

Apr 16, 2025 • 32min
Scaling ML Infrastructure Like a Pro with Elliott Clark
Elliott Clark, a DevOps expert and founder of Batteries Included, shares his vast experience in scaling machine learning infrastructure. He discusses the critical role of performance testing, emphasizing the use of production traffic for safe and effective code testing. Elliott also highlights the importance of a supportive team culture in navigating microservices and scaling challenges. He advocates for open-source solutions to aid mid-sized companies, and introduces a unique pricing model that democratizes access to robust infrastructure, making it easier for smaller setups.

Apr 10, 2025 • 30min
Automation - First DevOps Focus with Kedar Kulkarni
In this engaging discussion, Kedar Kulkarni, a DevOps and cloud infrastructure expert, shares his insights on 'automation-first' DevOps. He emphasizes the significance of infrastructure as code and warns about the pitfalls of neglecting maintenance. Kedar also dives into GitOps tools, highlighting their role in Kubernetes management. Listeners learn about the essentials of building effective DevOps frameworks and how embracing automation can enhance both productivity and career growth. His journey in open-source development adds a personal touch to the conversation.