The New Stack Podcast

In this week’s episode ofThe New Stack Agents, Scott Carey, editor-in-chief of LeadDev, discussed their first AI Impact Report, which explores how engineering teams are adopting AI tools. The report shows that two-thirds of developers are actively using AI, with another 20% in pilot stages and only 2% having no plans to use AI — a group Carey finds particularly intriguing. Popular tools include Cursor (43%) and GitHub Copilot (37%), with others like OpenAI, Gemini, and Claude following, while Amazon Q and Replit lag behind.Most developers use AI for code generation, documentation, and research, but usage for DevOps tasks like testing, deployment, and IT automation remains low. Carey finds this underutilization frustrating, given AI's potential impact in these areas. The report also highlights concern for junior developers, with 54% of respondents expecting fewer future hires at that level. While many believe AI boosts productivity, some remain unsure — a sign that organizations still struggle to measure developer performance effectively.Learn more from The New Stack about the latest insights about the AI tool adoption: AI Adoption: Why Businesses Struggle to Move from Development to Production3 Strategies for Speeding Up AI Adoption Among DevelopersAI Everywhere: Overcoming Barriers to AdoptionJoin our community of newsletter subscribers to stay on top of the news and at the top of your game. 

In a dynamic conversation, Sid Sheth, Founder and CEO of d-Matrix, dives into the complexities of AI inference. He emphasizes that inference isn't a one-size-fits-all challenge and requires specialized hardware for different needs. Sid introduces d-Matrix's innovative modular platform, Corsair, designed to minimize memory-compute distance for faster performance. He also explores the parallels between human learning and AI deployment, and stresses the necessity for tailored infrastructure to enhance enterprise AI integration.

Naveen Rao, VP of AI at Databricks and former neuroscientist, dives into the evolution of AI, emphasizing the need for energy-efficient systems rather than brute-force scaling. He warns against the impending 'model collapse' of large language models due to reliance on AI-generated content. Rao argues for grounding AI in reality and rethinking traditional approaches, suggesting that true intelligence should mimic biological efficiency. His insights challenge current methodologies and highlight the importance of observational learning in AI development.

Burkay Gur, Co-founder and CEO of Fal.ai, and Glenn Solomon, Managing Partner at Notable Capital, dive into the evolution of generative media. They discuss Fal.ai's shift from optimizing machine learning infrastructure to hosting diverse media models, emphasizing the competitive edge of speed. Gur highlights how generative AI transforms creativity, noting that while creation costs have dropped, true creative value remains. Solomon reflects on the changing landscape of venture capital in AI, focusing on model customization and the balance between technology and creativity.

Paul Klein IV, founder of Browserbase and its tool Stagehand, is reshaping the way AI interacts with the web. He discusses the limitations of traditional headless browsers and how his tool empowers AI agents to interpret natural-language commands, adapting to ever-changing web elements. Klein envisions a future where AI can handle complex tasks like filing taxes independently. He also shares insights on the challenges of ethical AI practices, the integration of open-source tools, and the necessity of security in AI operations.

Antje Barth, an AWS Developer Advocate for Generative AI, shares insights on the burgeoning interest in agentic and multi-agent systems among developers. She discusses the importance of tools like Amazon Q CLI and Strands SDK for scaling applications, along with AWS's focus on security, emphasizing that safety should be prioritized from day one. Barth also highlights the evolving landscape of AI-navigated applications and the role of community in fostering innovation and collaboration within the developer ecosystem.

Andrew Lee, co-founder of Shortwave and Firebase, dives into the transformative journey of his AI-first email client. He shares how Shortwave evolved from basic enhancements to deploying sophisticated AI capabilities, including tool-calling agents that tackle complex tasks autonomously. Lee highlights the impressive advancements seen in AI, particularly from Anthropic, and envisions a future where AI proactively manages emails and personalizes interfaces. This innovative shift promises to redefine productivity in email management.

Ev Kontsevoy, CEO of Teleport, discusses the evolving landscape of infrastructure security from KubeCon + CloudNativeCon Europe. He highlights alarming cybersecurity statistics, like the $5 million average breach cost, emphasizing that complexity fuels vulnerabilities. Kontsevoy advocates for an identity-first approach, treating humans, devices, and AI as unified identities for better security. He also shares insights on Teleport’s zero trust platform and future plans for supporting AI protocols, illustrating the dual role of AI in both cybersecurity threats and solutions.

Andrew Rynhard, Founder and CTO at Sidero Labs, and Justin Garrison, Head of Product, dive into Talos Linux, a distribution crafted for Kubernetes. They discuss its unique features, including an immutable file system and the absence of SSH, promoting a more secure and automated management approach. The demo reveals Talos's API-driven philosophy and ease of deployment across various environments, from cloud to edge devices. The conversation highlights how Talos’s design minimizes human error and enhances scalability, making node management more efficient.

Sumeet Singh, CEO of Aptori and co-founder of AppFormix, dives into building AI security engineers to tackle vulnerabilities in code. He unveils how Aptori's innovative tools map real-time data flows, marking a shift from merely alerting developers to automated code fixes. The discussion covers AI's evolution in security, addressing engineer fatigue, and the startup challenges faced in creating reliable solutions. Singh emphasizes the need for transparency and a balanced approach as they navigate the future of agent-based AI in enterprise security.