AI Confidential

Vijoy Pandey, Head of Outshift by Cisco, understands that an internet populated by agents requires an open, interoperable framework for agent-to-agent communication and a seismic shift in governance. That’s why Outshift by Cisco, in partnership with LangChain and Galileo, created AGNTCY — an open source collective for inter-agent collaboration. And we’re excited to announce that Opaque is a member! In this episode, Pandey talks to hosts Aaron Fulkerson and Mark Hinkle about:  His aims for AGNTCY How we create an open-source, collaborative, interoperable, and secure internet of agents If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

What would Founder, Systems Architect, and Deeptech Strategist, John Willis, like you to understand? The history of AI and the risks associated with data exhaust. Willis recently published Rebels of Reason, an AI history told through the stories of lesser-known technologists who built the foundation for modern-day AI. And one of the biggest threats he’s flagging for enterprise AI users is data exhaust, byproduct info that's generated while using digital systems. From manufacturing process details to AI model configurations, this data trail is growing fast and can be collected and exploited.  Also in this episode, you’ll hear about: Why legacy systems and tech debt still haunt AI adoption How the NORMAL stack embeds AI governance into every layer of the enterprise Why RAG isn’t dead If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

Atin Sanyal, Co-founder and CTO of Galileo, has a rich background in machine learning from companies like Uber and Apple. He dives into the intriguing challenges of AI evaluation, emphasizing the need for enhanced reliability in GenAI outputs. Atin discusses Galileo's innovative ChainPoll methodology for detecting hallucinations in language models and the importance of evolving AI quality metrics. He highlights the critical role of data quality and secure computing for enterprises, hinting at the fascinating future of AI in safe and responsible applications.

João Moura, Founder and CEO of CrewAI, discusses his vision for transforming agentic AI into a magical experience while emphasizing speed and clarity. He explores the vital role of interoperability for scaling AI and stresses the need for secure systems. Moura also addresses the perils of 'agent washing' and how managers can effectively build agents. With personal anecdotes, he underscores the importance of community in driving innovation and sheds light on the future roles of AI agents in organizations.

James Kaplan, a Partner and CTO at McKinsey Technology, shares over 25 years of expertise in guiding enterprises through tech adoption. He discusses how AI is transforming the enterprise tech landscape, emphasizing the critical need for an AI-first mindset. Kaplan addresses the 'IT doom loop,' where investments fail to drive productivity, and explores generative AI's potential in enhancing operations and cybersecurity. He also highlights the importance of collaboration and knowledge-sharing among tech leaders to responsibly embrace AI.

Sriram Raghavan, Vice President of IBM Research AI, leads a global team focused on advancing AI with a commitment to open-source principles. He discusses IBM's contributions to the Linux Foundation, emphasizing smaller, fit-for-purpose models instead of large language models. The conversation touches on the importance of transparency in AI, the challenges of regulatory compliance, and the exciting potential of innovations like the Model Context Protocol. Sriram highlights how responsible AI practices can enhance enterprise efficiency while fostering community collaboration.

From cloud computing to infrastructure-as-a-service, Reuven Cohen (AKA rUv) has been on the cutting edge of every major technology supercycle — and he’s now one of the most influential people in the agentic AI space. With the help of agents, rUv produced 10 million lines of usable code last year. That’s 33,000 years of output from one human. rUv’s approach proves one of two things: he’s either an outlier or a leading indicator of what’s to come. In this episode, we talk to rUv about:  His approach to training autonomous agents The rapid advancements in agentic code development  Why LLMs are vulnerable to data poisoning Why Python is bad for agentic development

What does it take to ensure AI is safe, ethical, and resilient? In this season finale, Anthropic’s CISO joins Aaron to discuss the critical intersection of innovation, data privacy, and sovereignty, offering an optimistic perspective on what lies ahead for the future of confidential AI.   

AI is full of potential, but what does it really take to make it work in complex environments? Will Grannis, CTO and VP at Google Cloud, shares his perspective on bridging AI innovation with practical application, including insights into the real challenges and rewards of implementing AI in today’s top enterprises.

Can AI be both innovative and private? NVIDIA VP of Software Security Daniel Rohrer and Opaque Co-Founder and President Raluca Ada Popa discuss the advancements in privacy-preserving technology that enable organizations to push AI forward without compromising data sovereignty.