The New Stack Podcast

Kong’s AI Gateway Aims to Make Building with AI Easier

Apr 3, 2025

Marco Palladino, CTO and co-founder of Kong, dives into the transformative power of AI in the tech landscape. He discusses the evolution from simple chatbots to intelligent AI agents that enhance organizational efficiency. Key topics include Kong's AI Gateway, which simplifies AI integration while addressing security concerns. Palladino highlights the automated Retrieval-Augmented Generation (RAG) feature that minimizes errors. He emphasizes the critical need for consistent security measures to empower developers to drive innovation safely.

21:05

Creator website

Episode guests

Marco Palladino

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

AI applications are advancing from simple chatbots to complex agents that improve organizational efficiency through intelligent automation.

The introduction of Kong's AI Gateway allows developers to integrate multiple AI models securely while embedding essential security measures effortlessly.

Deep dives

Challenges in Developing Generative AI Applications

Creating effective generative AI applications presents various challenges for developers and organizations. Developers aim to maximize productivity by building multiple AI applications without duplicating work on common requirements. Organizations need to provide adequate infrastructure to support these new applications while ensuring sensitive data is not mishandled or leaked. The complexity arises as organizations transition from simple chatbot applications to more sophisticated AI agents that can function almost like virtual employees, enhancing operational efficiency through intelligent automation.

Intro

2min

Navigating AI Integration: Security and Efficiency

8min

Innovative AI Gateway Solutions

6min

The Rise of Intelligent AI Agents in Business Processes

2min

Future Enhancements for AI Gateway: Streamlining Developer Efficiency

3min

AI applications are evolving beyond chatbots into more complex and transformative solutions, according to Marco Palladino, CTO and co-founder of Kong. In a recent episode of The New Stack Makers, he discussed the rise of AI agents, which act as "virtual employees" to enhance organizational efficiency. For instance, AI can now function as a product manager for APIs—analyzing documentation, detecting inaccuracies, and making corrections.

However, reliance on AI agents brings security risks, such as data leakage and governance challenges. Organizations need observability and safeguards, but developers often resist implementing these requirements manually. As GenAI adoption matures, teams seek ways to accelerate development without rebuilding security measures repeatedly.

To address these challenges, Kong introduced AI Gateway, an open-source plugin for its API Gateway. AI Gateway supports multiple AI models across providers like AWS, Microsoft, and Google, offering developers a universal API to integrate AI securely and efficiently. It also features automated retrieval-augmented generation (RAG) pipelines to minimize hallucinations.

Palladino emphasized the need for consistent security in AI infrastructure, ensuring developers can focus on innovation while leveraging built-in protections.

Learn more from The New Stack about Kong’s AI Gateway

Kong: New ‘AI-Infused’ Features for API Management, Dev Tools

From Zero to a Terraform Provider for Kong in 120 Hours

Join our community of newsletter subscribers to stay on top of the news and at the top of your game.